00000001:02000400:3.0F:1783964835.596490:0:2977:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg412-server.virtnet: executing set_hostid 00000001:02000400:3.0:1783964852.936180:0:3199:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg412-server.virtnet: executing load_modules_local 00000001:01000000:2.0F:1783964854.739251:0:3254:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 615 MB/s 00000001:01000000:0.0F:1783964854.990527:0:3254:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 976 MB/s 00000001:01000000:3.0:1783964855.240693:0:3254:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 3947 MB/s 00000020:02000000:3.0:1783964855.972571:0:3291:0:(class_obd.c:804:obdclass_init()) Lustre: Build Version: 2.17.54_162_gc83a79c 00000400:02000000:0.0:1783964856.824742:0:3306:0:(api-ni.c:2768:lnet_startup_lndni()) Added LNI 192.168.204.112@tcp [8/256/0/180] 00008000:02000000:3.0:1783964860.263693:0:3456:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:3.0:1783964908.656190:0:5261:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg412-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1783964917.294331:0:5793:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1783964917.295189:0:5793:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1783964917.295525:0:5793:0:(super25.c:130:lustre_fill_super()) VFS Op: sb 00000000490a6289 00000080:02000400:3.0:1783964917.295538:0:5793:0:(super25.c:148:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:3.0:1783964917.304463:0:5793:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:3.0:1783964917.304479:0:5793:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1783964917.304527:0:5793:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000c04cd8e1) 00000020:00000080:3.0:1783964917.304548:0:5793:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1783964917.335895:0:5793:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:0.0:1783964917.336483:0:5793:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1783964917.373375:0:5793:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1783964917.373435:0:5793:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1783964917.373458:0:5793:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1783964917.373512:0:5793:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1783964917.373537:0:5793:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1783964917.373973:0:5793:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1783964917.373982:0:5793:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:2.0:1783964917.373994:0:5793:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe782b916994fd103 00000020:01000004:2.0:1783964917.374002:0:5793:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1783964917.374007:0:5793:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1783964917.374012:0:5793:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000490a6289 from MGS 00000020:01000004:2.0:1783964917.374017:0:5793:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1783964917.374036:0:5793:0:(genops.c:413:class_newdev()) Allocate new device MGS (0000000006b66cb3) 00000020:00000080:2.0:1783964917.374049:0:5793:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1783964917.374138:0:5793:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000490a6289 from MGS, refs=2 00080000:01000000:2.0:1783964917.374144:0:5793:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:2.0:1783964917.374150:0:5793:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe782b916994fd111 00000100:00100000:3.0:1783964917.383966:0:5793:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1783964917.384133:0:5793:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1783964917.384139:0:5793:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1783964917.384876:0:5793:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1783964917.384886:0:5793:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1783964917.385861:0:5793:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783964917.386006:0:5793:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1783964917.386020:0:5793:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1783964917.393664:0:5793:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1783964917.393693:0:5793:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1783964917.398112:0:5793:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1783964917.398126:0:5793:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1783964917.400664:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783964917.400669:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783964917.400671:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783964917.401441:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783964917.401445:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783964917.401446:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783964917.402045:0:5793:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1783964917.407346:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:1.0F:1783964917.651461:0:5793:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2783 MB/s 00000001:01000000:3.0:1783964917.901308:0:5793:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 5831 MB/s 00000001:01000000:1.0:1783964918.151905:0:5793:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 963 MB/s 00000001:01000000:3.0:1783964918.402873:0:5793:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 749 MB/s 00080000:10000000:1.0:1783964918.422000:0:5793:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00010000:00010000:2.0:1783964918.454978:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1783964918.468525:0:5793:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:1.0:1783964918.468544:0:5793:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1783964918.468547:0:5793:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:1.0:1783964918.470498:0:5803:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1783964918.470554:0:5793:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1783964918.473180:0:5793:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:1.0:1783964918.473465:0:5793:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1783964918.473494:0:5793:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1783964918.473815:0:5793:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1783964918.473970:0:5793:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1783964918.473988:0:5793:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1783964918.475389:0:5793:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1783964918.475553:0:5793:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:1.0:1783964918.476493:0:5793:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1783964918.476574:0:5793:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1783964918.477873:0:5793:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1783964918.477896:0:5793:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.112@tcp' 00000020:01000004:3.0:1783964918.477898:0:5793:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1783964918.477949:0:5793:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.112@tcp (typ=mgc) 00000020:00000080:3.0:1783964918.477961:0:5793:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.112@tcp (0000000024974c3e) 00000020:00000080:3.0:1783964918.477977:0:5793:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1783964918.478262:0:5793:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000063fb75cd@MGC192.168.204.112@tcp: add connection 192.168.204.112@tcp at head 00010000:00010000:3.0:1783964918.478423:0:5793:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.112@tcp-0 is initialized 00000040:01000000:3.0:1783964918.478430:0:5793:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.112@tcp ctxt 1 is initialized 10000000:01000000:2.0:1783964918.479682:0:5809:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1783964918.479735:0:5793:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.112@tcp (uuid ae0997f7-3a15-4fc6-865a-35b2f101956e) 00000020:00000080:2.0:1783964918.479753:0:5793:0:(genops.c:1406:class_connect()) connect: client ae0997f7-3a15-4fc6-865a-35b2f101956e, cookie 0xe782b916994fd11f 00000100:00080000:2.0:1783964918.480565:0:5793:0:(import.c:510:import_select_connection()) MGC192.168.204.112@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1783964918.480576:0:5793:0:(import.c:624:import_select_connection()) MGC192.168.204.112@tcp: import 0000000063fb75cd using connection 192.168.204.112@tcp/0@lo 00000100:00100000:2.0:1783964918.480620:0:5793:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000001072c15b x1870622732845184/t0(0) o250->MGC192.168.204.112@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783964918.480643:0:5793:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import ae0997f7-3a15-4fc6-865a-35b2f101956e->MGS 00000020:01000004:2.0:1783964918.480662:0:5793:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1783964918.480673:0:5793:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1783964918.480685:0:5793:0:(genops.c:413:class_newdev()) Allocate new device MDS (00000000baf8bd9b) 00000020:00000080:2.0:1783964918.480698:0:5793:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1783964918.481342:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000001072c15b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ae0997f7-3a15-4fc6-865a-35b2f101956e:3321:1870622732845184:0@lo:250: 00000100:00100000:1.0:1783964918.481435:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783964918.481508:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732845184 00000100:00100000:1.0:1783964918.481517:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732845184 00000100:00100000:1.0:1783964918.481560:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783964918.481566:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ef041770 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3321:x1870622732845184:12345-0@lo:250: 00010000:00080000:1.0:1783964918.481590:0:5805:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from ae0997f7-3a15-4fc6-865a-35b2f101956e@0@lo t0 exp 0000000000000000 cur 152 last 0 00000020:00000080:1.0:1783964918.481612:0:5805:0:(genops.c:1406:class_connect()) connect: client ae0997f7-3a15-4fc6-865a-35b2f101956e, cookie 0xe782b916994fd12d 00000100:00080000:1.0:1783964918.481734:0:5805:0:(import.c:65:import_set_state_nolock()) 00000000a64725c4 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783964918.481786:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ef041770 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+5:3321:x1870622732845184:12345-0@lo:250: Request processed in 218us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1783964918.481794:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783964918.481827:0:3321:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.204.112@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1783964918.481835:0:3321:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.204.112@tcp: connect to target with instance 0 00000100:00080000:1.0:1783964918.481840:0:3321:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.204.112@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1783964918.481844:0:3321:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1783964918.481854:0:3321:0:(import.c:65:import_set_state_nolock()) 0000000063fb75cd MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1783964918.481857:0:3321:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1783964918.481861:0:3321:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1783964918.481865:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000001072c15b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ae0997f7-3a15-4fc6-865a-35b2f101956e:3321:1870622732845184:0@lo:250: 00000100:00080000:1.0:1783964918.481924:0:5808:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000100:00100000:2.0:1783964918.493469:0:5793:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783964918.493664:0:5793:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:2.0:1783964918.493670:0:5793:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1783964918.495184:0:5793:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1783964918.495194:0:5793:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:2.0:1783964918.496946:0:5793:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:2.0:1783964918.496959:0:5793:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1783964918.498499:0:5793:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783964918.498727:0:5793:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1783964918.498733:0:5793:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:0.0:1783964918.499510:0:5793:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:0.0:1783964918.499517:0:5793:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1783964918.549749:0:5793:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783964918.549965:0:5793:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1783964918.549973:0:5793:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1783964918.551197:0:5793:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1783964918.551252:0:5793:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1783964918.551855:0:5793:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783964918.552008:0:5793:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1783964918.552013:0:5793:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:1.0:1783964918.552504:0:5793:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:1.0:1783964918.552512:0:5793:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1783964918.552972:0:5793:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1783964918.553110:0:5793:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1783964918.553115:0:5793:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1783964918.553725:0:5793:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1783964918.553732:0:5793:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1783964918.554338:0:5793:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783964918.554482:0:5793:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1783964918.554487:0:5793:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1783964918.555147:0:5793:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1783964918.555156:0:5793:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1783964918.587150:0:5793:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1783964918.587408:0:5793:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1783964918.587425:0:5793:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1783964918.593245:0:5793:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1783964918.593263:0:5793:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1783964918.601196:0:5793:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1783964918.601288:0:5793:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1783964918.608433:0:5793:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1783964918.608465:0:5793:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:1.0:1783964918.608473:0:5793:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.112@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1783964918.608606:0:5793:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.112@tcp ctxt 0 is initialized 00000020:01000004:1.0:1783964918.608641:0:5793:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.112@tcp, index=0000, flags=0x20065 00000020:01000004:1.0:1783964918.608645:0:5793:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1783964918.608647:0:5793:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1783964918.608649:0:5793:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783964918.608650:0:5793:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783964918.608651:0:5793:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783964918.608653:0:5793:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783964918.608659:0:5793:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1783964918.608660:0:5793:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1783964918.608662:0:5793:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1783964918.608663:0:5793:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1783964918.608665:0:5793:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783964918.608666:0:5793:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1783964918.608668:0:5793:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:1.0:1783964918.608670:0:5793:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1783964918.608671:0:5793:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1783964918.608672:0:5793:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783964918.608673:0:5793:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783964918.608674:0:5793:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783964918.608675:0:5793:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783964918.608675:0:5793:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1783964918.608676:0:5793:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1783964918.608677:0:5793:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1783964918.608678:0:5793:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1783964918.608679:0:5793:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783964918.608679:0:5793:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1783964918.608716:0:5793:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1783964918.608735:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003f0446f4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae0997f7-3a15-4fc6-865a-35b2f101956e:5793:1870622732845312:0@lo:253: 00000100:00100000:1.0:1783964918.608817:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783964918.609150:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set 00000000e05b81f1 going to sleep for 11 seconds 00000100:00100000:0.0:1783964918.609249:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732845312 00000100:00100000:0.0:1783964918.609257:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732845312 00000100:00100000:0.0:1783964918.609356:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783964918.609365:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bea00336 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae0997f7-3a15-4fc6-865a-35b2f101956e+5:5793:x1870622732845312:12345-0@lo:253: 20000000:01000000:0.0:1783964918.609418:0:5807:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1783964918.609421:0:5807:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:2.0:1783964918.609736:0:5827:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1783964918.609789:0:5807:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:0.0:1783964918.610080:0:5807:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783964918.611150:0:5828:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:0.0:1783964918.611541:0:5807:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1783964918.611545:0:5807:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:0.0:1783964918.611550:0:5807:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:0.0:1783964918.611554:0:5807:0:(mgs_llog.c:3608:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:0.0:1783964918.611572:0:5807:0:(mgs_llog.c:3168:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:0.0:1783964918.611804:0:5807:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783964918.612072:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:0.0:1783964918.612085:0:5807:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1783964918.612134:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:0.0:1783964918.612183:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:0.0:1783964918.612279:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:0.0:1783964918.612370:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:0.0:1783964918.612379:0:5807:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:0.0:1783964918.612425:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:0.0:1783964918.612434:0:5807:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:0.0:1783964918.612479:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:0.0:1783964918.612488:0:5807:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:0.0:1783964918.612520:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:0.0:1783964918.612572:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:0.0:1783964918.612603:0:5807:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1783964918.612607:0:5807:0:(mgs_llog.c:3168:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:0.0:1783964918.612619:0:5807:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783964918.612818:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:0.0:1783964918.612827:0:5807:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1783964918.612866:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:0.0:1783964918.612899:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:0.0:1783964918.612944:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:0.0:1783964918.612955:0:5807:0:(mgs_llog.c:3125:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:0.0:1783964918.613028:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:0.0:1783964918.613037:0:5807:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1783964918.613084:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:0.0:1783964918.613121:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:0.0:1783964918.613154:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:0.0:1783964918.613163:0:5807:0:(mgs_llog.c:3090:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:0.0:1783964918.613292:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:0.0:1783964918.613302:0:5807:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:0.0:1783964918.613334:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:0.0:1783964918.613368:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:0.0:1783964918.613547:0:5807:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:0.0:1783964918.613596:0:5807:0:(mgs_llog.c:3305:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:0.0:1783964918.613603:0:5807:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:2.0:1783964918.614580:0:5829:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:0.0:1783964918.615011:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:0.0:1783964918.615041:0:5807:0:(mgs_llog.c:3351:mgs_write_log_mdc_to_lmv()) add nid 192.168.204.112@tcp for mdt 20000000:01000000:0.0:1783964918.615043:0:5807:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.112@tcp (null) (null) (null) 00000040:00080000:0.0:1783964918.615087:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:0.0:1783964918.615095:0:5807:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1783964918.615152:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:0.0:1783964918.615160:0:5807:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.204.112@tcp (null) (null) 00000040:00080000:0.0:1783964918.618090:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:0.0:1783964918.618122:0:5807:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:0.0:1783964918.618371:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:0.0:1783964918.618417:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:0.0:1783964918.618552:0:5807:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1783964918.618556:0:5807:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1783964918.618575:0:5807:0:(mgs_llog.c:5068:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:0.0:1783964918.618581:0:5807:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:0.0:1783964918.625709:0:5830:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 20000000:02000000:1.0:1783964918.625899:0:5807:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:1.0:1783964918.638380:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:1.0:1783964918.638438:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 160 off10176 00000040:00080000:1.0:1783964918.638562:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10400 20000000:01000000:1.0:1783964918.638584:0:5807:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1783964918.638587:0:5807:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1783964918.638590:0:5807:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1783964918.638603:0:5807:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1783964918.638605:0:5807:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1783964918.638634:0:5807:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1783964918.638637:0:5807:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1783964918.641255:0:5831:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 00000040:00080000:0.0:1783964918.642050:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10624 00000040:00080000:0.0:1783964918.642101:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 80 off10704 00000040:00080000:0.0:1783964918.642178:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 20000000:01000000:0.0:1783964918.642194:0:5807:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1783964918.642197:0:5807:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:3.0:1783964918.643146:0:5832:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:0.0:1783964918.643472:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:0.0:1783964918.643521:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:0.0:1783964918.643556:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:0.0:1783964918.643571:0:5807:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1783964918.643573:0:5807:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 100 to 20 10000000:01000000:0.0:1783964918.643579:0:5807:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1783964918.643600:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000006ebf2baa/0xe782b916994fd134 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964918.643618:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006ebf2baa/0xe782b916994fd134 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964918.643629:0:5807:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000006ebf2baa/0xe782b916994fd134 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964918.643635:0:5807:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000006ebf2baa/0xe782b916994fd134 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964918.643641:0:5807:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000006ebf2baa/0xe782b916994fd134 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964918.643648:0:5807:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000006ebf2baa/0xe782b916994fd134 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964918.643668:0:5807:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000006ebf2baa already unused, calling callback (00000000c6a2ab5d) 00010000:00010000:0.0:1783964918.643673:0:5807:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000006ebf2baa/0xe782b916994fd134 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964918.643680:0:5807:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000006ebf2baa/0xe782b916994fd134 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964918.643693:0:5807:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000006ebf2baa/0xe782b916994fd134 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964918.643701:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000006ebf2baa/0xe782b916994fd134 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964918.643706:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000006ebf2baa/0xe782b916994fd134 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1783964918.643724:0:5807:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1783964918.978274:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bea00336 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae0997f7-3a15-4fc6-865a-35b2f101956e+5:5793:x1870622732845312:12345-0@lo:253: Request processed in 368903us (369450us total) trans 0 rc 0/0 00000100:00100000:1.0:1783964918.978301:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783964918.978411:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003f0446f4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae0997f7-3a15-4fc6-865a-35b2f101956e:5793:1870622732845312:0@lo:253: 10000000:01000000:0.0:1783964918.978426:0:5793:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1783964918.978429:0:5793:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1783964918.978431:0:5793:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1783964918.978432:0:5793:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783964918.978434:0:5793:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:0.0:1783964918.978435:0:5793:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783964918.978436:0:5793:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783964918.978437:0:5793:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1783964918.978439:0:5793:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1783964918.978440:0:5793:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1783964918.978441:0:5793:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783964918.978442:0:5793:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1783964918.978461:0:5793:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000490a6289 from lustre-MDT0000 10000000:01000000:0.0:1783964918.978485:0:5793:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1783964918.978492:0:5793:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1783964918.978497:0:5793:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff947407224d40 10000000:01000000:0.0:1783964918.978502:0:5793:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1783964918.978509:0:5793:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff947407224d40 from 1 10000000:01000000:0.0:1783964918.978511:0:5793:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1783964918.978558:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.112@tcp lock: 000000006ebf2baa/0xe782b916994fd13b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964918.978568:0:5793:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.112@tcp lock: 000000006ebf2baa/0xe782b916994fd13b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964918.978576:0:5793:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.112@tcp lock: 000000006ebf2baa/0xe782b916994fd13b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783964918.978593:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000084145437 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae0997f7-3a15-4fc6-865a-35b2f101956e:5793:1870622732845440:0@lo:101: 00000100:00100000:0.0:1783964918.978625:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783964918.978725:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732845440 00000100:00100000:1.0:1783964918.978731:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732845440 00000100:00100000:1.0:1783964918.978773:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783964918.978780:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000005e7430 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae0997f7-3a15-4fc6-865a-35b2f101956e+5:5793:x1870622732845440:12345-0@lo:101: 00010000:00010000:1.0:1783964918.978793:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783964918.978805:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000029110dd7/0xe782b916994fd142 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe782b916994fd13b expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964918.978825:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000029110dd7/0xe782b916994fd142 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe782b916994fd13b expref: 6 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964918.978844:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000029110dd7/0xe782b916994fd142 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe782b916994fd13b expref: 6 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964918.978852:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000029110dd7, rc 0) 00000100:00100000:1.0:1783964918.978876:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000005e7430 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae0997f7-3a15-4fc6-865a-35b2f101956e+6:5793:x1870622732845440:12345-0@lo:101: Request processed in 97us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1783964918.978881:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783964918.979037:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set 00000000020face7 going to sleep for 11 seconds 00000100:00100000:0.0:1783964918.979049:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000084145437 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae0997f7-3a15-4fc6-865a-35b2f101956e:5793:1870622732845440:0@lo:101: 00010000:00010000:0.0:1783964918.979061:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.112@tcp lock: 000000006ebf2baa/0xe782b916994fd13b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fd142 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964918.979069:0:5793:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.112@tcp lock: 000000006ebf2baa/0xe782b916994fd13b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe782b916994fd142 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783964918.979112:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000084145437 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae0997f7-3a15-4fc6-865a-35b2f101956e:5793:1870622732845568:0@lo:501: 00000100:00100000:0.0:1783964918.979133:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783964918.979146:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set 00000000020face7 going to sleep for 11 seconds 00000100:00100000:1.0:1783964918.979225:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732845568 00000100:00100000:1.0:1783964918.979239:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732845568 00000100:00100000:1.0:1783964918.979266:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783964918.979271:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000073ef62bf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae0997f7-3a15-4fc6-865a-35b2f101956e+6:5793:x1870622732845568:12345-0@lo:501: 00000100:00100000:1.0:1783964918.979472:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000073ef62bf pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae0997f7-3a15-4fc6-865a-35b2f101956e+6:5793:x1870622732845568:12345-0@lo:501: Request processed in 201us (338us total) trans 0 rc -2/-2 00000100:00100000:1.0:1783964918.979479:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783964918.979543:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000084145437 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae0997f7-3a15-4fc6-865a-35b2f101956e:5793:1870622732845568:0@lo:501: 10000000:01000000:2.0:1783964918.979568:0:5793:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.112@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1783964918.979583:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.112@tcp lock: 000000006ebf2baa/0xe782b916994fd13b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fd142 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783964918.979591:0:5793:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.112@tcp lock: 000000006ebf2baa/0xe782b916994fd13b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fd142 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783964918.979597:0:5793:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff947403dc3000 10000000:01000000:2.0:1783964918.979601:0:5793:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1783964918.979604:0:5793:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff947403dc3000 10000000:01000000:2.0:1783964918.979607:0:5793:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1783964918.979609:0:5793:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff947403dc3000 from 1 10000000:01000000:2.0:1783964918.979611:0:5793:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1783964918.979627:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.112@tcp lock: 000000005867c7ea/0xe782b916994fd149 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783964918.979633:0:5793:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.112@tcp lock: 000000005867c7ea/0xe782b916994fd149 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783964918.979655:0:5793:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.112@tcp lock: 000000005867c7ea/0xe782b916994fd149 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783964918.979667:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000e08df2a5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae0997f7-3a15-4fc6-865a-35b2f101956e:5793:1870622732845696:0@lo:101: 00000100:00100000:2.0:1783964918.979709:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783964918.979728:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set 00000000a73c5d13 going to sleep for 11 seconds 00000100:00100000:2.0:1783964918.979743:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732845696 00000100:00100000:2.0:1783964918.979747:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732845696 00000100:00100000:2.0:1783964918.979764:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783964918.979769:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001a70118a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+6:5793:x1870622732845696:12345-0@lo:101: 00010000:00010000:2.0:1783964918.979775:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783964918.979783:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000fe136eca/0xe782b916994fd150 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe782b916994fd149 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783964918.979795:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000fe136eca/0xe782b916994fd150 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe782b916994fd149 expref: 7 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783964918.979802:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000fe136eca/0xe782b916994fd150 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe782b916994fd149 expref: 7 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783964918.979809:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000fe136eca, rc 0) 00000100:00100000:2.0:1783964918.979830:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001a70118a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+7:5793:x1870622732845696:12345-0@lo:101: Request processed in 62us (122us total) trans 0 rc 0/0 00000100:00100000:2.0:1783964918.979849:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783964918.979876:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000e08df2a5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae0997f7-3a15-4fc6-865a-35b2f101956e:5793:1870622732845696:0@lo:101: 00010000:00010000:2.0:1783964918.979884:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.112@tcp lock: 000000005867c7ea/0xe782b916994fd149 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fd150 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783964918.979899:0:5793:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.112@tcp lock: 000000005867c7ea/0xe782b916994fd149 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe782b916994fd150 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783964918.979910:0:5793:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.112@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1783964918.979912:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.112@tcp lock: 000000005867c7ea/0xe782b916994fd149 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fd150 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783964918.979918:0:5793:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.112@tcp lock: 000000005867c7ea/0xe782b916994fd149 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fd150 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783964918.979923:0:5793:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1783964918.979925:0:5793:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1783964918.979929:0:5793:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff947403dc3000 10000000:01000000:2.0:1783964918.979931:0:5793:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1783964918.979933:0:5793:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1783964918.979935:0:5793:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1783964918.979945:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.112@tcp lock: 0000000040f2f922/0xe782b916994fd157 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783964918.979951:0:5793:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.112@tcp lock: 0000000040f2f922/0xe782b916994fd157 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783964918.979957:0:5793:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.112@tcp lock: 0000000040f2f922/0xe782b916994fd157 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783964918.979966:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000e08df2a5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae0997f7-3a15-4fc6-865a-35b2f101956e:5793:1870622732845824:0@lo:101: 00000100:00100000:2.0:1783964918.979987:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783964918.979999:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set 00000000a73c5d13 going to sleep for 11 seconds 00000100:00100000:2.0:1783964918.980017:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732845824 00000100:00100000:2.0:1783964918.980020:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732845824 00000100:00100000:2.0:1783964918.980036:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783964918.980040:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000122aaa50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+7:5793:x1870622732845824:12345-0@lo:101: 00010000:00010000:2.0:1783964918.980046:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783964918.980052:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000001e49d806/0xe782b916994fd15e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe782b916994fd157 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783964918.980063:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001e49d806/0xe782b916994fd15e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe782b916994fd157 expref: 8 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783964918.980070:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000001e49d806/0xe782b916994fd15e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe782b916994fd157 expref: 8 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783964918.980075:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000001e49d806, rc 0) 00000100:00100000:2.0:1783964918.980105:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000122aaa50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+8:5793:x1870622732845824:12345-0@lo:101: Request processed in 65us (118us total) trans 0 rc 0/0 00000100:00100000:2.0:1783964918.980111:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783964918.980139:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000e08df2a5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae0997f7-3a15-4fc6-865a-35b2f101956e:5793:1870622732845824:0@lo:101: 00010000:00010000:2.0:1783964918.980147:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.112@tcp lock: 0000000040f2f922/0xe782b916994fd157 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fd15e expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783964918.980153:0:5793:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.112@tcp lock: 0000000040f2f922/0xe782b916994fd157 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe782b916994fd15e expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783964918.980187:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000e08df2a5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae0997f7-3a15-4fc6-865a-35b2f101956e:5793:1870622732845952:0@lo:501: 00000100:00100000:2.0:1783964918.980256:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783964918.980272:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set 00000000a73c5d13 going to sleep for 11 seconds 00000100:00100000:2.0:1783964918.980284:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732845952 00000100:00100000:2.0:1783964918.980292:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732845952 00000100:00100000:2.0:1783964918.980310:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783964918.980314:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b0e5d4b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+8:5793:x1870622732845952:12345-0@lo:501: 00000100:00100000:2.0:1783964918.980492:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b0e5d4b4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+9:5793:x1870622732845952:12345-0@lo:501: Request processed in 177us (235us total) trans 0 rc 0/0 00000100:00100000:2.0:1783964918.980499:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783964918.980528:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000e08df2a5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae0997f7-3a15-4fc6-865a-35b2f101956e:5793:1870622732845952:0@lo:501: 00000100:00100000:2.0:1783964918.980553:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000e08df2a5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae0997f7-3a15-4fc6-865a-35b2f101956e:5793:1870622732846080:0@lo:503: 00000100:00100000:2.0:1783964918.980592:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783964918.980604:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set 00000000a73c5d13 going to sleep for 11 seconds 00000100:00100000:2.0:1783964918.980615:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732846080 00000100:00100000:2.0:1783964918.980619:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732846080 00000100:00100000:2.0:1783964918.980634:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1783964918.980638:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000b870d51 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+9:5793:x1870622732846080:12345-0@lo:503: 00000100:00100000:2.0:1783964918.980775:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000b870d51 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+9:5793:x1870622732846080:12345-0@lo:503: Request processed in 136us (182us total) trans 0 rc 0/0 00000100:00100000:2.0:1783964918.980782:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1783964918.980819:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000e08df2a5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae0997f7-3a15-4fc6-865a-35b2f101956e:5793:1870622732846080:0@lo:503: 00000100:00100000:2.0:1783964918.981027:0:5836:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000e08df2a5 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae0997f7-3a15-4fc6-865a-35b2f101956e:5836:1870622732846208:0@lo:502: 00000100:00100000:2.0:1783964918.981063:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783964918.981081:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732846208 00000100:00100000:2.0:1783964918.981084:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732846208 00000100:00100000:2.0:1783964918.981100:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1783964918.981105:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b0c64090 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+9:5836:x1870622732846208:12345-0@lo:502: 00000100:00100000:2.0:1783964918.981278:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b0c64090 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+9:5836:x1870622732846208:12345-0@lo:502: Request processed in 173us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1783964918.981293:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1783964918.981325:0:5836:0:(client.c:2702:ptlrpc_set_wait()) set 000000001544f21a going to sleep for 11 seconds 00000100:00100000:2.0:1783964918.981337:0:5836:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000e08df2a5 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae0997f7-3a15-4fc6-865a-35b2f101956e:5836:1870622732846208:0@lo:502: 00000020:01000000:2.0:1783964918.981356:0:5836:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783964918.981366:0:5836:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783964918.981368:0:5836:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1783964918.981373:0:5836:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1783964918.981375:0:5836:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1783964918.981389:0:5836:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (000000008b02f3ba) 00000020:00000080:2.0:1783964918.981405:0:5836:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1783964918.981409:0:5836:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1783964918.981475:0:5836:0:(osd_handler.c:1569:osd_obd_connect()) connect #2 00000020:00000080:2.0:1783964918.981483:0:5836:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe782b916994fd16c 00000020:00000080:2.0:1783964918.981700:0:5836:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1783964918.981704:0:5836:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783964918.981708:0:5836:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783964918.981709:0:5836:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1783964918.981712:0:5836:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783964918.981715:0:5836:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783964918.981716:0:5836:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1783964918.981719:0:5836:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1783964918.981726:0:5836:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000a63ed299) 00000020:00000080:2.0:1783964918.981734:0:5836:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1783964918.981737:0:5836:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1783964918.981738:0:5836:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1783964918.981741:0:5836:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1783964918.981746:0:5836:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1783964918.981790:0:5836:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000490a6289 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1783964918.981807:0:5836:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (000000008a51ac72) 00000020:00000080:2.0:1783964918.981817:0:5836:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1783964918.981891:0:5836:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1783964918.981899:0:5836:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe782b916994fd181 00000020:00000080:2.0:1783964918.981999:0:5836:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1783964918.982005:0:5836:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1783964918.982010:0:5836:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xe782b916994fd188 00080000:01000000:2.0:1783964918.982014:0:5836:0:(osd_handler.c:1569:osd_obd_connect()) connect #3 00000020:00000080:2.0:1783964918.982017:0:5836:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe782b916994fd18f 00080000:10000000:2.0:1783964918.982467:0:5836:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:2.0:1783964918.982662:0:5836:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:2.0:1783964918.994092:0:5836:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:3.0:1783964919.069602:0:5836:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:3.0:1783964919.070195:0:5836:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:3.0:1783964919.074168:0:5836:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1783964919.074918:0:5836:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1783964919.117610:0:5836:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000ebbbee2f) 00000020:00000080:3.0:1783964919.117632:0:5836:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1783964919.117765:0:5836:0:(osd_handler.c:1569:osd_obd_connect()) connect #4 00000020:00000080:3.0:1783964919.117772:0:5836:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe782b916994fd19d 00000020:00000080:1.0:1783964919.123062:0:5836:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:1.0:1783964919.124381:0:5836:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:0.0:1783964919.185936:0:5836:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:2.0:1783964919.249992:0:5836:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:1.0:1783964919.337476:0:5836:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:2.0:1783964919.385031:0:5836:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:1.0:1783964919.426395:0:5836:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:2.0:1783964919.459728:0:5836:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xe782b916994fd1a4 00000020:00000080:2.0:1783964919.460375:0:5836:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1783964919.460388:0:5836:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783964919.460393:0:5836:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783964919.460396:0:5836:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1783964919.460399:0:5836:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783964919.460404:0:5836:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783964919.460406:0:5836:0:(obd_config.c:1561:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1783964919.460410:0:5836:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1783964919.460442:0:5836:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:2.0:1783964919.460454:0:5836:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783964919.460457:0:5836:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783964919.460458:0:5836:0:(obd_config.c:1561:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:2.0:1783964919.460460:0:5836:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783964919.460462:0:5836:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783964919.460464:0:5836:0:(obd_config.c:1561:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:2.0:1783964919.460466:0:5836:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1783964919.460467:0:5836:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1783964919.460513:0:5836:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000e08df2a5 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae0997f7-3a15-4fc6-865a-35b2f101956e:5836:1870622732846336:0@lo:502: 00000100:00100000:2.0:1783964919.460595:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783964919.460702:0:5836:0:(client.c:2702:ptlrpc_set_wait()) set 00000000315feab5 going to sleep for 11 seconds 00000100:00100000:0.0:1783964919.460971:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732846336 00000100:00100000:0.0:1783964919.460984:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732846336 00000100:00100000:0.0:1783964919.461067:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1783964919.461076:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001d59bb21 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+9:5836:x1870622732846336:12345-0@lo:502: 00000100:00100000:0.0:1783964919.461425:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001d59bb21 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+9:5836:x1870622732846336:12345-0@lo:502: Request processed in 350us (830us total) trans 0 rc 0/0 00000100:00100000:0.0:1783964919.461433:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783964919.461518:0:5836:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000e08df2a5 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae0997f7-3a15-4fc6-865a-35b2f101956e:5836:1870622732846336:0@lo:502: 00000020:01000000:2.0:1783964919.461545:0:5836:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783964919.461549:0:5836:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783964919.461551:0:5836:0:(obd_config.c:1561:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000040:00080000:2.0:1783964919.461554:0:5836:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:3.0:1783964919.461766:0:5793:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:3.0:1783964919.461785:0:5793:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.112@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1783964919.461805:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.112@tcp lock: 0000000040f2f922/0xe782b916994fd157 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fd15e expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964919.461816:0:5793:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.112@tcp lock: 0000000040f2f922/0xe782b916994fd157 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fd15e expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783964919.461824:0:5793:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff947403dc3000 from 1 10000000:01000000:3.0:1783964919.461828:0:5793:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1783964919.461877:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.112@tcp lock: 0000000000693523/0xe782b916994fd1ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964919.461885:0:5793:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.112@tcp lock: 0000000000693523/0xe782b916994fd1ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964919.461893:0:5793:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.112@tcp lock: 0000000000693523/0xe782b916994fd1ab lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783964919.461909:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000025b2c4e4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae0997f7-3a15-4fc6-865a-35b2f101956e:5793:1870622732846464:0@lo:101: 00000100:00100000:3.0:1783964919.461955:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783964919.462171:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set 000000008f3cd8f2 going to sleep for 11 seconds 00000100:00100000:1.0:1783964919.462372:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732846464 00000100:00100000:1.0:1783964919.462378:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732846464 00000100:00100000:1.0:1783964919.462406:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1783964919.462412:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004f78964a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae0997f7-3a15-4fc6-865a-35b2f101956e+9:5793:x1870622732846464:12345-0@lo:101: 00010000:00010000:1.0:1783964919.462425:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783964919.462438:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000006f16ee47/0xe782b916994fd1b2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe782b916994fd1ab expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964919.462458:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006f16ee47/0xe782b916994fd1b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe782b916994fd1ab expref: 10 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964919.462467:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000006f16ee47/0xe782b916994fd1b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe782b916994fd1ab expref: 10 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964919.462475:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000006f16ee47, rc 0) 00000100:00100000:1.0:1783964919.462556:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004f78964a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae0997f7-3a15-4fc6-865a-35b2f101956e+10:5793:x1870622732846464:12345-0@lo:101: Request processed in 144us (600us total) trans 0 rc 0/0 00000100:00100000:1.0:1783964919.462562:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1783964919.462745:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000025b2c4e4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae0997f7-3a15-4fc6-865a-35b2f101956e:5793:1870622732846464:0@lo:101: 00010000:00010000:3.0:1783964919.462767:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.112@tcp lock: 0000000000693523/0xe782b916994fd1ab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fd1b2 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964919.462774:0:5793:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.112@tcp lock: 0000000000693523/0xe782b916994fd1ab lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe782b916994fd1b2 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783964919.463359:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000025b2c4e4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae0997f7-3a15-4fc6-865a-35b2f101956e:5793:1870622732846592:0@lo:256: 00000100:00100000:3.0:1783964919.463402:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783964919.463437:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set 000000008f3cd8f2 going to sleep for 11 seconds 00000100:00100000:1.0:1783964919.463729:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732846592 00000100:00100000:1.0:1783964919.463735:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732846592 00000100:00100000:1.0:1783964919.463768:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1783964919.463774:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000061fcf4d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae0997f7-3a15-4fc6-865a-35b2f101956e+10:5793:x1870622732846592:12345-0@lo:256: 20000000:01000000:1.0:1783964919.463791:0:5806:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1783964919.463796:0:5806:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1783964919.463874:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000061fcf4d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae0997f7-3a15-4fc6-865a-35b2f101956e+10:5793:x1870622732846592:12345-0@lo:256: Request processed in 100us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1783964919.463880:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1783964919.464049:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000025b2c4e4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae0997f7-3a15-4fc6-865a-35b2f101956e:5793:1870622732846592:0@lo:256: 10000000:01000000:3.0:1783964919.464769:0:5793:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.112@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1783964919.464836:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.112@tcp lock: 0000000000693523/0xe782b916994fd1ab lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fd1b2 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964919.464856:0:5793:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.112@tcp lock: 0000000000693523/0xe782b916994fd1ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fd1b2 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783964919.464863:0:5793:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff947403dc3000 from 1 10000000:01000000:3.0:1783964919.464866:0:5793:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783964919.464893:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.112@tcp lock: 00000000dc495833/0xe782b916994fd1b9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964919.464899:0:5793:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.112@tcp lock: 00000000dc495833/0xe782b916994fd1b9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964919.464907:0:5793:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.112@tcp lock: 00000000dc495833/0xe782b916994fd1b9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783964919.464923:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000025b2c4e4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae0997f7-3a15-4fc6-865a-35b2f101956e:5793:1870622732846720:0@lo:101: 00000100:00100000:3.0:1783964919.464966:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783964919.465003:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set 000000008f3cd8f2 going to sleep for 11 seconds 00000100:00100000:0.0:1783964919.465124:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732846720 00000100:00100000:0.0:1783964919.465129:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732846720 00000100:00100000:0.0:1783964919.465171:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1783964919.465178:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008b73abc7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae0997f7-3a15-4fc6-865a-35b2f101956e+10:5793:x1870622732846720:12345-0@lo:101: 00010000:00010000:0.0:1783964919.465188:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783964919.465230:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000a561e062/0xe782b916994fd1c0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe782b916994fd1b9 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964919.465250:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000a561e062/0xe782b916994fd1c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe782b916994fd1b9 expref: 11 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964919.465259:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000a561e062/0xe782b916994fd1c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe782b916994fd1b9 expref: 11 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964919.465267:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000a561e062, rc 0) 00000100:00100000:0.0:1783964919.465298:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008b73abc7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae0997f7-3a15-4fc6-865a-35b2f101956e+11:5793:x1870622732846720:12345-0@lo:101: Request processed in 121us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1783964919.465304:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1783964919.465441:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000025b2c4e4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae0997f7-3a15-4fc6-865a-35b2f101956e:5793:1870622732846720:0@lo:101: 00010000:00010000:3.0:1783964919.465452:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.112@tcp lock: 00000000dc495833/0xe782b916994fd1b9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fd1c0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964919.465460:0:5793:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.112@tcp lock: 00000000dc495833/0xe782b916994fd1b9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe782b916994fd1c0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783964919.465502:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000025b2c4e4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae0997f7-3a15-4fc6-865a-35b2f101956e:5793:1870622732846848:0@lo:501: 00000100:00100000:3.0:1783964919.465523:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783964919.465548:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set 000000008f3cd8f2 going to sleep for 11 seconds 00000100:00100000:0.0:1783964919.465588:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732846848 00000100:00100000:0.0:1783964919.465592:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732846848 00000100:00100000:0.0:1783964919.465617:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1783964919.465622:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e2ccfb76 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae0997f7-3a15-4fc6-865a-35b2f101956e+11:5793:x1870622732846848:12345-0@lo:501: 00000100:00100000:0.0:1783964919.466574:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e2ccfb76 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae0997f7-3a15-4fc6-865a-35b2f101956e+11:5793:x1870622732846848:12345-0@lo:501: Request processed in 951us (1049us total) trans 0 rc 0/0 00000100:00100000:0.0:1783964919.466588:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1783964919.467141:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000025b2c4e4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae0997f7-3a15-4fc6-865a-35b2f101956e:5793:1870622732846848:0@lo:501: 00000100:00100000:3.0:1783964919.467188:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000025b2c4e4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae0997f7-3a15-4fc6-865a-35b2f101956e:5793:1870622732846976:0@lo:503: 00000100:00100000:3.0:1783964919.467259:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783964919.467286:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set 000000008f3cd8f2 going to sleep for 11 seconds 00000100:00100000:3.0:1783964919.467319:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732846976 00000100:00100000:3.0:1783964919.467325:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732846976 00000100:00100000:3.0:1783964919.467356:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1783964919.467362:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000033263f17 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+11:5793:x1870622732846976:12345-0@lo:503: 00000040:00080000:3.0:1783964919.467405:0:5805:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1783964919.467443:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000033263f17 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+11:5793:x1870622732846976:12345-0@lo:503: Request processed in 82us (184us total) trans 0 rc 0/0 00000100:00100000:3.0:1783964919.467449:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1783964919.467489:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000025b2c4e4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae0997f7-3a15-4fc6-865a-35b2f101956e:5793:1870622732846976:0@lo:503: 00000040:00080000:2.0:1783964919.468646:0:5840:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:3.0:1783964919.468978:0:5793:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:3.0:1783964919.469006:0:5793:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1783964919.469042:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783964919.469381:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.112@tcp lock: 00000000dc495833/0xe782b916994fd1b9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fd1c0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964919.469395:0:5793:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.112@tcp lock: 00000000dc495833/0xe782b916994fd1b9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fd1c0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783964919.469534:0:5793:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1783964919.469538:0:5793:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff947403dc3000 10000000:01000000:0.0:1783964919.469541:0:5793:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff947403dc3000 10000000:01000000:0.0:1783964919.469545:0:5793:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1783964919.469551:0:5793:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff947403dc3000 from 1 10000000:01000000:0.0:1783964919.469554:0:5793:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1783964919.469589:0:5793:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.112@tcp lock: 000000001cf8edb9/0xe782b916994fd1c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964919.469597:0:5793:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.112@tcp lock: 000000001cf8edb9/0xe782b916994fd1c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964919.469606:0:5793:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.112@tcp lock: 000000001cf8edb9/0xe782b916994fd1c7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783964919.469627:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003a3b1ccf pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae0997f7-3a15-4fc6-865a-35b2f101956e:5793:1870622732847104:0@lo:101: 00000100:00100000:0.0:1783964919.469757:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783964919.469828:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set 0000000062436991 going to sleep for 11 seconds 00000100:00100000:2.0:1783964919.469939:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732847104 00000100:00100000:2.0:1783964919.469947:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732847104 00000100:00100000:2.0:1783964919.470029:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1783964919.470037:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000034b72c1c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae0997f7-3a15-4fc6-865a-35b2f101956e+11:5793:x1870622732847104:12345-0@lo:101: 00010000:00010000:2.0:1783964919.470050:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783964919.470063:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000215dd3c6/0xe782b916994fd1ce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe782b916994fd1c7 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783964919.470087:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000215dd3c6/0xe782b916994fd1ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe782b916994fd1c7 expref: 12 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783964919.470096:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000215dd3c6/0xe782b916994fd1ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe782b916994fd1c7 expref: 12 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783964919.470104:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000215dd3c6, rc 0) 00000100:00100000:2.0:1783964919.470147:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000034b72c1c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae0997f7-3a15-4fc6-865a-35b2f101956e+12:5793:x1870622732847104:12345-0@lo:101: Request processed in 112us (391us total) trans 0 rc 0/0 00000100:00100000:2.0:1783964919.470154:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1783964919.470261:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003a3b1ccf pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae0997f7-3a15-4fc6-865a-35b2f101956e:5793:1870622732847104:0@lo:101: 00010000:00010000:0.0:1783964919.470274:0:5793:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.112@tcp lock: 000000001cf8edb9/0xe782b916994fd1c7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fd1ce expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964919.470282:0:5793:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.112@tcp lock: 000000001cf8edb9/0xe782b916994fd1c7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe782b916994fd1ce expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783964919.470336:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003a3b1ccf pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae0997f7-3a15-4fc6-865a-35b2f101956e:5793:1870622732847232:0@lo:501: 00000100:00100000:0.0:1783964919.470361:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783964919.470574:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set 0000000062436991 going to sleep for 11 seconds 00000100:00100000:3.0:1783964919.470660:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732847232 00000100:00100000:3.0:1783964919.470665:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732847232 00000100:00100000:3.0:1783964919.470690:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1783964919.470696:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001a4e2193 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+12:5793:x1870622732847232:12345-0@lo:501: 00000100:00100000:3.0:1783964919.470978:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001a4e2193 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+12:5793:x1870622732847232:12345-0@lo:501: Request processed in 282us (616us total) trans 0 rc 0/0 00000100:00100000:3.0:1783964919.470986:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1783964919.471244:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003a3b1ccf pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae0997f7-3a15-4fc6-865a-35b2f101956e:5793:1870622732847232:0@lo:501: 00000100:00100000:0.0:1783964919.471284:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003a3b1ccf pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae0997f7-3a15-4fc6-865a-35b2f101956e:5793:1870622732847360:0@lo:503: 00000100:00100000:0.0:1783964919.471328:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783964919.471350:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set 0000000062436991 going to sleep for 11 seconds 00000100:00100000:3.0:1783964919.471404:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732847360 00000100:00100000:3.0:1783964919.471408:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732847360 00000100:00100000:3.0:1783964919.471432:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1783964919.471438:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000099f341d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+12:5793:x1870622732847360:12345-0@lo:503: 00000100:00100000:3.0:1783964919.471900:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000099f341d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+12:5793:x1870622732847360:12345-0@lo:503: Request processed in 406us (514us total) trans 0 rc 0/0 00000100:00100000:3.0:1783964919.471908:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1783964919.472131:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003a3b1ccf pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae0997f7-3a15-4fc6-865a-35b2f101956e:5793:1870622732847360:0@lo:503: 00000100:00100000:0.0:1783964919.472475:0:5841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003a3b1ccf pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae0997f7-3a15-4fc6-865a-35b2f101956e:5841:1870622732847488:0@lo:502: 00000100:00100000:0.0:1783964919.472511:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783964919.472538:0:5841:0:(client.c:2702:ptlrpc_set_wait()) set 0000000062436991 going to sleep for 11 seconds 00000100:00100000:3.0:1783964919.472575:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732847488 00000100:00100000:3.0:1783964919.472579:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732847488 00000100:00100000:3.0:1783964919.472608:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1783964919.472613:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006462becc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+12:5841:x1870622732847488:12345-0@lo:502: 00000100:00100000:3.0:1783964919.472976:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006462becc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+12:5841:x1870622732847488:12345-0@lo:502: Request processed in 363us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1783964919.472983:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1783964919.473063:0:5841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003a3b1ccf pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae0997f7-3a15-4fc6-865a-35b2f101956e:5841:1870622732847488:0@lo:502: 00000020:01000004:0.0:1783964919.473116:0:5841:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1783964919.473139:0:5841:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (000000001f6bf3a2) 00000020:00000080:0.0:1783964919.473157:0:5841:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:0.0:1783964919.473387:0:5841:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000490a6289 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1783964919.473391:0:5841:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000490a6289 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1783964919.473393:0:5841:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000490a6289 4 00010000:00080000:0.0:1783964919.473421:0:5841:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000d43ebc42@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.112@tcp at head 00010000:00010000:0.0:1783964919.480726:0:5841:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:0.0:1783964919.480871:0:5841:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:0.0:1783964919.480910:0:5841:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1783964919.480922:0:5841:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xe782b916994fd1dc 00000100:00080000:0.0:1783964919.480932:0:5841:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1783964919.480937:0:5841:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000d43ebc42 using connection 192.168.204.112@tcp/0@lo 00000100:00100000:0.0:1783964919.480974:0:5841:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000003a3b1ccf x1870622732847616/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783964919.481013:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003a3b1ccf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3321:1870622732847616:0@lo:38: 00000100:00100000:0.0:1783964919.481089:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1783964919.481166:0:5841:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1783964919.483725:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732847616 00000100:00100000:2.0:1783964919.483739:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732847616 00000100:00100000:2.0:1783964919.484256:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783964919.484264:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ba866886 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3321:x1870622732847616:12345-0@lo:38: 00000100:00100000:0.0:1783964919.484364:0:5841:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000007a4a8f26 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae0997f7-3a15-4fc6-865a-35b2f101956e:5841:1870622732847744:0@lo:502: 00000100:00100000:2.0:1783964919.484385:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ba866886 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3321:x1870622732847616:12345-0@lo:38: Request processed in 119us (3295us total) trans 0 rc -11/-11 00000100:00100000:2.0:1783964919.484392:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783964919.484426:0:5841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783964919.484467:0:5841:0:(client.c:2702:ptlrpc_set_wait()) set 00000000407cb01e going to sleep for 11 seconds 00000100:00100000:1.0:1783964919.484547:0:3321:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1783964919.484556:0:3321:0:(import.c:65:import_set_state_nolock()) 00000000d43ebc42 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783964919.484560:0:3321:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1783964919.484563:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003a3b1ccf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3321:1870622732847616:0@lo:38: 00000100:00100000:2.0:1783964919.484589:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732847744 00000100:00100000:2.0:1783964919.484595:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732847744 00000100:00100000:2.0:1783964919.484636:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1783964919.484642:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000024103a77 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae0997f7-3a15-4fc6-865a-35b2f101956e+12:5841:x1870622732847744:12345-0@lo:502: 00000100:00100000:2.0:1783964919.485024:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000024103a77 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae0997f7-3a15-4fc6-865a-35b2f101956e+12:5841:x1870622732847744:12345-0@lo:502: Request processed in 382us (598us total) trans 0 rc 0/0 00000100:00100000:2.0:1783964919.485032:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1783964919.485052:0:5841:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000007a4a8f26 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae0997f7-3a15-4fc6-865a-35b2f101956e:5841:1870622732847744:0@lo:502: 00000040:00080000:1.0:1783964919.485083:0:5841:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:3.0:1783964919.485334:0:5793:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:3.0:1783964919.485361:0:5793:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.112@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1783964919.485411:0:5793:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.112@tcp lock: 000000001cf8edb9/0xe782b916994fd1c7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fd1ce expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964919.485422:0:5793:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.112@tcp lock: 000000001cf8edb9/0xe782b916994fd1c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fd1ce expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1783964919.485472:0:5793:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1783964919.485475:0:5793:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1783964919.485476:0:5793:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783964919.485477:0:5793:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783964919.485478:0:5793:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783964919.485480:0:5793:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783964919.485481:0:5793:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1783964919.485483:0:5793:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1783964919.485485:0:5793:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1783964919.485486:0:5793:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1783964919.485488:0:5793:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783964919.485489:0:5793:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1783964919.485493:0:5793:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:3.0:1783964919.485495:0:5793:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1783964919.485497:0:5793:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1783964919.485498:0:5793:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783964919.485499:0:5793:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783964919.485500:0:5793:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783964919.485501:0:5793:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783964919.485502:0:5793:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1783964919.485503:0:5793:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1783964919.485503:0:5793:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1783964919.485504:0:5793:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1783964919.485505:0:5793:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783964919.485506:0:5793:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1783964919.485524:0:5793:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1783964919.485536:0:5793:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000025b2c4e4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae0997f7-3a15-4fc6-865a-35b2f101956e:5793:1870622732847872:0@lo:253: 00000100:00100000:3.0:1783964919.485573:0:5793:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783964919.485601:0:5793:0:(client.c:2702:ptlrpc_set_wait()) set 0000000084d6fe90 going to sleep for 11 seconds 00000100:00100000:0.0:1783964919.485657:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732847872 00000100:00100000:0.0:1783964919.485662:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732847872 00000100:00100000:0.0:1783964919.485692:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1783964919.485699:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008640ecc9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+12:5793:x1870622732847872:12345-0@lo:253: 20000000:01000000:0.0:1783964919.485719:0:5805:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1783964919.485731:0:5805:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1783964919.507362:0:5805:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1783964919.507378:0:5805:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:0.0:1783964919.507412:0:5827:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1783964919.507416:0:5827:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1783964919.507435:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000034eaec27/0xe782b916994fd1e3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964919.507454:0:5827:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000006f16ee47/0xe782b916994fd1b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe782b916994fd1ab expref: 12 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964919.507462:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000034eaec27/0xe782b916994fd1e3 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964919.507498:0:5827:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000006f16ee47/0xe782b916994fd1b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe782b916994fd1ab expref: 12 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964919.507511:0:5827:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000006f16ee47/0xe782b916994fd1b2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe782b916994fd1ab expref: 12 pid: 5806 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783964919.507542:0:5827:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000068535b01 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5827:1870622732848000:0@lo:104: 00000100:00100000:0.0:1783964919.507832:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783964919.507918:0:5827:0:(client.c:2702:ptlrpc_set_wait()) set 000000003a99549a going to sleep for 11 seconds 00000100:00100000:2.0:1783964919.512026:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732848000 00000100:00100000:2.0:1783964919.512041:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732848000 00000100:00100000:2.0:1783964919.512105:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783964919.512113:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006c655a71 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ae0997f7-3a15-4fc6-865a-35b2f101956e+3:5827:x1870622732848000:12345-0@lo:104: 00010000:00010000:2.0:1783964919.512131:0:5795:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.112@tcp lock: 0000000000693523/0xe782b916994fd1ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe782b916994fd1b2 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783964919.512190:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008640ecc9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+12:5793:x1870622732847872:12345-0@lo:253: Request processed in 26491us (26616us total) trans 0 rc 0/0 00010000:00010000:2.0:1783964919.512246:0:5795:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1783964919.512252:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006c655a71 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ae0997f7-3a15-4fc6-865a-35b2f101956e+3:5827:x1870622732848000:12345-0@lo:104: Request processed in 140us (4421us total) trans 0 rc 0/0 00000100:00100000:2.0:1783964919.512259:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1783964919.512279:0:5801:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783964919.512284:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.112@tcp lock: 0000000000693523/0xe782b916994fd1ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe782b916994fd1b2 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783964919.512292:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000000693523 already unused, calling callback (00000000c28b6328) 10000000:00010000:2.0:1783964919.512296:0:5801:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.112@tcp lock: 0000000000693523/0xe782b916994fd1ab lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe782b916994fd1b2 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783964919.512321:0:5801:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.112@tcp lock: 0000000000693523/0xe782b916994fd1ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe782b916994fd1b2 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783964919.512327:0:5801:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.112@tcp lock: 0000000000693523/0xe782b916994fd1ab lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe782b916994fd1b2 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783964919.512333:0:5801:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1783964919.512370:0:5801:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.112@tcp lock: 0000000000693523/0xe782b916994fd1ab lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe782b916994fd1b2 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783964919.512376:0:5801:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783964919.512394:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.112@tcp lock: 0000000000693523/0xe782b916994fd1ab lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe782b916994fd1b2 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783964919.512400:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.112@tcp lock: 0000000000693523/0xe782b916994fd1ab lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe782b916994fd1b2 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783964919.512416:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783964919.512417:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783964919.512419:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783964919.512474:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000e08df2a5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ae0997f7-3a15-4fc6-865a-35b2f101956e:3323:1870622732848128:0@lo:103: 00000100:00100000:0.0:1783964919.512479:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1783964919.512510:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783964919.512598:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732848128 00000100:00100000:0.0:1783964919.512603:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732848128 00010000:00010000:0.0:1783964919.512620:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000006f16ee47/0xe782b916994fd1b2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe782b916994fd1ab expref: 12 pid: 5806 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783964919.512723:0:5827:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000068535b01 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5827:1870622732848000:0@lo:104: 00010000:00010000:1.0:1783964919.512752:0:5827:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000034eaec27/0xe782b916994fd1e3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783964919.512782:0:5793:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000025b2c4e4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae0997f7-3a15-4fc6-865a-35b2f101956e:5793:1870622732847872:0@lo:253: 10000000:01000000:1.0:1783964919.512791:0:5793:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1783964919.512794:0:5793:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1783964919.512796:0:5793:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1783964919.512798:0:5793:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783964919.512799:0:5793:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783964919.512800:0:5793:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783964919.512801:0:5793:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783964919.512802:0:5793:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1783964919.512804:0:5793:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1783964919.512805:0:5793:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1783964919.512806:0:5793:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1783964919.512808:0:5793:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783964919.512809:0:5793:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1783964919.512819:0:5793:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00000100:00100000:0.0:1783964919.512829:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783964919.512835:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000542874bc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ae0997f7-3a15-4fc6-865a-35b2f101956e+12:3323:x1870622732848128:12345-0@lo:103: 00010000:00010000:0.0:1783964919.512916:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783964919.512921:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000006f16ee47/0xe782b916994fd1b2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe782b916994fd1ab expref: 12 pid: 5806 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964919.512931:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000006f16ee47/0xe782b916994fd1b2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe782b916994fd1ab expref: 12 pid: 5806 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964919.512946:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000006f16ee47/0xe782b916994fd1b2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe782b916994fd1ab expref: 12 pid: 5806 timeout: 303 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964919.512960:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000034eaec27/0xe782b916994fd1e3 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964919.512967:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000034eaec27/0xe782b916994fd1e3 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1783964919.512992:0:5797:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005576208s 00010000:00010000:0.0:1783964919.512995:0:5797:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000034eaec27/0xe782b916994fd1e3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964919.513002:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000034eaec27/0xe782b916994fd1e3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964919.513008:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000034eaec27/0xe782b916994fd1e3 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964919.513013:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000034eaec27/0xe782b916994fd1e3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964919.513019:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000034eaec27 already unused, calling callback (00000000c6a2ab5d) 00010000:00010000:0.0:1783964919.513022:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000034eaec27/0xe782b916994fd1e3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964919.513029:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000034eaec27/0xe782b916994fd1e3 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964919.513051:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000034eaec27/0xe782b916994fd1e3 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964919.513060:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783964919.513068:0:5827:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000034eaec27/0xe782b916994fd1e3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783964919.513074:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000034eaec27/0xe782b916994fd1e3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783964919.513079:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000034eaec27/0xe782b916994fd1e3 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783964919.513098:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000542874bc pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ae0997f7-3a15-4fc6-865a-35b2f101956e+11:3323:x1870622732848128:12345-0@lo:103: Request processed in 264us (588us total) trans 0 rc 0/0 00000100:00100000:0.0:1783964919.513105:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783964919.513144:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000e08df2a5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ae0997f7-3a15-4fc6-865a-35b2f101956e:3323:1870622732848128:0@lo:103: 00080000:10000000:0.0:1783964919.520447:0:5793:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:0.0:1783964919.521095:0:5793:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1783964919.521693:0:5793:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:0.0:1783964919.521886:0:5793:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1783964919.522092:0:5793:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:0.0:1783964919.522547:0:5793:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:0.0:1783964919.523525:0:5793:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:0.0:1783964919.523886:0:5793:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:0.0:1783964919.524087:0:5793:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:0.0:1783964919.524420:0:5793:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:0.0:1783964919.524753:0:5793:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:0.0:1783964919.524954:0:5793:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:3.0:1783964919.565723:0:5793:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:2.0:1783964919.597937:0:5793:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:2.0:1783964919.598348:0:5847:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000020:00080000:0.0:1783964919.599012:0:5846:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:0.0:1783964919.599018:0:5846:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:3.0:1783964919.606998:0:5793:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:3.0:1783964919.607372:0:5793:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:3.0:1783964919.607854:0:5793:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:3.0:1783964919.607861:0:5793:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:3.0:1783964919.607988:0:5793:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783964919.610375:0:5793:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1783964919.611017:0:5793:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1783964919.611055:0:5793:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1783964919.611337:0:5793:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1783964919.611513:0:5793:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:3.0:1783964919.613191:0:5793:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:3.0:1783964919.615460:0:5793:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:3.0:1783964919.616058:0:5793:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:3.0:1783964919.616375:0:5793:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:3.0:1783964919.616503:0:5793:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:3.0:1783964919.616650:0:5793:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:3.0:1783964919.617108:0:5793:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:3.0:1783964919.618126:0:5793:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:3.0:1783964919.618540:0:5793:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:3.0:1783964919.618773:0:5793:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:3.0:1783964919.619072:0:5793:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:3.0:1783964919.619372:0:5793:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:3.0:1783964919.619580:0:5793:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:3.0:1783964919.619792:0:5793:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:3.0:1783964919.620402:0:5793:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:3.0:1783964919.620573:0:5793:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:3.0:1783964919.621112:0:5793:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:3.0:1783964919.621463:0:5793:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:3.0:1783964919.621620:0:5793:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:3.0:1783964919.622270:0:5793:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:3.0:1783964919.622577:0:5793:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:3.0:1783964919.622857:0:5793:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:3.0:1783964919.623484:0:5793:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:3.0:1783964919.623670:0:5793:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:3.0:1783964919.624194:0:5793:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:3.0:1783964919.624690:0:5793:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:3.0:1783964919.625456:0:5793:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:3.0:1783964919.625623:0:5793:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:3.0:1783964919.626480:0:5793:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:3.0:1783964919.626897:0:5793:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:3.0:1783964919.629142:0:5793:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:3.0:1783964919.630539:0:5793:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:3.0:1783964919.631410:0:5793:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:1.0:1783964919.635755:0:5847:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:1.0:1783964919.693855:0:5793:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1783964919.693899:0:5793:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb07301cbb988 00100000:10000000:1.0:1783964919.693908:0:5793:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1783964919.694243:0:5793:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1783964919.694259:0:5793:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.112@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1783964919.694703:0:5793:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1783964919.695569:0:5793:0:(super25.c:181:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:1.0:1783964919.735027:0:5847:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1783964919.735116:0:5847:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1783964919.735121:0:5847:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:1.0:1783964920.493447:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783964921.516011:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783964922.539371:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783964923.563415:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1783964924.243764:0:6090:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg412-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1783964924.592884:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1783964924.971499:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1783964924.971509:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1783964924.971513:0:38:0:(import.c:65:import_set_state_nolock()) 00000000d43ebc42 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783964924.971525:0:38:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000d43ebc42 using connection 192.168.204.112@tcp/0@lo 00000100:00100000:3.0:1783964924.971551:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000078a8e411 x1870622732848384/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783964924.971584:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000078a8e411 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3321:1870622732848384:0@lo:38: 00000100:00100000:0.0:1783964924.971641:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000006ee60344 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ae0997f7-3a15-4fc6-865a-35b2f101956e:3324:1870622732848256:0@lo:400: 00000100:00100000:3.0:1783964924.971671:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783964924.971689:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783964924.972059:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732848384 00000100:00100000:1.0:1783964924.972068:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732848384 00000100:00100000:1.0:1783964924.972109:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783964924.972124:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a6dcc703 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3321:x1870622732848384:12345-0@lo:38: 00010000:00080000:1.0:1783964924.972151:0:5813:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 159 last 0 00000020:00000080:1.0:1783964924.972224:0:5813:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xe782b916994fd1ea 00000004:00100000:1.0:1783964924.972268:0:5813:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1783964924.972607:0:5813:0:(import.c:65:import_set_state_nolock()) 000000001c66f2e5 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783964924.972676:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a6dcc703 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1870622732848384:12345-0@lo:38: Request processed in 551us (1006us total) trans 0 rc 0/0 00000100:00100000:0.0:1783964924.972687:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1783964924.972734:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000078a8e411 x1870622732848384/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783964934 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1783964924.972751:0:3321:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1783964924.972759:0:3321:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1783964924.972764:0:3321:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1783964924.972766:0:3321:0:(import.c:65:import_set_state_nolock()) 00000000d43ebc42 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1783964924.972772:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000078a8e411 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3321:1870622732848384:0@lo:38: 00000100:00100000:2.0:1783964924.972977:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732848256 00000100:00100000:2.0:1783964924.972983:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732848256 00000100:00100000:2.0:1783964924.973026:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1783964924.973033:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c19b062d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae0997f7-3a15-4fc6-865a-35b2f101956e+11:3324:x1870622732848256:12345-0@lo:400: 00000100:00100000:2.0:1783964924.973094:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c19b062d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae0997f7-3a15-4fc6-865a-35b2f101956e+11:3324:x1870622732848256:12345-0@lo:400: Request processed in 62us (1406us total) trans 0 rc 0/0 00000100:00100000:2.0:1783964924.973101:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1783964924.973515:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000006ee60344 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ae0997f7-3a15-4fc6-865a-35b2f101956e:3324:1870622732848256:0@lo:400: 00010000:00010000:2.0:1783964925.611358:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1783964926.507418:0:5809:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1783964926.507431:0:5809:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff947403dc3000 from 3 10000000:01000000:2.0:1783964926.507439:0:5809:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1783964926.507507:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.112@tcp lock: 000000005c968278/0xe782b916994fd1f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783964926.507535:0:5809:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.112@tcp lock: 000000005c968278/0xe782b916994fd1f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783964926.507549:0:5809:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.112@tcp lock: 000000005c968278/0xe782b916994fd1f1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783964926.507582:0:5809:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000068be56c2 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae0997f7-3a15-4fc6-865a-35b2f101956e:5809:1870622732848512:0@lo:101: 00000100:00100000:2.0:1783964926.507813:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783964926.507893:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732848512 00000100:00100000:2.0:1783964926.507901:0:5809:0:(client.c:2702:ptlrpc_set_wait()) set 000000006ebb09b3 going to sleep for 11 seconds 00000100:00100000:0.0:1783964926.507910:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732848512 00000100:00100000:0.0:1783964926.507992:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1783964926.508004:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000081c91846 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+11:5809:x1870622732848512:12345-0@lo:101: 00010000:00010000:0.0:1783964926.508023:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783964926.508046:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000034eaec27/0xe782b916994fd1f8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe782b916994fd1f1 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964926.508176:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000034eaec27/0xe782b916994fd1f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe782b916994fd1f1 expref: 12 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964926.508189:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000034eaec27/0xe782b916994fd1f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe782b916994fd1f1 expref: 12 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964926.508197:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000034eaec27, rc 0) 00000100:00100000:0.0:1783964926.508309:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000081c91846 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+12:5809:x1870622732848512:12345-0@lo:101: Request processed in 309us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1783964926.508317:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1783964926.508373:0:5809:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000068be56c2 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae0997f7-3a15-4fc6-865a-35b2f101956e:5809:1870622732848512:0@lo:101: 00010000:00010000:2.0:1783964926.508401:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.112@tcp lock: 000000005c968278/0xe782b916994fd1f1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fd1f8 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783964926.508428:0:5809:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.112@tcp lock: 000000005c968278/0xe782b916994fd1f1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe782b916994fd1f8 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783964926.508495:0:5809:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000068be56c2 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae0997f7-3a15-4fc6-865a-35b2f101956e:5809:1870622732848640:0@lo:256: 00000100:00100000:2.0:1783964926.508611:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783964926.508701:0:5809:0:(client.c:2702:ptlrpc_set_wait()) set 000000006ebb09b3 going to sleep for 11 seconds 00000100:00100000:3.0:1783964926.514445:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732848640 00000100:00100000:3.0:1783964926.514472:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732848640 00000100:00100000:3.0:1783964926.514682:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1783964926.514694:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000073bdce07 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae0997f7-3a15-4fc6-865a-35b2f101956e+12:5809:x1870622732848640:12345-0@lo:256: 20000000:01000000:3.0:1783964926.514731:0:5807:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1783964926.514761:0:5807:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1783964926.514765:0:5807:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:3.0:1783964926.514974:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000073bdce07 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae0997f7-3a15-4fc6-865a-35b2f101956e+12:5809:x1870622732848640:12345-0@lo:256: Request processed in 282us (6362us total) trans 0 rc 0/0 00000100:00100000:3.0:1783964926.514983:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1783964926.515052:0:5809:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000068be56c2 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae0997f7-3a15-4fc6-865a-35b2f101956e:5809:1870622732848640:0@lo:256: 10000000:01000000:1.0:1783964926.515255:0:5809:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.112@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1783964926.515266:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.112@tcp lock: 000000005c968278/0xe782b916994fd1f1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fd1f8 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964926.515277:0:5809:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.112@tcp lock: 000000005c968278/0xe782b916994fd1f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fd1f8 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964926.635971:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783964927.660525:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783964928.684426:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1783964929.308712:0:6292:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffa23e5820 20000000:00000080:1.0:1783964929.308739:0:6292:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff94743635ec00 uarg=0000000000000000 20000000:01000000:1.0:1783964929.308801:0:6292:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1783964929.308819:0:6292:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1783964929.308826:0:6292:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1783964929.309107:0:6292:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:1.0:1783964929.309123:0:6292:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:0.0:1783964929.312839:0:6292:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783964929.313149:0:6292:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1783964929.313238:0:6292:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:0.0:1783964929.313296:0:6292:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:0.0:1783964929.313318:0:6292:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1783964929.313341:0:6292:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000002978420c/0xe782b916994fd1ff lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964929.313364:0:6292:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000a561e062/0xe782b916994fd1c0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe782b916994fd1b9 expref: 11 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964929.313371:0:6292:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000002978420c/0xe782b916994fd1ff lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964929.313420:0:6292:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000a561e062/0xe782b916994fd1c0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe782b916994fd1b9 expref: 11 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964929.313453:0:6292:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000a561e062/0xe782b916994fd1c0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe782b916994fd1b9 expref: 11 pid: 5806 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783964929.313486:0:6292:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000406c1369 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6292:1870622732848768:0@lo:104: 00000100:00100000:0.0:1783964929.313569:0:6292:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783964929.313641:0:6292:0:(client.c:2702:ptlrpc_set_wait()) set 00000000703aad1c going to sleep for 11 seconds 00000100:00100000:3.0:1783964929.314121:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732848768 00000100:00100000:3.0:1783964929.314132:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732848768 00000100:00100000:3.0:1783964929.314326:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783964929.314336:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003ea19a7b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ae0997f7-3a15-4fc6-865a-35b2f101956e+3:6292:x1870622732848768:12345-0@lo:104: 00010000:00010000:3.0:1783964929.314361:0:5796:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.112@tcp lock: 00000000dc495833/0xe782b916994fd1b9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe782b916994fd1c0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964929.314456:0:5796:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1783964929.314468:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003ea19a7b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ae0997f7-3a15-4fc6-865a-35b2f101956e+3:6292:x1870622732848768:12345-0@lo:104: Request processed in 135us (899us total) trans 0 rc 0/0 00000100:00100000:3.0:1783964929.314476:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1783964929.314500:0:5801:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783964929.314507:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.112@tcp lock: 00000000dc495833/0xe782b916994fd1b9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe782b916994fd1c0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964929.314517:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000dc495833 already unused, calling callback (00000000c28b6328) 10000000:00010000:3.0:1783964929.314639:0:5801:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.112@tcp lock: 00000000dc495833/0xe782b916994fd1b9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe782b916994fd1c0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964929.314650:0:5801:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.112@tcp lock: 00000000dc495833/0xe782b916994fd1b9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe782b916994fd1c0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783964929.314658:0:5801:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.112@tcp lock: 00000000dc495833/0xe782b916994fd1b9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe782b916994fd1c0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783964929.314664:0:5801:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1783964929.314742:0:5801:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.112@tcp lock: 00000000dc495833/0xe782b916994fd1b9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe782b916994fd1c0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964929.314750:0:5801:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783964929.314771:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.112@tcp lock: 00000000dc495833/0xe782b916994fd1b9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe782b916994fd1c0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964929.314777:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.112@tcp lock: 00000000dc495833/0xe782b916994fd1b9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe782b916994fd1c0 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964929.314808:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783964929.314810:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783964929.314811:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783964929.314834:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000078a8e411 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ae0997f7-3a15-4fc6-865a-35b2f101956e:3325:1870622732848896:0@lo:103: 00000100:00100000:3.0:1783964929.314870:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783964929.314928:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732848896 00000100:00100000:3.0:1783964929.314933:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732848896 00010000:00010000:3.0:1783964929.314952:0:5798:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000a561e062/0xe782b916994fd1c0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe782b916994fd1b9 expref: 12 pid: 5806 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783964929.314977:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783964929.314983:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000002cacc32 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ae0997f7-3a15-4fc6-865a-35b2f101956e+12:3325:x1870622732848896:12345-0@lo:103: 00010000:00010000:3.0:1783964929.314996:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783964929.315000:0:5798:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000a561e062/0xe782b916994fd1c0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe782b916994fd1b9 expref: 12 pid: 5806 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964929.315011:0:5798:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000a561e062/0xe782b916994fd1c0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe782b916994fd1b9 expref: 12 pid: 5806 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964929.315040:0:5798:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000002978420c/0xe782b916994fd1ff lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964929.315049:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002978420c/0xe782b916994fd1ff lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964929.315064:0:5798:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000002978420c/0xe782b916994fd1ff lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964929.315134:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000002978420c/0xe782b916994fd1ff lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964929.315141:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000002978420c/0xe782b916994fd1ff lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964929.315157:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000002978420c/0xe782b916994fd1ff lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964929.315163:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000002978420c already unused, calling callback (00000000c6a2ab5d) 00010000:00010000:3.0:1783964929.315167:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000002978420c/0xe782b916994fd1ff lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964929.315175:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000002978420c/0xe782b916994fd1ff lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964929.315183:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000002978420c/0xe782b916994fd1ff lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964929.315280:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783964929.315310:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000002cacc32 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ae0997f7-3a15-4fc6-865a-35b2f101956e+12:3325:x1870622732848896:12345-0@lo:103: Request processed in 328us (441us total) trans 0 rc 0/0 00000100:00100000:3.0:1783964929.315317:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783964929.315358:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000078a8e411 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ae0997f7-3a15-4fc6-865a-35b2f101956e:3325:1870622732848896:0@lo:103: 00010000:00010000:0.0:1783964929.315851:0:6292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000a561e062/0xe782b916994fd1c0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe782b916994fd1b9 expref: 11 pid: 5806 timeout: 313 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783964929.315867:0:6292:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000406c1369 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6292:1870622732848768:0@lo:104: 00010000:00010000:0.0:1783964929.315892:0:6292:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000002978420c/0xe782b916994fd1ff lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964929.315901:0:6292:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000002978420c/0xe782b916994fd1ff lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964929.315907:0:6292:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000002978420c/0xe782b916994fd1ff lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964929.315913:0:6292:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000002978420c/0xe782b916994fd1ff lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6292 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964929.715279:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783964930.092504:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000078a8e411 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ae0997f7-3a15-4fc6-865a-35b2f101956e:3322:1870622732849024:0@lo:400: 00000100:00100000:0.0:1783964930.092624:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783964930.099268:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000004747e7c5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3323:1870622732849152:0@lo:400: 00000100:00100000:0.0:1783964930.099354:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732849024 00000100:00100000:0.0:1783964930.099365:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732849024 00000100:00100000:0.0:1783964930.099428:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1783964930.099438:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001fed3766 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+11:3322:x1870622732849024:12345-0@lo:400: 00000100:00100000:0.0:1783964930.099717:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001fed3766 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+11:3322:x1870622732849024:12345-0@lo:400: Request processed in 97us (6910us total) trans 0 rc 0/0 00000100:00100000:0.0:1783964930.099738:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1783964930.099832:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000078a8e411 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ae0997f7-3a15-4fc6-865a-35b2f101956e:3322:1870622732849024:0@lo:400: 00000100:00100000:2.0:1783964930.100665:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783964930.100750:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732849152 00000100:00100000:0.0:1783964930.100757:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732849152 00000100:00100000:0.0:1783964930.100798:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783964930.100804:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000049ba036a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3323:x1870622732849152:12345-0@lo:400: 00000100:00100000:0.0:1783964930.100857:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000049ba036a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3323:x1870622732849152:12345-0@lo:400: Request processed in 54us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1783964930.100863:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1783964930.101810:0:3323:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000004747e7c5 x1870622732849152/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783964946 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783964930.101829:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000004747e7c5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3323:1870622732849152:0@lo:400: 00010000:00010000:1.0:1783964930.748760:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783964931.755280:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783964932.780357:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783964933.803440:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1783964934.196865:0:6605:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1783964934.196871:0:6605:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:3.0:1783964934.197040:0:6605:0:(super25.c:130:lustre_fill_super()) VFS Op: sb 00000000ebcdc16a 00000020:01000004:3.0:1783964934.197063:0:6605:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1783964934.197079:0:6605:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1783964934.197096:0:6605:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (00000000e086b22e) 00000020:00000080:3.0:1783964934.197116:0:6605:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1783964934.210585:0:6605:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1783964934.210869:0:6605:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1783964934.230571:0:6605:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1783964934.235119:0:6605:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1783964934.235154:0:6605:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1783964934.235311:0:6605:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1783964934.235342:0:6605:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1783964934.235873:0:6605:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1783964934.235887:0:6605:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:2.0:1783964934.235904:0:6605:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xe782b916994fd20d 00000020:01000004:2.0:1783964934.235913:0:6605:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1783964934.235954:0:6605:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.112@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1783964934.235959:0:6605:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.112@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1783964934.235966:0:6605:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1783964934.235971:0:6605:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1783964934.235990:0:6605:0:(genops.c:413:class_newdev()) Allocate new device OSS (0000000097f6759e) 00000020:00000080:2.0:1783964934.236009:0:6605:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:2.0:1783964934.237653:0:6605:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783964934.237859:0:6605:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1783964934.237867:0:6605:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1783964934.241285:0:6605:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1783964934.241427:0:6605:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1783964934.246621:0:6605:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1783964934.246638:0:6605:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1783964934.248598:0:6605:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783964934.248797:0:6605:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1783964934.248804:0:6605:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1783964934.249785:0:6605:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1783964934.249796:0:6605:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1783964934.272913:0:6605:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783964934.273228:0:6605:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1783964934.273236:0:6605:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1783964934.274360:0:6605:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1783964934.274371:0:6605:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1783964934.275351:0:6605:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1783964934.275361:0:6605:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1783964934.277052:0:6605:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1783964934.277303:0:6605:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1783964934.277310:0:6605:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1783964934.278003:0:6605:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1783964934.278011:0:6605:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1783964934.315349:0:6605:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783964934.315625:0:6605:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1783964934.315634:0:6605:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1783964934.317957:0:6605:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1783964934.317973:0:6605:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1783964934.320747:0:6605:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1783964934.320789:0:6605:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:3.0:1783964934.320797:0:6605:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.112@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1783964934.348382:0:6605:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.112@tcp ctxt 0 is initialized 00000020:01000004:3.0:1783964934.348431:0:6605:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.112@tcp, index=0000, flags=0x20062 00000020:01000004:3.0:1783964934.348436:0:6605:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1783964934.348439:0:6605:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1783964934.348440:0:6605:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783964934.348441:0:6605:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783964934.348443:0:6605:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783964934.348444:0:6605:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783964934.348446:0:6605:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783964934.348447:0:6605:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1783964934.348449:0:6605:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1783964934.348450:0:6605:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783964934.348452:0:6605:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1783964934.348457:0:6605:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:3.0:1783964934.348460:0:6605:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1783964934.348461:0:6605:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1783964934.348462:0:6605:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783964934.348464:0:6605:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783964934.348464:0:6605:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783964934.348466:0:6605:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783964934.348466:0:6605:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783964934.348467:0:6605:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1783964934.348469:0:6605:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1783964934.348469:0:6605:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783964934.348471:0:6605:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1783964934.348519:0:6605:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1783964934.348544:0:6605:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000840e2a3b pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae0997f7-3a15-4fc6-865a-35b2f101956e:6605:1870622732849280:0@lo:253: 00000100:00100000:3.0:1783964934.348642:0:6605:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783964934.348722:0:6605:0:(client.c:2702:ptlrpc_set_wait()) set 0000000014fa5f52 going to sleep for 11 seconds 00000100:00100000:2.0:1783964934.348846:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732849280 00000100:00100000:2.0:1783964934.348858:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732849280 00000100:00100000:2.0:1783964934.348924:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1783964934.348948:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000006312bcc7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae0997f7-3a15-4fc6-865a-35b2f101956e+11:6605:x1870622732849280:12345-0@lo:253: 20000000:01000000:2.0:1783964934.348989:0:5807:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1783964934.348994:0:5807:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:2.0:1783964934.349000:0:5807:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:2.0:1783964934.349005:0:5807:0:(mgs_llog.c:3858:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:2.0:1783964934.352926:0:5807:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783964934.354963:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:2.0:1783964934.355000:0:5807:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:2.0:1783964934.355090:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:2.0:1783964934.355099:0:5807:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:2.0:1783964934.355134:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:2.0:1783964934.355184:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:3.0:1783964934.356509:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:3.0:1783964934.356539:0:5807:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.204.112@tcp 20000000:01000000:3.0:1783964934.356548:0:5807:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.112@tcp (null) (null) (null) 00000040:00080000:3.0:1783964934.356587:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:3.0:1783964934.356596:0:5807:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1783964934.356645:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:3.0:1783964934.356653:0:5807:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.204.112@tcp (null) (null) 00000040:00080000:3.0:1783964934.356687:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:3.0:1783964934.356699:0:5807:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1783964934.356731:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:3.0:1783964934.356798:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:3.0:1783964934.358393:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:3.0:1783964934.358426:0:5807:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.204.112@tcp 20000000:01000000:3.0:1783964934.358428:0:5807:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.112@tcp (null) (null) (null) 00000040:00080000:3.0:1783964934.358471:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:3.0:1783964934.358479:0:5807:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1783964934.358509:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:3.0:1783964934.358516:0:5807:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.204.112@tcp (null) (null) 00000040:00080000:3.0:1783964934.358566:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:3.0:1783964934.358576:0:5807:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1783964934.358610:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:3.0:1783964934.358645:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:3.0:1783964934.358664:0:5807:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:3.0:1783964934.358668:0:5807:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:3.0:1783964934.358676:0:5807:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:3.0:1783964934.358677:0:5807:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1783964934.358679:0:5807:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1783964934.358695:0:5807:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1783964934.358698:0:5807:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1783964934.358734:0:5807:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1783964934.358737:0:5807:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1783964934.359801:0:6619:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:3.0:1783964934.360482:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:3.0:1783964934.360528:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:3.0:1783964934.360600:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:3.0:1783964934.360624:0:5807:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1783964934.360626:0:5807:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1783964934.361623:0:6620:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 13 marker 9 1->4: lustre sys.timeout 20000000:01000000:0.0:1783964934.361690:0:6620:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 15 marker 9 2->4: lustre sys.timeout 00000040:00080000:0.0:1783964934.361744:0:6620:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:0.0:1783964934.362619:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:0.0:1783964934.362666:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:0.0:1783964934.362738:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:0.0:1783964934.362754:0:5807:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1783964934.362757:0:5807:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1783964934.363611:0:6621:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 10 1->4: lustre sys.timeout 20000000:01000000:3.0:1783964934.363664:0:6621:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 10 2->4: lustre sys.timeout 00000040:00080000:3.0:1783964934.363712:0:6621:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:0.0:1783964934.364380:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:0.0:1783964934.364502:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:0.0:1783964934.364541:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 10000000:01000000:0.0:1783964934.364564:0:5807:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1783964934.364590:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000c3f1fc31/0xe782b916994fd21b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964934.364614:0:5807:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000029110dd7/0xe782b916994fd142 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe782b916994fd13b expref: 11 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964934.364622:0:5807:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000001e49d806/0xe782b916994fd15e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe782b916994fd157 expref: 11 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964934.364629:0:5807:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000215dd3c6/0xe782b916994fd1ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe782b916994fd1c7 expref: 11 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964934.364636:0:5807:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000c3f1fc31/0xe782b916994fd21b lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964934.364686:0:5807:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000215dd3c6/0xe782b916994fd1ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe782b916994fd1c7 expref: 11 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964934.364703:0:5807:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000215dd3c6/0xe782b916994fd1ce lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe782b916994fd1c7 expref: 11 pid: 5807 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783964934.364719:0:5807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000406c1369 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5807:1870622732849408:0@lo:104: 00000100:00100000:0.0:1783964934.364800:0:5807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783964934.364942:0:5807:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000001e49d806/0xe782b916994fd15e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe782b916994fd157 expref: 11 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964934.364950:0:5807:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000001e49d806/0xe782b916994fd15e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe782b916994fd157 expref: 11 pid: 5805 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783964934.364959:0:5807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000090f96708 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5807:1870622732849536:0@lo:104: 00000100:00100000:0.0:1783964934.364980:0:5807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783964934.365197:0:5807:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000029110dd7/0xe782b916994fd142 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe782b916994fd13b expref: 11 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964934.365235:0:5807:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000029110dd7/0xe782b916994fd142 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe782b916994fd13b expref: 11 pid: 5806 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783964934.365243:0:5807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000005dec3862 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5807:1870622732849664:0@lo:104: 00000100:00100000:0.0:1783964934.365267:0:5807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783964934.365418:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732849408 00000100:00100000:3.0:1783964934.365427:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732849408 00000100:00100000:3.0:1783964934.365470:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732849536 00000100:00100000:3.0:1783964934.365473:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732849536 00000100:00100000:3.0:1783964934.365487:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783964934.365495:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000012acb9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ae0997f7-3a15-4fc6-865a-35b2f101956e+4:5807:x1870622732849408:12345-0@lo:104: 00010000:00010000:3.0:1783964934.365510:0:5796:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.112@tcp lock: 000000001cf8edb9/0xe782b916994fd1c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe782b916994fd1ce expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964934.365609:0:5796:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1783964934.365615:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000012acb9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ae0997f7-3a15-4fc6-865a-35b2f101956e+4:5807:x1870622732849408:12345-0@lo:104: Request processed in 120us (816us total) trans 0 rc 0/0 00000100:00100000:3.0:1783964934.365622:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783964934.365642:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783964934.365647:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b5b6a13e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ae0997f7-3a15-4fc6-865a-35b2f101956e+3:5807:x1870622732849536:12345-0@lo:104: 00010000:00010000:3.0:1783964934.365654:0:5796:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.112@tcp lock: 0000000040f2f922/0xe782b916994fd157 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe782b916994fd15e expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964934.365702:0:5801:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783964934.365709:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.112@tcp lock: 000000001cf8edb9/0xe782b916994fd1c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe782b916994fd1ce expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964934.365718:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000001cf8edb9 already unused, calling callback (00000000c28b6328) 10000000:00010000:1.0:1783964934.365722:0:5801:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.112@tcp lock: 000000001cf8edb9/0xe782b916994fd1c7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xe782b916994fd1ce expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964934.365730:0:5801:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.112@tcp lock: 000000001cf8edb9/0xe782b916994fd1c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xe782b916994fd1ce expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783964934.365737:0:5801:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.112@tcp lock: 000000001cf8edb9/0xe782b916994fd1c7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xe782b916994fd1ce expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783964934.365742:0:5801:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783964934.365780:0:5801:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.112@tcp lock: 000000001cf8edb9/0xe782b916994fd1c7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe782b916994fd1ce expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964934.365786:0:5801:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783964934.365805:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.112@tcp lock: 000000001cf8edb9/0xe782b916994fd1c7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe782b916994fd1ce expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964934.365810:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.112@tcp lock: 000000001cf8edb9/0xe782b916994fd1c7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe782b916994fd1ce expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964934.365826:0:5801:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783964934.365834:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.112@tcp lock: 0000000040f2f922/0xe782b916994fd157 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe782b916994fd15e expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964934.365840:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000040f2f922 already unused, calling callback (00000000c28b6328) 10000000:00010000:1.0:1783964934.365842:0:5801:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.112@tcp lock: 0000000040f2f922/0xe782b916994fd157 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xe782b916994fd15e expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964934.365847:0:5801:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.112@tcp lock: 0000000040f2f922/0xe782b916994fd157 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xe782b916994fd15e expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783964934.365852:0:5801:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.112@tcp lock: 0000000040f2f922/0xe782b916994fd157 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xe782b916994fd15e expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783964934.365858:0:5801:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783964934.365872:0:5801:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.112@tcp lock: 0000000040f2f922/0xe782b916994fd157 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe782b916994fd15e expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964934.365878:0:5801:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783964934.365883:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.112@tcp lock: 0000000040f2f922/0xe782b916994fd157 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe782b916994fd15e expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964934.365889:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.112@tcp lock: 0000000040f2f922/0xe782b916994fd157 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe782b916994fd15e expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964934.365899:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783964934.365901:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783964934.365903:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783964934.365944:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000be2d083b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ae0997f7-3a15-4fc6-865a-35b2f101956e:3324:1870622732849792:0@lo:103: 00000100:00100000:1.0:1783964934.365980:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783964934.366027:0:3324:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783964934.366032:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000005fe6f8fa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ae0997f7-3a15-4fc6-865a-35b2f101956e:3324:1870622732849920:0@lo:103: 00000100:00100000:1.0:1783964934.366061:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783964934.366089:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732849792 00000100:00100000:1.0:1783964934.366093:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732849792 00010000:00010000:1.0:1783964934.366113:0:5799:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000215dd3c6/0xe782b916994fd1ce lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe782b916994fd1c7 expref: 12 pid: 5807 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783964934.366136:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732849920 00000100:00100000:1.0:1783964934.366139:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732849920 00010000:00010000:1.0:1783964934.366149:0:5799:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000001e49d806/0xe782b916994fd15e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe782b916994fd157 expref: 13 pid: 5805 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783964934.366161:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783964934.366166:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007d02f824 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ae0997f7-3a15-4fc6-865a-35b2f101956e+13:3324:x1870622732849792:12345-0@lo:103: 00010000:00010000:1.0:1783964934.366178:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783964934.366184:0:5799:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000215dd3c6/0xe782b916994fd1ce lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe782b916994fd1c7 expref: 13 pid: 5807 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964934.366195:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000215dd3c6/0xe782b916994fd1ce lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe782b916994fd1c7 expref: 13 pid: 5807 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964934.366233:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783964934.366260:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007d02f824 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ae0997f7-3a15-4fc6-865a-35b2f101956e+13:3324:x1870622732849792:12345-0@lo:103: Request processed in 94us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1783964934.366266:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783964934.366280:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783964934.366285:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e95b5f67 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ae0997f7-3a15-4fc6-865a-35b2f101956e+12:3324:x1870622732849920:12345-0@lo:103: 00010000:00010000:1.0:1783964934.366305:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783964934.366309:0:5799:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000001e49d806/0xe782b916994fd15e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe782b916994fd157 expref: 12 pid: 5805 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964934.366327:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000001e49d806/0xe782b916994fd15e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe782b916994fd157 expref: 12 pid: 5805 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964934.366337:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783964934.366357:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e95b5f67 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ae0997f7-3a15-4fc6-865a-35b2f101956e+12:3324:x1870622732849920:12345-0@lo:103: Request processed in 73us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1783964934.366363:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783964934.366403:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000005fe6f8fa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ae0997f7-3a15-4fc6-865a-35b2f101956e:3324:1870622732849920:0@lo:103: 00000100:00100000:1.0:1783964934.366410:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000be2d083b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ae0997f7-3a15-4fc6-865a-35b2f101956e:3324:1870622732849792:0@lo:103: 00000100:00100000:0.0:1783964934.366634:0:5807:0:(client.c:2702:ptlrpc_set_wait()) set 00000000774aeb83 going to sleep for 11 seconds 00010000:00010000:0.0:1783964934.366649:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000215dd3c6/0xe782b916994fd1ce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe782b916994fd1c7 expref: 11 pid: 5807 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783964934.366660:0:5807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000406c1369 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5807:1870622732849408:0@lo:104: 00010000:00010000:0.0:1783964934.366669:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000001e49d806/0xe782b916994fd15e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe782b916994fd157 expref: 10 pid: 5805 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783964934.366676:0:5807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000090f96708 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5807:1870622732849536:0@lo:104: 00010000:00010000:3.0:1783964934.367235:0:5796:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:3.0:1783964934.367245:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b5b6a13e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ae0997f7-3a15-4fc6-865a-35b2f101956e+3:5807:x1870622732849536:12345-0@lo:104: Request processed in 1598us (2263us total) trans 0 rc 0/0 00010000:00010000:1.0:1783964934.367279:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783964934.367318:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783964934.367343:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732849664 00000100:00100000:3.0:1783964934.367348:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732849664 00000100:00100000:3.0:1783964934.367381:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783964934.367386:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007a114971 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ae0997f7-3a15-4fc6-865a-35b2f101956e+3:5807:x1870622732849664:12345-0@lo:104: 00010000:00010000:3.0:1783964934.367396:0:5796:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.112@tcp lock: 000000006ebf2baa/0xe782b916994fd13b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe782b916994fd142 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964934.367459:0:5796:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1783964934.367464:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007a114971 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ae0997f7-3a15-4fc6-865a-35b2f101956e+3:5807:x1870622732849664:12345-0@lo:104: Request processed in 78us (2197us total) trans 0 rc 0/0 00000100:00100000:3.0:1783964934.367469:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1783964934.367475:0:5807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000005dec3862 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5807:1870622732849664:0@lo:104: 00010000:00010000:0.0:1783964934.367519:0:5807:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000c3f1fc31/0xe782b916994fd21b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964934.367562:0:5801:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783964934.367566:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.112@tcp lock: 000000006ebf2baa/0xe782b916994fd13b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe782b916994fd142 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964934.367574:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000006ebf2baa already unused, calling callback (00000000c28b6328) 10000000:00010000:1.0:1783964934.367578:0:5801:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.112@tcp lock: 000000006ebf2baa/0xe782b916994fd13b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe782b916994fd142 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964934.367585:0:5801:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.112@tcp lock: 000000006ebf2baa/0xe782b916994fd13b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe782b916994fd142 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783964934.367591:0:5801:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.112@tcp lock: 000000006ebf2baa/0xe782b916994fd13b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe782b916994fd142 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783964934.367596:0:5801:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783964934.367637:0:5801:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.112@tcp lock: 000000006ebf2baa/0xe782b916994fd13b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe782b916994fd142 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964934.367667:0:5801:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783964934.367694:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.112@tcp lock: 000000006ebf2baa/0xe782b916994fd13b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe782b916994fd142 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964934.367701:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.112@tcp lock: 000000006ebf2baa/0xe782b916994fd13b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe782b916994fd142 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964934.367717:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783964934.367718:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783964934.367720:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783964934.367726:0:3323:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783964934.367739:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000be2d083b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ae0997f7-3a15-4fc6-865a-35b2f101956e:3323:1870622732850048:0@lo:103: 00000100:00100000:1.0:1783964934.367773:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783964934.367805:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732850048 00000100:00100000:1.0:1783964934.367808:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732850048 00010000:00010000:1.0:1783964934.367822:0:5799:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000029110dd7/0xe782b916994fd142 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe782b916994fd13b expref: 10 pid: 5806 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783964934.367841:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783964934.367846:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005fe6f8fa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ae0997f7-3a15-4fc6-865a-35b2f101956e+10:3323:x1870622732850048:12345-0@lo:103: 00010000:00010000:1.0:1783964934.367855:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783964934.367860:0:5799:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000029110dd7/0xe782b916994fd142 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe782b916994fd13b expref: 10 pid: 5806 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964934.367868:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000029110dd7/0xe782b916994fd142 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe782b916994fd13b expref: 10 pid: 5806 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964934.367879:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000029110dd7/0xe782b916994fd142 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe782b916994fd13b expref: 10 pid: 5806 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964934.367904:0:5799:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000c3f1fc31/0xe782b916994fd21b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964934.368080:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c3f1fc31/0xe782b916994fd21b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964934.368096:0:5799:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000c3f1fc31/0xe782b916994fd21b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964934.368102:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000c3f1fc31/0xe782b916994fd21b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964934.368108:0:5799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000c3f1fc31/0xe782b916994fd21b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964934.368113:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000c3f1fc31/0xe782b916994fd21b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964934.368118:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c3f1fc31 already unused, calling callback (00000000c6a2ab5d) 00010000:00010000:1.0:1783964934.368121:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000c3f1fc31/0xe782b916994fd21b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964934.368128:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000c3f1fc31/0xe782b916994fd21b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964934.368145:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000c3f1fc31/0xe782b916994fd21b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964934.368154:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783964934.368181:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005fe6f8fa pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ae0997f7-3a15-4fc6-865a-35b2f101956e+9:3323:x1870622732850048:12345-0@lo:103: Request processed in 335us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1783964934.368196:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783964934.368254:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000be2d083b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ae0997f7-3a15-4fc6-865a-35b2f101956e:3323:1870622732850048:0@lo:103: 00010000:00010000:0.0:1783964934.368307:0:5807:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000c3f1fc31/0xe782b916994fd21b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964934.368321:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000c3f1fc31/0xe782b916994fd21b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964934.368327:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000c3f1fc31/0xe782b916994fd21b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1783964934.368340:0:5807:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1783964934.412671:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000006312bcc7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae0997f7-3a15-4fc6-865a-35b2f101956e+8:6605:x1870622732849280:12345-0@lo:253: Request processed in 63727us (64017us total) trans 0 rc 0/0 00000100:00100000:1.0:1783964934.412693:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1783964934.412814:0:6605:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000840e2a3b pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae0997f7-3a15-4fc6-865a-35b2f101956e:6605:1870622732849280:0@lo:253: 10000000:01000000:3.0:1783964934.412834:0:6605:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1783964934.412839:0:6605:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1783964934.412841:0:6605:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1783964934.412843:0:6605:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783964934.412844:0:6605:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:3.0:1783964934.412845:0:6605:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783964934.412847:0:6605:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783964934.412848:0:6605:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783964934.412850:0:6605:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1783964934.412852:0:6605:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783964934.412854:0:6605:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1783964934.412880:0:6605:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000ebcdc16a from lustre-OST0000 10000000:01000000:3.0:1783964934.412914:0:6605:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1783964934.412918:0:6605:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1783964934.412926:0:6605:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff947407224d40 local copy 10000000:01000000:3.0:1783964934.412932:0:6605:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1783964934.413002:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.112@tcp lock: 00000000e245ce29/0xe782b916994fd222 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964934.413015:0:6605:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.112@tcp lock: 00000000e245ce29/0xe782b916994fd222 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964934.413053:0:6605:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.112@tcp lock: 00000000e245ce29/0xe782b916994fd222 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783964934.413075:0:6605:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000840e2a3b pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae0997f7-3a15-4fc6-865a-35b2f101956e:6605:1870622732850176:0@lo:101: 00000100:00100000:3.0:1783964934.413118:0:6605:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783964934.413254:0:6605:0:(client.c:2702:ptlrpc_set_wait()) set 0000000091af7bf9 going to sleep for 11 seconds 00000100:00100000:0.0:1783964934.413445:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732850176 00000100:00100000:0.0:1783964934.413457:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732850176 00000100:00100000:0.0:1783964934.413564:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1783964934.413576:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f5989f9e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae0997f7-3a15-4fc6-865a-35b2f101956e+8:6605:x1870622732850176:12345-0@lo:101: 00010000:00010000:0.0:1783964934.413592:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783964934.413608:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c3f1fc31/0xe782b916994fd229 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe782b916994fd222 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964934.413637:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c3f1fc31/0xe782b916994fd229 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe782b916994fd222 expref: 9 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964934.413648:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c3f1fc31/0xe782b916994fd229 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe782b916994fd222 expref: 9 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964934.413658:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c3f1fc31, rc 0) 00000100:00100000:0.0:1783964934.413704:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f5989f9e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae0997f7-3a15-4fc6-865a-35b2f101956e+9:6605:x1870622732850176:12345-0@lo:101: Request processed in 132us (587us total) trans 0 rc 0/0 00000100:00100000:0.0:1783964934.413710:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1783964934.413780:0:6605:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000840e2a3b pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae0997f7-3a15-4fc6-865a-35b2f101956e:6605:1870622732850176:0@lo:101: 00010000:00010000:3.0:1783964934.413792:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.112@tcp lock: 00000000e245ce29/0xe782b916994fd222 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xe782b916994fd229 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964934.413801:0:6605:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.112@tcp lock: 00000000e245ce29/0xe782b916994fd222 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xe782b916994fd229 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783964934.413918:0:6605:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000840e2a3b pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae0997f7-3a15-4fc6-865a-35b2f101956e:6605:1870622732850304:0@lo:501: 00000100:00100000:3.0:1783964934.413975:0:6605:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783964934.414043:0:6605:0:(client.c:2702:ptlrpc_set_wait()) set 0000000091af7bf9 going to sleep for 11 seconds 00000100:00100000:2.0:1783964934.414114:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732850304 00000100:00100000:2.0:1783964934.414120:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732850304 00000100:00100000:2.0:1783964934.414147:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1783964934.414153:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009c65cb8a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+9:6605:x1870622732850304:12345-0@lo:501: 00000100:00100000:2.0:1783964934.414430:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009c65cb8a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+9:6605:x1870622732850304:12345-0@lo:501: Request processed in 277us (455us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783964934.414445:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1783964934.414524:0:6605:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000840e2a3b pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae0997f7-3a15-4fc6-865a-35b2f101956e:6605:1870622732850304:0@lo:501: 10000000:01000000:3.0:1783964934.414538:0:6605:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.112@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1783964934.414563:0:6605:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.112@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1783964934.414567:0:6605:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.112@tcp lock: 00000000e245ce29/0xe782b916994fd222 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xe782b916994fd229 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964934.414575:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.112@tcp lock: 00000000e245ce29/0xe782b916994fd222 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xe782b916994fd229 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964934.414580:0:6605:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.112@tcp lock: 00000000e245ce29/0xe782b916994fd222 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xe782b916994fd229 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964934.414614:0:6605:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1783964934.414636:0:6605:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff94743e519000 10000000:01000000:3.0:1783964934.414640:0:6605:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1783964934.414645:0:6605:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff947407224d40 10000000:01000000:3.0:1783964934.414647:0:6605:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1783964934.414650:0:6605:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff947407224d40 from 1 10000000:01000000:3.0:1783964934.414653:0:6605:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1783964934.414673:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.112@tcp lock: 00000000dc495833/0xe782b916994fd230 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964934.414679:0:6605:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.112@tcp lock: 00000000dc495833/0xe782b916994fd230 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964934.414686:0:6605:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.112@tcp lock: 00000000dc495833/0xe782b916994fd230 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783964934.414698:0:6605:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000840e2a3b pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae0997f7-3a15-4fc6-865a-35b2f101956e:6605:1870622732850432:0@lo:101: 00000100:00100000:3.0:1783964934.414723:0:6605:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783964934.414740:0:6605:0:(client.c:2702:ptlrpc_set_wait()) set 00000000cf534e69 going to sleep for 11 seconds 00010000:00010000:2.0:1783964934.414797:0:5800:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783964934.414803:0:5800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.112@tcp lock: 00000000e245ce29/0xe782b916994fd222 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xe782b916994fd229 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783964934.414811:0:5800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000e245ce29 already unused, calling callback (00000000c28b6328) 10000000:00010000:2.0:1783964934.414815:0:5800:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.112@tcp lock: 00000000e245ce29/0xe782b916994fd222 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0xe782b916994fd229 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783964934.414823:0:5800:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.112@tcp lock: 00000000e245ce29/0xe782b916994fd222 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0xe782b916994fd229 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783964934.414830:0:5800:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.112@tcp lock: 00000000e245ce29/0xe782b916994fd222 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0xe782b916994fd229 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783964934.414835:0:5800:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1783964934.414858:0:5800:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.112@tcp lock: 00000000e245ce29/0xe782b916994fd222 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xe782b916994fd229 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783964934.414864:0:5800:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783964934.414895:0:5800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.112@tcp lock: 00000000e245ce29/0xe782b916994fd222 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xe782b916994fd229 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783964934.414901:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.112@tcp lock: 00000000e245ce29/0xe782b916994fd222 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0xe782b916994fd229 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783964934.414920:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783964934.414921:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783964934.414922:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783964934.414931:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783964934.414961:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000ce433988 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ae0997f7-3a15-4fc6-865a-35b2f101956e:3322:1870622732850560:0@lo:103: 00000100:00100000:2.0:1783964934.414994:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783964934.415031:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732850560 00000100:00100000:2.0:1783964934.415035:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732850560 00000100:00100000:2.0:1783964934.415070:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783964934.415076:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ce0e1562 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ae0997f7-3a15-4fc6-865a-35b2f101956e+9:3322:x1870622732850560:12345-0@lo:103: 00010000:00010000:2.0:1783964934.415101:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783964934.415116:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000c3f1fc31/0xe782b916994fd229 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe782b916994fd222 expref: 9 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783964934.415133:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783964934.415161:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ce0e1562 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ae0997f7-3a15-4fc6-865a-35b2f101956e+8:3322:x1870622732850560:12345-0@lo:103: Request processed in 87us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1783964934.415168:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783964934.415194:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000ce433988 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ae0997f7-3a15-4fc6-865a-35b2f101956e:3322:1870622732850560:0@lo:103: 00000100:00100000:2.0:1783964934.415244:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732850432 00000100:00100000:2.0:1783964934.415248:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732850432 00000100:00100000:2.0:1783964934.415264:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1783964934.415269:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b5ae872c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+8:6605:x1870622732850432:12345-0@lo:101: 00010000:00010000:2.0:1783964934.415277:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783964934.415287:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000038ed6dd1/0xe782b916994fd237 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe782b916994fd230 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783964934.415302:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000038ed6dd1/0xe782b916994fd237 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe782b916994fd230 expref: 9 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783964934.415311:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000038ed6dd1/0xe782b916994fd237 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe782b916994fd230 expref: 9 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783964934.415328:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000038ed6dd1, rc 0) 00000100:00100000:2.0:1783964934.415358:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b5ae872c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+9:6605:x1870622732850432:12345-0@lo:101: Request processed in 89us (634us total) trans 0 rc 0/0 00000100:00100000:2.0:1783964934.415363:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1783964934.415416:0:6605:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000840e2a3b pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae0997f7-3a15-4fc6-865a-35b2f101956e:6605:1870622732850432:0@lo:101: 00010000:00010000:2.0:1783964934.415425:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.112@tcp lock: 00000000dc495833/0xe782b916994fd230 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fd237 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783964934.415433:0:6605:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.112@tcp lock: 00000000dc495833/0xe782b916994fd230 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe782b916994fd237 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783964934.415449:0:6605:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.112@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1783964934.415459:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.112@tcp lock: 00000000dc495833/0xe782b916994fd230 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fd237 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783964934.415465:0:6605:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.112@tcp lock: 00000000dc495833/0xe782b916994fd230 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fd237 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783964934.415471:0:6605:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1783964934.415474:0:6605:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1783964934.415478:0:6605:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1783964934.415480:0:6605:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1783964934.415493:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.112@tcp lock: 000000001e49d806/0xe782b916994fd23e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783964934.415498:0:6605:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.112@tcp lock: 000000001e49d806/0xe782b916994fd23e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783964934.415515:0:6605:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.112@tcp lock: 000000001e49d806/0xe782b916994fd23e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783964934.415526:0:6605:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000ce433988 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae0997f7-3a15-4fc6-865a-35b2f101956e:6605:1870622732850688:0@lo:101: 00000100:00100000:2.0:1783964934.415550:0:6605:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783964934.415561:0:6605:0:(client.c:2702:ptlrpc_set_wait()) set 000000002ebd6591 going to sleep for 11 seconds 00000100:00100000:2.0:1783964934.415578:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732850688 00000100:00100000:2.0:1783964934.415582:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732850688 00000100:00100000:2.0:1783964934.415598:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1783964934.415603:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000109c40ec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+9:6605:x1870622732850688:12345-0@lo:101: 00010000:00010000:2.0:1783964934.415610:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783964934.415616:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000215dd3c6/0xe782b916994fd245 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe782b916994fd23e expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783964934.415628:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000215dd3c6/0xe782b916994fd245 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe782b916994fd23e expref: 10 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783964934.415634:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000215dd3c6/0xe782b916994fd245 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe782b916994fd23e expref: 10 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783964934.415641:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000215dd3c6, rc 0) 00000100:00100000:2.0:1783964934.415665:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000109c40ec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+10:6605:x1870622732850688:12345-0@lo:101: Request processed in 63us (115us total) trans 0 rc 0/0 00000100:00100000:2.0:1783964934.415671:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1783964934.415699:0:6605:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000ce433988 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae0997f7-3a15-4fc6-865a-35b2f101956e:6605:1870622732850688:0@lo:101: 00010000:00010000:2.0:1783964934.415708:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.112@tcp lock: 000000001e49d806/0xe782b916994fd23e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fd245 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783964934.415725:0:6605:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.112@tcp lock: 000000001e49d806/0xe782b916994fd23e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe782b916994fd245 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783964934.415815:0:6605:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000ce433988 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae0997f7-3a15-4fc6-865a-35b2f101956e:6605:1870622732850816:0@lo:501: 00000100:00100000:2.0:1783964934.415840:0:6605:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783964934.415852:0:6605:0:(client.c:2702:ptlrpc_set_wait()) set 000000002ebd6591 going to sleep for 11 seconds 00000100:00100000:2.0:1783964934.415864:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732850816 00000100:00100000:2.0:1783964934.415868:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732850816 00000100:00100000:2.0:1783964934.415885:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1783964934.415890:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fc702c65 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+10:6605:x1870622732850816:12345-0@lo:501: 00000100:00100000:2.0:1783964934.416117:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fc702c65 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+10:6605:x1870622732850816:12345-0@lo:501: Request processed in 227us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1783964934.416125:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1783964934.416169:0:6605:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000ce433988 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae0997f7-3a15-4fc6-865a-35b2f101956e:6605:1870622732850816:0@lo:501: 00000100:00100000:2.0:1783964934.416197:0:6605:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000ce433988 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae0997f7-3a15-4fc6-865a-35b2f101956e:6605:1870622732850944:0@lo:503: 00000100:00100000:2.0:1783964934.416262:0:6605:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783964934.416276:0:6605:0:(client.c:2702:ptlrpc_set_wait()) set 000000002ebd6591 going to sleep for 11 seconds 00000100:00100000:2.0:1783964934.416289:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732850944 00000100:00100000:2.0:1783964934.416292:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732850944 00000100:00100000:2.0:1783964934.416308:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1783964934.416313:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001b956f31 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+10:6605:x1870622732850944:12345-0@lo:503: 00000100:00100000:2.0:1783964934.416475:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001b956f31 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+10:6605:x1870622732850944:12345-0@lo:503: Request processed in 162us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1783964934.416482:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1783964934.416522:0:6605:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000ce433988 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae0997f7-3a15-4fc6-865a-35b2f101956e:6605:1870622732850944:0@lo:503: 00000040:00080000:2.0:1783964934.416874:0:6605:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1783964934.416950:0:6605:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000ce433988 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae0997f7-3a15-4fc6-865a-35b2f101956e:6605:1870622732851072:0@lo:502: 00000100:00100000:2.0:1783964934.416986:0:6605:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783964934.417002:0:6605:0:(client.c:2702:ptlrpc_set_wait()) set 00000000c5a523d2 going to sleep for 11 seconds 00000100:00100000:2.0:1783964934.417018:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732851072 00000100:00100000:2.0:1783964934.417022:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732851072 00000100:00100000:2.0:1783964934.417042:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1783964934.417047:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c929d5c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+10:6605:x1870622732851072:12345-0@lo:502: 00000100:00100000:2.0:1783964934.417190:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c929d5c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+10:6605:x1870622732851072:12345-0@lo:502: Request processed in 142us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1783964934.417197:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1783964934.417266:0:6605:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000ce433988 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae0997f7-3a15-4fc6-865a-35b2f101956e:6605:1870622732851072:0@lo:502: 00000040:00080000:2.0:1783964934.417532:0:6605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1783964934.417582:0:6605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1783964934.417616:0:6605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1783964934.417666:0:6605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1783964934.417705:0:6605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1783964934.417741:0:6605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1783964934.417763:0:6605:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000ce433988 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae0997f7-3a15-4fc6-865a-35b2f101956e:6605:1870622732851200:0@lo:502: 00000100:00100000:2.0:1783964934.417797:0:6605:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783964934.417813:0:6605:0:(client.c:2702:ptlrpc_set_wait()) set 00000000c5a523d2 going to sleep for 11 seconds 00000100:00100000:2.0:1783964934.417827:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732851200 00000100:00100000:2.0:1783964934.417831:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732851200 00000100:00100000:2.0:1783964934.417852:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1783964934.417858:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003bf3033f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+10:6605:x1870622732851200:12345-0@lo:502: 00000100:00100000:2.0:1783964934.421859:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003bf3033f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+10:6605:x1870622732851200:12345-0@lo:502: Request processed in 3986us (4046us total) trans 0 rc 0/0 00000100:00100000:2.0:1783964934.421903:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1783964934.422423:0:6605:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000ce433988 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae0997f7-3a15-4fc6-865a-35b2f101956e:6605:1870622732851200:0@lo:502: 00000040:00080000:2.0:1783964934.422726:0:6605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1783964934.422745:0:6605:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:2.0:1783964934.423345:0:6622:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1783964934.423428:0:6622:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:2.0:1783964934.423436:0:6622:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783964934.423439:0:6622:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1783964934.423446:0:6622:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1783964934.423464:0:6622:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (000000001b0acc2b) 00000020:00000080:2.0:1783964934.423492:0:6622:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:2.0:1783964934.423498:0:6622:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1783964934.423585:0:6622:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000ebcdc16a from lustre-OST0000, refs=2 00080000:01000000:2.0:1783964934.423594:0:6622:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:2.0:1783964934.423602:0:6622:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xe782b916994fd253 00010000:00010000:2.0:1783964934.428058:0:6622:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:3.0:1783964934.428638:0:6622:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:3.0:1783964934.432673:0:6622:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1783964934.433393:0:6622:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:0.0:1783964934.442585:0:6622:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:0.0:1783964934.443153:0:6622:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:0.0:1783964934.445040:0:6622:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1783964934.445062:0:6622:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783964934.445070:0:6622:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783964934.445072:0:6622:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1783964934.445076:0:6622:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783964934.445080:0:6622:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783964934.445082:0:6622:0:(obd_config.c:1561:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:0.0:1783964934.445085:0:6622:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1783964934.445086:0:6622:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1783964934.445155:0:6622:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783964934.445159:0:6622:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783964934.445160:0:6622:0:(obd_config.c:1561:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:0.0:1783964934.445163:0:6622:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1783964934.445443:0:6605:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:3.0:1783964934.445472:0:6605:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.112@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1783964934.445498:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.112@tcp lock: 000000001e49d806/0xe782b916994fd23e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fd245 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964934.445524:0:6605:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.112@tcp lock: 000000001e49d806/0xe782b916994fd23e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fd245 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783964934.445532:0:6605:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff94743e519000 from 1 10000000:01000000:3.0:1783964934.445535:0:6605:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783964934.445583:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.112@tcp lock: 000000005809f6a4/0xe782b916994fd25a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964934.445592:0:6605:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.112@tcp lock: 000000005809f6a4/0xe782b916994fd25a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964934.445603:0:6605:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.112@tcp lock: 000000005809f6a4/0xe782b916994fd25a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783964934.445632:0:6605:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003de2850f pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae0997f7-3a15-4fc6-865a-35b2f101956e:6605:1870622732851328:0@lo:101: 00000100:00100000:3.0:1783964934.445721:0:6605:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783964934.445770:0:6605:0:(client.c:2702:ptlrpc_set_wait()) set 000000008e05de77 going to sleep for 11 seconds 00000100:00100000:0.0:1783964934.446467:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732851328 00000100:00100000:0.0:1783964934.446477:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732851328 00000100:00100000:0.0:1783964934.446546:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1783964934.446558:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007b436ddc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae0997f7-3a15-4fc6-865a-35b2f101956e+10:6605:x1870622732851328:12345-0@lo:101: 00010000:00010000:0.0:1783964934.446577:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783964934.446594:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000009cb34d8a/0xe782b916994fd261 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe782b916994fd25a expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964934.446625:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000009cb34d8a/0xe782b916994fd261 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe782b916994fd25a expref: 11 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964934.446637:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000009cb34d8a/0xe782b916994fd261 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe782b916994fd25a expref: 11 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964934.446646:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000009cb34d8a, rc 0) 00000100:00100000:0.0:1783964934.446707:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007b436ddc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae0997f7-3a15-4fc6-865a-35b2f101956e+11:6605:x1870622732851328:12345-0@lo:101: Request processed in 152us (986us total) trans 0 rc 0/0 00000100:00100000:0.0:1783964934.446714:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1783964934.446820:0:6605:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003de2850f pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae0997f7-3a15-4fc6-865a-35b2f101956e:6605:1870622732851328:0@lo:101: 00010000:00010000:3.0:1783964934.446839:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.112@tcp lock: 000000005809f6a4/0xe782b916994fd25a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fd261 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964934.446848:0:6605:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.112@tcp lock: 000000005809f6a4/0xe782b916994fd25a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe782b916994fd261 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783964934.447127:0:6605:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003de2850f pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae0997f7-3a15-4fc6-865a-35b2f101956e:6605:1870622732851456:0@lo:501: 00000100:00100000:3.0:1783964934.447169:0:6605:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783964934.447239:0:6605:0:(client.c:2702:ptlrpc_set_wait()) set 000000008e05de77 going to sleep for 11 seconds 00000100:00100000:0.0:1783964934.447454:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732851456 00000100:00100000:0.0:1783964934.447467:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732851456 00000100:00100000:0.0:1783964934.447505:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1783964934.447514:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000060b64e20 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+11:6605:x1870622732851456:12345-0@lo:501: 00000100:00100000:0.0:1783964934.447829:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000060b64e20 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+11:6605:x1870622732851456:12345-0@lo:501: Request processed in 317us (660us total) trans 0 rc 0/0 00000100:00100000:0.0:1783964934.447838:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1783964934.447959:0:6605:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003de2850f pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae0997f7-3a15-4fc6-865a-35b2f101956e:6605:1870622732851456:0@lo:501: 00000100:00100000:3.0:1783964934.447995:0:6605:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@000000003de2850f pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae0997f7-3a15-4fc6-865a-35b2f101956e:6605:1870622732851584:0@lo:503: 00000100:00100000:3.0:1783964934.448036:0:6605:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783964934.448064:0:6605:0:(client.c:2702:ptlrpc_set_wait()) set 000000008e05de77 going to sleep for 11 seconds 00000100:00100000:0.0:1783964934.449477:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732851584 00000100:00100000:0.0:1783964934.449488:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732851584 00000100:00100000:0.0:1783964934.449560:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1783964934.449569:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004b1fd325 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+11:6605:x1870622732851584:12345-0@lo:503: 00000100:00100000:2.0:1783964934.450515:0:6605:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@000000003de2850f pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae0997f7-3a15-4fc6-865a-35b2f101956e:6605:1870622732851584:0@lo:503: 00000040:00080000:2.0:1783964934.450912:0:6605:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1783964934.451015:0:6605:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@0000000051ebd8ac pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae0997f7-3a15-4fc6-865a-35b2f101956e:6605:1870622732851712:0@lo:502: 00000100:00100000:2.0:1783964934.451075:0:6605:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783964934.451260:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004b1fd325 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+11:6605:x1870622732851584:12345-0@lo:503: Request processed in 1691us (3221us total) trans 0 rc 0/0 00000100:00100000:0.0:1783964934.451272:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1783964934.451378:0:6605:0:(client.c:2702:ptlrpc_set_wait()) set 00000000b8f39a62 going to sleep for 11 seconds 00000100:00100000:0.0:1783964934.454114:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732851712 00000100:00100000:0.0:1783964934.454135:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732851712 00000100:00100000:0.0:1783964934.454254:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1783964934.454265:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000bd3af900 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+11:6605:x1870622732851712:12345-0@lo:502: 00000100:00100000:1.0:1783964934.454842:0:6605:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@0000000051ebd8ac pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae0997f7-3a15-4fc6-865a-35b2f101956e:6605:1870622732851712:0@lo:502: 00000040:00080000:1.0:1783964934.455271:0:6605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1783964934.455483:0:6605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1783964934.455534:0:6605:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@00000000be2d083b pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae0997f7-3a15-4fc6-865a-35b2f101956e:6605:1870622732851840:0@lo:502: 00000100:00100000:1.0:1783964934.455602:0:6605:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783964934.455710:0:6605:0:(client.c:2702:ptlrpc_set_wait()) set 00000000fdfd6fee going to sleep for 11 seconds 00000100:00100000:2.0:1783964934.455839:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732851840 00000100:00100000:2.0:1783964934.455847:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732851840 00000100:00100000:2.0:1783964934.456021:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1783964934.456031:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d2b68738 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae0997f7-3a15-4fc6-865a-35b2f101956e+12:6605:x1870622732851840:12345-0@lo:502: 00000100:00100000:2.0:1783964934.456408:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d2b68738 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae0997f7-3a15-4fc6-865a-35b2f101956e+12:6605:x1870622732851840:12345-0@lo:502: Request processed in 378us (805us total) trans 0 rc 0/0 00000100:00100000:2.0:1783964934.456419:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1783964934.456443:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000bd3af900 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+11:6605:x1870622732851712:12345-0@lo:502: Request processed in 441us (3629us total) trans 0 rc 0/0 00000100:00100000:0.0:1783964934.456458:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1783964934.456687:0:6605:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@00000000be2d083b pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae0997f7-3a15-4fc6-865a-35b2f101956e:6605:1870622732851840:0@lo:502: 00000040:00080000:1.0:1783964934.457441:0:6605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1783964934.457460:0:6605:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1783964934.458508:0:6626:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783964934.458522:0:6626:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783964934.458525:0:6626:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1783964934.458531:0:6626:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff94743e519000 00000020:00000080:1.0:1783964934.458533:0:6626:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1783964934.458575:0:6626:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783964934.458579:0:6626:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783964934.458581:0:6626:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1783964934.458584:0:6626:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1783964934.458738:0:6605:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1783964934.458837:0:6605:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1783964934.458913:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.112@tcp lock: ffff9474420ffe00/0xe782b916994fd25a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fd261 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783964934.458927:0:6605:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.112@tcp lock: ffff9474420ffe00/0xe782b916994fd25a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fd261 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783964934.458986:0:6605:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1783964934.458989:0:6605:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff94743e519000 10000000:01000000:2.0:1783964934.458993:0:6605:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff94743e519000 10000000:01000000:2.0:1783964934.458998:0:6605:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1783964934.459004:0:6605:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff94743e519000 from 1 10000000:01000000:2.0:1783964934.459007:0:6605:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1783964934.459054:0:6605:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.112@tcp lock: ffff947430c11400/0xe782b916994fd268 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783964934.459064:0:6605:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.112@tcp lock: ffff947430c11400/0xe782b916994fd268 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783964934.459077:0:6605:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.112@tcp lock: ffff947430c11400/0xe782b916994fd268 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783964934.459109:0:6605:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9474072a9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae0997f7-3a15-4fc6-865a-35b2f101956e:6605:1870622732851968:0@lo:101: 00000100:00100000:2.0:1783964934.459198:0:6605:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783964934.459323:0:6605:0:(client.c:2702:ptlrpc_set_wait()) set ffff9473048cc9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783964934.459554:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732851968 00000100:00100000:1.0:1783964934.459562:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732851968 00000100:00100000:1.0:1783964934.459616:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1783964934.459627:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947405adfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae0997f7-3a15-4fc6-865a-35b2f101956e+11:6605:x1870622732851968:12345-0@lo:101: 00010000:00010000:1.0:1783964934.459654:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783964934.459672:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff947401482a00/0xe782b916994fd26f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe782b916994fd268 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964934.459702:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff947401482a00/0xe782b916994fd26f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe782b916994fd268 expref: 12 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964934.459715:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff947401482a00/0xe782b916994fd26f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe782b916994fd268 expref: 12 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964934.459725:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff947401482a00, rc 0) 00000100:00100000:1.0:1783964934.459793:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947405adfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae0997f7-3a15-4fc6-865a-35b2f101956e+12:6605:x1870622732851968:12345-0@lo:101: Request processed in 168us (595us total) trans 0 rc 0/0 00000100:00100000:1.0:1783964934.459800:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1783964934.459982:0:6605:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9474072a9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae0997f7-3a15-4fc6-865a-35b2f101956e:6605:1870622732851968:0@lo:101: 00010000:00010000:3.0:1783964934.460017:0:6605:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.112@tcp lock: ffff947430c11400/0xe782b916994fd268 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fd26f expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964934.460032:0:6605:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.112@tcp lock: ffff947430c11400/0xe782b916994fd268 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe782b916994fd26f expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783964934.460166:0:6605:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9474368d7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae0997f7-3a15-4fc6-865a-35b2f101956e:6605:1870622732852096:0@lo:501: 00000100:00100000:3.0:1783964934.460251:0:6605:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783964934.460394:0:6605:0:(client.c:2702:ptlrpc_set_wait()) set ffff947429e5d780 going to sleep for 11 seconds 00000100:00100000:0.0:1783964934.460473:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732852096 00000100:00100000:0.0:1783964934.460481:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732852096 00000100:00100000:0.0:1783964934.460556:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1783964934.460565:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947405add850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+12:6605:x1870622732852096:12345-0@lo:501: 00000100:00100000:0.0:1783964934.461698:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947405add850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+12:6605:x1870622732852096:12345-0@lo:501: Request processed in 1129us (1440us total) trans 0 rc 0/0 00000100:00100000:0.0:1783964934.461711:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1783964934.461757:0:6605:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9474368d7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae0997f7-3a15-4fc6-865a-35b2f101956e:6605:1870622732852096:0@lo:501: 00000100:00100000:3.0:1783964934.461811:0:6605:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9474368d7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae0997f7-3a15-4fc6-865a-35b2f101956e:6605:1870622732852224:0@lo:503: 00000100:00100000:3.0:1783964934.461878:0:6605:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783964934.462512:0:6605:0:(client.c:2702:ptlrpc_set_wait()) set ffff947429e5d780 going to sleep for 11 seconds 00000100:00100000:1.0:1783964934.463486:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732852224 00000100:00100000:1.0:1783964934.463501:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732852224 00000100:00100000:1.0:1783964934.465387:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1783964934.465407:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947405adf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae0997f7-3a15-4fc6-865a-35b2f101956e+12:6605:x1870622732852224:12345-0@lo:503: 00000100:00100000:3.0:1783964934.466019:0:6605:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9474368d7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae0997f7-3a15-4fc6-865a-35b2f101956e:6605:1870622732852224:0@lo:503: 10000000:01000000:2.0:1783964934.466518:0:5809:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1783964934.466524:0:5809:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff947403dc3000 from 21 10000000:01000000:2.0:1783964934.466530:0:5809:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1783964934.466580:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.112@tcp lock: ffff947430c10a00/0xe782b916994fd276 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783964934.466610:0:5809:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.112@tcp lock: ffff947430c10a00/0xe782b916994fd276 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783964934.466621:0:5809:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.112@tcp lock: ffff947430c10a00/0xe782b916994fd276 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783964934.466646:0:5809:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9474072a8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae0997f7-3a15-4fc6-865a-35b2f101956e:5809:1870622732852352:0@lo:101: 00000100:00100000:2.0:1783964934.466717:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783964934.466835:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947405adf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae0997f7-3a15-4fc6-865a-35b2f101956e+12:6605:x1870622732852224:12345-0@lo:503: Request processed in 1431us (4952us total) trans 0 rc 0/0 00000100:00100000:1.0:1783964934.466846:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1783964934.466907:0:5809:0:(client.c:2702:ptlrpc_set_wait()) set ffff9473048cce40 going to sleep for 11 seconds 00000100:00100000:1.0:1783964934.466912:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732852352 00000100:00100000:1.0:1783964934.466921:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732852352 00000040:00080000:3.0:1783964934.466976:0:6605:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1783964934.467082:0:6605:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9474368d7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae0997f7-3a15-4fc6-865a-35b2f101956e:6605:1870622732852480:0@lo:502: 00000100:00100000:0.0:1783964934.467100:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1783964934.467129:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947405adf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+12:5809:x1870622732852352:12345-0@lo:101: 00010000:00010000:0.0:1783964934.467146:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1783964934.467166:0:6605:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783964934.467189:0:6605:0:(client.c:2702:ptlrpc_set_wait()) set ffff947429e5d780 going to sleep for 11 seconds 00010000:00010000:0.0:1783964934.468432:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff947400030200/0xe782b916994fd27d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe782b916994fd276 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964934.468493:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff947400030200/0xe782b916994fd27d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe782b916994fd276 expref: 13 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964934.468509:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff947400030200/0xe782b916994fd27d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe782b916994fd276 expref: 13 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964934.468519:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff947400030200, rc 0) 00000100:00100000:0.0:1783964934.468612:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947405adf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+13:5809:x1870622732852352:12345-0@lo:101: Request processed in 1501us (1897us total) trans 0 rc 0/0 00000100:00100000:0.0:1783964934.468620:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1783964934.468666:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732852480 00000100:00100000:0.0:1783964934.468672:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732852480 00000100:00100000:0.0:1783964934.468712:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1783964934.468721:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947405adf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+13:6605:x1870622732852480:12345-0@lo:502: 00000100:00100000:0.0:1783964934.469527:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947405adf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+13:6605:x1870622732852480:12345-0@lo:502: Request processed in 805us (2361us total) trans 0 rc 0/0 00000100:00100000:0.0:1783964934.469539:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1783964934.469630:0:5809:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9474072a8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae0997f7-3a15-4fc6-865a-35b2f101956e:5809:1870622732852352:0@lo:101: 00000100:00100000:2.0:1783964934.469634:0:6605:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9474368d7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae0997f7-3a15-4fc6-865a-35b2f101956e:6605:1870622732852480:0@lo:502: 00010000:00010000:3.0:1783964934.469689:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.112@tcp lock: ffff947430c10a00/0xe782b916994fd276 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fd27d expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964934.469723:0:5809:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.112@tcp lock: ffff947430c10a00/0xe782b916994fd276 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe782b916994fd27d expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783964934.469841:0:5809:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9474368d5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae0997f7-3a15-4fc6-865a-35b2f101956e:5809:1870622732852608:0@lo:501: 00000100:00100000:3.0:1783964934.469916:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783964934.469973:0:5809:0:(client.c:2702:ptlrpc_set_wait()) set ffff947429e5de40 going to sleep for 11 seconds 00000100:00100000:0.0:1783964934.470020:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732852608 00000100:00100000:0.0:1783964934.470028:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732852608 00000100:00100000:0.0:1783964934.470084:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1783964934.470095:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947405adcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae0997f7-3a15-4fc6-865a-35b2f101956e+13:5809:x1870622732852608:12345-0@lo:501: 00000100:00100000:0.0:1783964934.470443:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947405adcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae0997f7-3a15-4fc6-865a-35b2f101956e+13:5809:x1870622732852608:12345-0@lo:501: Request processed in 350us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1783964934.470457:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1783964934.470834:0:5809:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9474368d5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae0997f7-3a15-4fc6-865a-35b2f101956e:5809:1870622732852608:0@lo:501: 00000100:00100000:3.0:1783964934.470879:0:5809:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9474368d5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae0997f7-3a15-4fc6-865a-35b2f101956e:5809:1870622732852736:0@lo:503: 00000100:00100000:3.0:1783964934.470946:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783964934.470971:0:5809:0:(client.c:2702:ptlrpc_set_wait()) set ffff947429e5de40 going to sleep for 11 seconds 00000100:00100000:3.0:1783964934.470992:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732852736 00000100:00100000:3.0:1783964934.470997:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732852736 00000100:00100000:3.0:1783964934.471043:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1783964934.471052:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947405add450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+13:5809:x1870622732852736:12345-0@lo:503: 00000040:00080000:2.0:1783964934.472806:0:6605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000100:00100000:3.0:1783964934.472884:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947405add450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+13:5809:x1870622732852736:12345-0@lo:503: Request processed in 1823us (1928us total) trans 0 rc 0/0 00000100:00100000:3.0:1783964934.472898:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000040:00080000:2.0:1783964934.473021:0:6605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:2.0:1783964934.473065:0:6605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:2.0:1783964934.473112:0:6605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:2.0:1783964934.473263:0:6605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:2.0:1783964934.473401:0:6605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:2.0:1783964934.473436:0:6605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:2.0:1783964934.473471:0:6605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:2.0:1783964934.473526:0:6605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:2.0:1783964934.473573:0:6605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:2.0:1783964934.473610:0:6605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:2.0:1783964934.473675:0:6605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:2.0:1783964934.473719:0:6605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:2.0:1783964934.473753:0:6605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:2.0:1783964934.473804:0:6605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:2.0:1783964934.473840:0:6605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:2.0:1783964934.473872:0:6605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000100:00100000:0.0:1783964934.474136:0:5809:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9474368d5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae0997f7-3a15-4fc6-865a-35b2f101956e:5809:1870622732852736:0@lo:503: 00000040:00080000:2.0:1783964934.475510:0:6605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:2.0:1783964934.475598:0:6605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:2.0:1783964934.475647:0:6605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:2.0:1783964934.475714:0:6605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:2.0:1783964934.475752:0:6605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:2.0:1783964934.475784:0:6605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:2.0:1783964934.475833:0:6605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:2.0:1783964934.475868:0:6605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:2.0:1783964934.475899:0:6605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:2.0:1783964934.475963:0:6605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:2.0:1783964934.475998:0:6605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:2.0:1783964934.476061:0:6605:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9474072aa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae0997f7-3a15-4fc6-865a-35b2f101956e:6605:1870622732852864:0@lo:502: 00000100:00100000:2.0:1783964934.476167:0:6605:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783964934.476277:0:6605:0:(client.c:2702:ptlrpc_set_wait()) set ffff9473048cc900 going to sleep for 11 seconds 00000100:00100000:1.0:1783964934.476376:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732852864 00000100:00100000:1.0:1783964934.476387:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732852864 00000100:00100000:1.0:1783964934.476445:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1783964934.476456:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947405ade050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae0997f7-3a15-4fc6-865a-35b2f101956e+13:6605:x1870622732852864:12345-0@lo:502: 00000100:00100000:1.0:1783964934.477393:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947405ade050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae0997f7-3a15-4fc6-865a-35b2f101956e+13:6605:x1870622732852864:12345-0@lo:502: Request processed in 931us (1219us total) trans 0 rc 0/0 00000100:00100000:1.0:1783964934.477417:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1783964934.477609:0:6627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9474072a8e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae0997f7-3a15-4fc6-865a-35b2f101956e:6627:1870622732852992:0@lo:502: 00000100:00100000:2.0:1783964934.477652:0:6627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783964934.477693:0:6627:0:(client.c:2702:ptlrpc_set_wait()) set ffff9473048cc0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783964934.477752:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732852992 00000100:00100000:3.0:1783964934.477759:0:6605:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9474072aa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae0997f7-3a15-4fc6-865a-35b2f101956e:6605:1870622732852864:0@lo:502: 00000100:00100000:0.0:1783964934.477761:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732852992 00000100:00100000:0.0:1783964934.477820:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1783964934.477832:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947405ade850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+13:6627:x1870622732852992:12345-0@lo:502: 00000040:00080000:3.0:1783964934.478015:0:6605:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:3.0:1783964934.478040:0:6605:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000100:00100000:0.0:1783964934.478148:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947405ade850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+13:6627:x1870622732852992:12345-0@lo:502: Request processed in 317us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1783964934.478157:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1783964934.478369:0:6627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9474072a8e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae0997f7-3a15-4fc6-865a-35b2f101956e:6627:1870622732852992:0@lo:502: 00000100:00100000:1.0:1783964934.478426:0:6627:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947436305880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae0997f7-3a15-4fc6-865a-35b2f101956e:6627:1870622732853120:0@lo:502: 00000100:00100000:1.0:1783964934.478471:0:6627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783964934.478503:0:6627:0:(client.c:2702:ptlrpc_set_wait()) set ffff947408ea5480 going to sleep for 11 seconds 00000100:00100000:3.0:1783964934.479361:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732853120 00000100:00100000:3.0:1783964934.479373:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732853120 00000100:00100000:3.0:1783964934.479520:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1783964934.479530:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947405adc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae0997f7-3a15-4fc6-865a-35b2f101956e+13:6627:x1870622732853120:12345-0@lo:502: 00000100:00100000:3.0:1783964934.479790:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947405adc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae0997f7-3a15-4fc6-865a-35b2f101956e+13:6627:x1870622732853120:12345-0@lo:502: Request processed in 261us (1319us total) trans 0 rc 0/0 00000100:00100000:3.0:1783964934.479805:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1783964934.479925:0:6627:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947436305880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae0997f7-3a15-4fc6-865a-35b2f101956e:6627:1870622732853120:0@lo:502: 00000040:00080000:1.0:1783964934.479972:0:6627:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:3.0:1783964934.480134:0:5809:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:3.0:1783964934.480153:0:5809:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.112@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1783964934.480163:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.112@tcp lock: ffff947430c10a00/0xe782b916994fd276 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fd27d expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964934.480175:0:5809:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.112@tcp lock: ffff947430c10a00/0xe782b916994fd276 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fd27d expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783964934.480184:0:5809:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1783964934.480187:0:5809:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:3.0:1783964934.480190:0:5809:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1783964934.480289:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.112@tcp lock: ffff9474420fe600/0xe782b916994fd284 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964934.480298:0:5809:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.112@tcp lock: ffff9474420fe600/0xe782b916994fd284 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964934.480309:0:5809:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.112@tcp lock: ffff9474420fe600/0xe782b916994fd284 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783964934.480328:0:5809:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9474368d4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae0997f7-3a15-4fc6-865a-35b2f101956e:5809:1870622732853248:0@lo:101: 00000100:00100000:3.0:1783964934.480363:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783964934.480432:0:5809:0:(client.c:2702:ptlrpc_set_wait()) set ffff947429e5db40 going to sleep for 11 seconds 00000100:00100000:1.0:1783964934.480502:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732853248 00000100:00100000:1.0:1783964934.480507:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732853248 00000100:00100000:1.0:1783964934.480578:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1783964934.480590:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947405add050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae0997f7-3a15-4fc6-865a-35b2f101956e+13:5809:x1870622732853248:12345-0@lo:101: 00010000:00010000:1.0:1783964934.480602:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783964934.480616:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff947401482200/0xe782b916994fd28b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe782b916994fd284 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964934.480640:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff947401482200/0xe782b916994fd28b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe782b916994fd284 expref: 14 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964934.480651:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff947401482200/0xe782b916994fd28b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe782b916994fd284 expref: 14 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964934.480662:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff947401482200, rc 0) 00000100:00100000:1.0:1783964934.480711:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947405add050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae0997f7-3a15-4fc6-865a-35b2f101956e+14:5809:x1870622732853248:12345-0@lo:101: Request processed in 124us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1783964934.480718:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1783964934.480871:0:5809:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9474368d4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae0997f7-3a15-4fc6-865a-35b2f101956e:5809:1870622732853248:0@lo:101: 00000020:01000004:3.0:1783964934.480912:0:6628:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00010000:00010000:0.0:1783964934.480960:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.112@tcp lock: ffff9474420fe600/0xe782b916994fd284 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fd28b expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964934.480975:0:5809:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.112@tcp lock: ffff9474420fe600/0xe782b916994fd284 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xe782b916994fd28b expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783964934.481144:0:5809:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947436334a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae0997f7-3a15-4fc6-865a-35b2f101956e:5809:1870622732853376:0@lo:501: 00000100:00100000:0.0:1783964934.481235:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783964934.481267:0:5809:0:(client.c:2702:ptlrpc_set_wait()) set ffff9473048c29c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783964934.482074:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732853376 00000100:00100000:2.0:1783964934.482083:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732853376 00000100:00100000:2.0:1783964934.482134:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1783964934.482144:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947405ade450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae0997f7-3a15-4fc6-865a-35b2f101956e+14:5809:x1870622732853376:12345-0@lo:501: 00000020:00000080:3.0:1783964934.482535:0:6628:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9473050319c0) 00000100:00100000:2.0:1783964934.482770:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947405ade450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae0997f7-3a15-4fc6-865a-35b2f101956e+14:5809:x1870622732853376:12345-0@lo:501: Request processed in 624us (1530us total) trans 0 rc 0/0 00000100:00100000:2.0:1783964934.482780:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1783964934.482842:0:5809:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947436334a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae0997f7-3a15-4fc6-865a-35b2f101956e:5809:1870622732853376:0@lo:501: 00000100:00100000:2.0:1783964934.482893:0:5809:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9474072ab800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae0997f7-3a15-4fc6-865a-35b2f101956e:5809:1870622732853504:0@lo:503: 00000020:00000080:3.0:1783964934.482910:0:6628:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000100:00100000:2.0:1783964934.482975:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783964934.483009:0:5809:0:(client.c:2702:ptlrpc_set_wait()) set ffff9473048cccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1783964934.483026:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732853504 00000100:00100000:2.0:1783964934.483032:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732853504 00000100:00100000:2.0:1783964934.483077:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1783964934.483086:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947405adc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae0997f7-3a15-4fc6-865a-35b2f101956e+14:5809:x1870622732853504:12345-0@lo:503: 00000100:00100000:2.0:1783964934.483652:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947405adc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae0997f7-3a15-4fc6-865a-35b2f101956e+14:5809:x1870622732853504:12345-0@lo:503: Request processed in 565us (675us total) trans 0 rc 0/0 00000100:00100000:2.0:1783964934.483659:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000020:01000004:3.0:1783964934.483767:0:6628:0:(tgt_mount.c:153:server_get_mount()) get mount ffff94743e519000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1783964934.483773:0:6628:0:(tgt_mount.c:187:server_put_mount()) put mount ffff94743e519000 from lustre-OST0000, refs=3 00000020:01000004:3.0:1783964934.483786:0:6628:0:(obd_mount.c:710:lustre_put_lsi()) put ffff94743e519000 3 00010000:00080000:3.0:1783964934.483825:0:6628:0:(ldlm_lib.c:102:import_set_conn()) imp ffff947304bd5800@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.112@tcp at head 00000100:00100000:0.0:1783964934.484887:0:5809:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9474072ab800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae0997f7-3a15-4fc6-865a-35b2f101956e:5809:1870622732853504:0@lo:503: 00010000:00010000:3.0:1783964934.489136:0:6628:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:3.0:1783964934.489518:0:6628:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1783964934.489566:0:6628:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1783964934.489583:0:6628:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xe782b916994fd299 00000100:00080000:3.0:1783964934.489598:0:6628:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1783964934.489607:0:6628:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff947304bd5800 using connection 192.168.204.112@tcp/0@lo 00000100:00100000:3.0:1783964934.489661:0:6628:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9474368d7b80 x1870622732853632/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783964934.489734:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9474368d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3321:1870622732853632:0@lo:38: 00000100:00100000:2.0:1783964934.489830:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783964934.489996:0:6628:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1783964934.490074:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9474368d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3324:1870622732853760:0@lo:400: 00000100:00100000:3.0:1783964934.490117:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783964934.491097:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732853632 00000100:00100000:2.0:1783964934.491110:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732853632 00000100:00100000:2.0:1783964934.491151:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732853760 00000100:00100000:2.0:1783964934.491155:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732853760 00000100:00100000:0.0:1783964934.491181:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783964934.491194:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9474072aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3321:x1870622732853632:12345-0@lo:38: 00010000:00080000:0.0:1783964934.491269:0:5812:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 168 last 0 00000020:00000080:0.0:1783964934.491326:0:5812:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xe782b916994fd2a0 00000004:00100000:0.0:1783964934.491347:0:5812:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:2.0:1783964934.491359:0:5813:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1783964934.491368:0:5813:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1783964934.491391:0:5811:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00080000:0.0:1783964934.491398:0:5812:0:(import.c:65:import_set_state_nolock()) ffff947405902000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783964934.491401:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783964934.491408:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9474368d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3324:x1870622732853760:12345-0@lo:400: 00000100:00100000:2.0:1783964934.491485:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9474368d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3324:x1870622732853760:12345-0@lo:400: Request processed in 78us (1370us total) trans 0 rc 0/0 00000100:00100000:0.0:1783964934.491485:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9474072aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1870622732853632:12345-0@lo:38: Request processed in 292us (1655us total) trans 0 rc 0/0 00000100:00100000:2.0:1783964934.491493:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783964934.491496:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1783964934.491561:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9474368d7b80 x1870622732853632/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783964944 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00080000:1.0:1783964934.491569:0:3324:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9474368d5c00 x1870622732853760/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783964950 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783964934.491578:0:3321:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1783964934.491594:0:3321:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:2.0:1783964934.491604:0:3321:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1783964934.491613:0:3321:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1783964934.491616:0:3321:0:(import.c:65:import_set_state_nolock()) ffff947304bd5800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1783964934.491619:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9474368d5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3324:1870622732853760:0@lo:400: 00000100:00100000:2.0:1783964934.491627:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9474368d7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3321:1870622732853632:0@lo:38: 00000040:00080000:3.0:1783964934.492099:0:6628:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:3.0:1783964934.492161:0:6605:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:3.0:1783964934.492190:0:6605:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.112@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1783964934.492223:0:6605:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.112@tcp lock: ffff947430c11400/0xe782b916994fd268 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fd26f expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964934.492235:0:6605:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.112@tcp lock: ffff947430c11400/0xe782b916994fd268 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fd26f expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783964934.492276:0:6630:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9474072aa300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae0997f7-3a15-4fc6-865a-35b2f101956e:6630:1870622732853888:0@lo:502: 00000020:01000004:3.0:1783964934.492301:0:6605:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1783964934.492304:0:6605:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1783964934.492306:0:6605:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783964934.492307:0:6605:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783964934.492308:0:6605:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783964934.492310:0:6605:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783964934.492311:0:6605:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783964934.492313:0:6605:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1783964934.492314:0:6605:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1783964934.492321:0:6605:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783964934.492322:0:6605:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1783964934.492326:0:6605:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:3.0:1783964934.492329:0:6605:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1783964934.492330:0:6605:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1783964934.492331:0:6605:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783964934.492332:0:6605:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783964934.492332:0:6605:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783964934.492333:0:6605:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783964934.492334:0:6605:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783964934.492335:0:6605:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1783964934.492336:0:6605:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1783964934.492337:0:6605:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783964934.492338:0:6605:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1783964934.492365:0:6605:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1783964934.492383:0:6605:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9474368d4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae0997f7-3a15-4fc6-865a-35b2f101956e:6605:1870622732854016:0@lo:253: 00000100:00100000:2.0:1783964934.492415:0:6630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783964934.492460:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732853888 00000100:00100000:2.0:1783964934.492466:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732853888 00000100:00100000:3.0:1783964934.492472:0:6605:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783964934.492508:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732854016 00000100:00100000:2.0:1783964934.492513:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732854016 00000100:00100000:3.0:1783964934.492532:0:6605:0:(client.c:2702:ptlrpc_set_wait()) set ffff947429e5d6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783964934.492540:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1783964934.492549:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947405adc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae0997f7-3a15-4fc6-865a-35b2f101956e+15:6630:x1870622732853888:12345-0@lo:502: 00000100:00100000:3.0:1783964934.492571:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1783964934.492590:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947405adec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae0997f7-3a15-4fc6-865a-35b2f101956e+15:6605:x1870622732854016:12345-0@lo:253: 20000000:01000000:3.0:1783964934.492621:0:5807:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1783964934.492635:0:5807:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:2.0:1783964934.492863:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947405adc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae0997f7-3a15-4fc6-865a-35b2f101956e+15:6630:x1870622732853888:12345-0@lo:502: Request processed in 314us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1783964934.492872:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1783964934.494217:0:6630:0:(client.c:2702:ptlrpc_set_wait()) set ffff9473048cc900 going to sleep for 11 seconds 00000100:00100000:2.0:1783964934.494255:0:6630:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9474072aa300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae0997f7-3a15-4fc6-865a-35b2f101956e:6630:1870622732853888:0@lo:502: 00000020:01000000:2.0:1783964934.494312:0:6630:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1783964934.494322:0:6630:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1783964934.494331:0:6630:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783964934.494333:0:6630:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1783964934.494341:0:6630:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1783964934.494345:0:6630:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.112@tcp to nid 0x20000c0a8cc70 (192.168.204.112@tcp) 00000020:01000000:2.0:1783964934.494375:0:6630:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1783964934.494379:0:6630:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1783964934.494398:0:6630:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff94743729cd40) 00000020:00000080:2.0:1783964934.494424:0:6630:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:2.0:1783964934.494429:0:6630:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1783964934.494543:0:6630:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1783964934.494550:0:6630:0:(osd_handler.c:1569:osd_obd_connect()) connect #5 00000020:00000080:2.0:1783964934.494559:0:6630:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe782b916994fd2ae 00010000:00080000:2.0:1783964934.494598:0:6630:0:(ldlm_lib.c:102:import_set_conn()) imp ffff947425afd800@lustre-OST0000-osc-MDT0000: add connection 192.168.204.112@tcp at head 00010000:00010000:2.0:1783964934.495568:0:6630:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 20000000:01000000:1.0:1783964934.522849:0:5807:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1783964934.522871:0:5807:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:3.0:1783964934.523001:0:5827:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1783964934.523008:0:5827:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1783964934.523040:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9474420ffc00/0xe782b916994fd2b5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964934.523065:0:5827:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff947400030c00/0xe782b916994fd1f8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe782b916994fd1f1 expref: 14 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964934.523074:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9474420ffc00/0xe782b916994fd2b5 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964934.523123:0:5827:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff947400030c00/0xe782b916994fd1f8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe782b916994fd1f1 expref: 14 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964934.523154:0:5827:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff947400030c00/0xe782b916994fd1f8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe782b916994fd1f1 expref: 14 pid: 5805 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783964934.523183:0:5827:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9474368d4000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5827:1870622732854144:0@lo:104: 00000100:00100000:3.0:1783964934.523291:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783964934.523489:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732854144 00000100:00100000:1.0:1783964934.523498:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732854144 00000100:00100000:1.0:1783964934.523562:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783964934.523571:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9474368d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ae0997f7-3a15-4fc6-865a-35b2f101956e+3:5827:x1870622732854144:12345-0@lo:104: 00010000:00010000:1.0:1783964934.523586:0:5796:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.112@tcp lock: ffff947430c10000/0xe782b916994fd1f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe782b916994fd1f8 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964934.523639:0:5796:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783964934.523645:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9474368d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ae0997f7-3a15-4fc6-865a-35b2f101956e+3:5827:x1870622732854144:12345-0@lo:104: Request processed in 75us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1783964934.523652:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:1.0:1783964934.523675:0:5801:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783964934.523681:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.112@tcp lock: ffff947430c10000/0xe782b916994fd1f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe782b916994fd1f8 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964934.523688:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947430c10000 already unused, calling callback (ffffffffc1ca8c20) 10000000:00010000:1.0:1783964934.523692:0:5801:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.112@tcp lock: ffff947430c10000/0xe782b916994fd1f1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe782b916994fd1f8 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964934.523701:0:5801:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.112@tcp lock: ffff947430c10000/0xe782b916994fd1f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe782b916994fd1f8 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783964934.523708:0:5801:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.112@tcp lock: ffff947430c10000/0xe782b916994fd1f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe782b916994fd1f8 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783964934.523726:0:5801:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1783964934.523753:0:5801:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.112@tcp lock: ffff947430c10000/0xe782b916994fd1f1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe782b916994fd1f8 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964934.523760:0:5801:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783964934.523780:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.112@tcp lock: ffff947430c10000/0xe782b916994fd1f1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe782b916994fd1f8 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964934.523788:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.112@tcp lock: ffff947430c10000/0xe782b916994fd1f1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe782b916994fd1f8 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964934.523807:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783964934.523808:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783964934.523810:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783964934.523823:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947436305880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ae0997f7-3a15-4fc6-865a-35b2f101956e:3325:1870622732854272:0@lo:103: 00000100:00100000:1.0:1783964934.523858:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783964934.523888:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732854272 00000100:00100000:1.0:1783964934.523892:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732854272 00010000:00010000:1.0:1783964934.524318:0:5798:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff947400030c00/0xe782b916994fd1f8 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe782b916994fd1f1 expref: 15 pid: 5805 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783964934.524342:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783964934.524416:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94741843c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ae0997f7-3a15-4fc6-865a-35b2f101956e+15:3325:x1870622732854272:12345-0@lo:103: 00010000:00010000:1.0:1783964934.524433:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783964934.524440:0:5798:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff947400030c00/0xe782b916994fd1f8 lrc: 6/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe782b916994fd1f1 expref: 15 pid: 5805 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964934.524458:0:5798:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff947400030c00/0xe782b916994fd1f8 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe782b916994fd1f1 expref: 15 pid: 5805 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964934.524489:0:5798:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9474420ffc00/0xe782b916994fd2b5 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964934.524498:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9474420ffc00/0xe782b916994fd2b5 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1783964934.524517:0:5798:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.005576208s 00000100:00100000:3.0:1783964934.524660:0:5827:0:(client.c:2702:ptlrpc_set_wait()) set ffff947429e5db40 going to sleep for 11 seconds 00010000:00010000:1.0:1783964934.525038:0:5798:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9474420ffc00/0xe782b916994fd2b5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964934.525049:0:5798:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9474420ffc00/0xe782b916994fd2b5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964934.525057:0:5798:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9474420ffc00/0xe782b916994fd2b5 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964934.525066:0:5798:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9474420ffc00/0xe782b916994fd2b5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964934.525074:0:5798:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9474420ffc00 already unused, calling callback (ffffffffc168d230) 00010000:00010000:1.0:1783964934.525080:0:5798:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9474420ffc00/0xe782b916994fd2b5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964934.525090:0:5798:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9474420ffc00/0xe782b916994fd2b5 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964934.525103:0:5798:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9474420ffc00/0xe782b916994fd2b5 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964934.525118:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783964934.525691:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94741843c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ae0997f7-3a15-4fc6-865a-35b2f101956e+15:3325:x1870622732854272:12345-0@lo:103: Request processed in 1336us (1825us total) trans 0 rc 0/0 00000100:00100000:1.0:1783964934.525976:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783964934.526461:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947436305880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ae0997f7-3a15-4fc6-865a-35b2f101956e:3325:1870622732854272:0@lo:103: 00010000:00010000:2.0:1783964934.529389:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff947400030c00/0xe782b916994fd1f8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe782b916994fd1f1 expref: 14 pid: 5805 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783964934.529418:0:5827:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9474368d4000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5827:1870622732854144:0@lo:104: 00010000:00010000:2.0:1783964934.529451:0:5827:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9474420ffc00/0xe782b916994fd2b5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783964934.529463:0:5827:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9474420ffc00/0xe782b916994fd2b5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783964934.529470:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9474420ffc00/0xe782b916994fd2b5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783964934.529478:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9474420ffc00/0xe782b916994fd2b5 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:01000000:2.0:1783964934.569828:0:6630:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1783964934.569862:0:6630:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1783964934.570552:0:6630:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783964934.570753:0:6630:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783964934.570810:0:6630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:2.0:1783964934.570875:0:6630:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:0.0:1783964934.571641:0:6633:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1783964934.571649:0:6633:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1783964934.573464:0:6630:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1783964934.573483:0:6630:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1783964934.573533:0:6630:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1783964934.573563:0:6630:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe782b916994fd2bc 00000100:00080000:2.0:1783964934.573579:0:6630:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1783964934.573588:0:6630:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff947425afd800 using connection 192.168.204.112@tcp/0@lo 00000100:00100000:2.0:1783964934.573639:0:6630:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9474072aa300 x1870622732854400/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783964934.573698:0:6630:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1783964934.573768:0:6630:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783964934.573773:0:6630:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783964934.573776:0:6630:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1783964934.573779:0:6630:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783964934.573785:0:6630:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783964934.573787:0:6630:0:(obd_config.c:1561:class_process_config()) marker 15 (0x1) lustre sys.timeout 00000020:00000080:2.0:1783964934.573792:0:6630:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1783964934.573794:0:6630:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1783964934.573830:0:6630:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9474072ab480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae0997f7-3a15-4fc6-865a-35b2f101956e:6630:1870622732854528:0@lo:502: 00000100:00100000:2.0:1783964934.573973:0:6630:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783964934.574041:0:6630:0:(client.c:2702:ptlrpc_set_wait()) set ffff9473048cc6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783964934.574066:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9474072aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3321:1870622732854400:0@lo:8: 00000100:00100000:2.0:1783964934.574106:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783964934.574610:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732854528 00000100:00100000:2.0:1783964934.574620:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732854528 00000100:00100000:2.0:1783964934.574673:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1783964934.574685:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947405addc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae0997f7-3a15-4fc6-865a-35b2f101956e+14:6630:x1870622732854528:12345-0@lo:502: 00000100:00100000:0.0:1783964934.575380:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732854400 00000100:00100000:0.0:1783964934.575391:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732854400 00000100:00100000:0.0:1783964934.575433:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783964934.575441:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9474072a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3321:x1870622732854400:12345-0@lo:8: 00000100:00100000:0.0:1783964934.575545:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9474072a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3321:x1870622732854400:12345-0@lo:8: Request processed in 103us (1437us total) trans 0 rc -11/-11 00000100:00100000:0.0:1783964934.575553:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783964934.576306:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947405addc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae0997f7-3a15-4fc6-865a-35b2f101956e+14:6630:x1870622732854528:12345-0@lo:502: Request processed in 1603us (2322us total) trans 0 rc 0/0 00000100:00100000:2.0:1783964934.576327:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1783964934.576422:0:3321:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1783964934.576431:0:3321:0:(import.c:65:import_set_state_nolock()) ffff947425afd800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783964934.576436:0:3321:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1783964934.576441:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9474072aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3321:1870622732854400:0@lo:8: 00000100:00100000:3.0:1783964934.578198:0:6630:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9474072ab480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae0997f7-3a15-4fc6-865a-35b2f101956e:6630:1870622732854528:0@lo:502: 00000020:01000000:3.0:1783964934.578280:0:6630:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783964934.578291:0:6630:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783964934.578362:0:6630:0:(obd_config.c:1561:class_process_config()) marker 15 (0x2) lustre sys.timeout 00000040:00080000:3.0:1783964934.578368:0:6630:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:3.0:1783964934.578904:0:5809:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:3.0:1783964934.578954:0:5809:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.112@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1783964934.578967:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.112@tcp lock: ffff9474420fe600/0xe782b916994fd284 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fd28b expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964934.578980:0:5809:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.112@tcp lock: ffff9474420fe600/0xe782b916994fd284 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fd28b expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783964934.578992:0:5809:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1783964934.578995:0:5809:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff947403dc3000 from 1 10000000:01000000:3.0:1783964934.578999:0:5809:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783964934.579042:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.112@tcp lock: ffff9474420ff200/0xe782b916994fd2c3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964934.579051:0:5809:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.112@tcp lock: ffff9474420ff200/0xe782b916994fd2c3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964934.579063:0:5809:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.112@tcp lock: ffff9474420ff200/0xe782b916994fd2c3 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783964934.579103:0:5809:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9474368d4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae0997f7-3a15-4fc6-865a-35b2f101956e:5809:1870622732854656:0@lo:101: 00000100:00100000:3.0:1783964934.579177:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783964934.579272:0:5809:0:(client.c:2702:ptlrpc_set_wait()) set ffff94740734b900 going to sleep for 11 seconds 00000100:00100000:1.0:1783964934.579647:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732854656 00000100:00100000:1.0:1783964934.579661:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732854656 00000100:00100000:1.0:1783964934.579723:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1783964934.579735:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947405a4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae0997f7-3a15-4fc6-865a-35b2f101956e+14:5809:x1870622732854656:12345-0@lo:101: 00010000:00010000:1.0:1783964934.579823:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783964934.579846:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff947401483a00/0xe782b916994fd2ca lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe782b916994fd2c3 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964934.579880:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff947401483a00/0xe782b916994fd2ca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe782b916994fd2c3 expref: 15 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964934.579892:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff947401483a00/0xe782b916994fd2ca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe782b916994fd2c3 expref: 15 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964934.579901:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff947401483a00, rc 0) 00000100:00100000:1.0:1783964934.579989:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947405a4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae0997f7-3a15-4fc6-865a-35b2f101956e+15:5809:x1870622732854656:12345-0@lo:101: Request processed in 257us (812us total) trans 0 rc 0/0 00000100:00100000:1.0:1783964934.579996:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1783964934.580062:0:5809:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9474368d4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae0997f7-3a15-4fc6-865a-35b2f101956e:5809:1870622732854656:0@lo:101: 00010000:00010000:1.0:1783964934.580081:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.112@tcp lock: ffff9474420ff200/0xe782b916994fd2c3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fd2ca expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964934.580093:0:5809:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.112@tcp lock: ffff9474420ff200/0xe782b916994fd2c3 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe782b916994fd2ca expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783964934.580169:0:5809:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947436305880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae0997f7-3a15-4fc6-865a-35b2f101956e:5809:1870622732854784:0@lo:501: 00000100:00100000:1.0:1783964934.580268:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783964934.580299:0:5809:0:(client.c:2702:ptlrpc_set_wait()) set ffff947408caa300 going to sleep for 11 seconds 00000100:00100000:1.0:1783964934.580321:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732854784 00000100:00100000:1.0:1783964934.580326:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732854784 00000100:00100000:1.0:1783964934.580655:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1783964934.580665:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947405a4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae0997f7-3a15-4fc6-865a-35b2f101956e+15:5809:x1870622732854784:12345-0@lo:501: 00000100:00100000:1.0:1783964934.580929:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947405a4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae0997f7-3a15-4fc6-865a-35b2f101956e+15:5809:x1870622732854784:12345-0@lo:501: Request processed in 265us (665us total) trans 0 rc 0/0 00000100:00100000:1.0:1783964934.580948:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1783964934.581014:0:5809:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947436305880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae0997f7-3a15-4fc6-865a-35b2f101956e:5809:1870622732854784:0@lo:501: 00000100:00100000:3.0:1783964934.581187:0:5809:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9474368d4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae0997f7-3a15-4fc6-865a-35b2f101956e:5809:1870622732854912:0@lo:503: 00000100:00100000:3.0:1783964934.581601:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783964934.581647:0:5809:0:(client.c:2702:ptlrpc_set_wait()) set ffff94740734b900 going to sleep for 11 seconds 00000100:00100000:1.0:1783964934.582011:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732854912 00000100:00100000:1.0:1783964934.582022:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732854912 00000100:00100000:1.0:1783964934.582074:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1783964934.582083:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947405a4e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+15:5809:x1870622732854912:12345-0@lo:503: 00000100:00100000:1.0:1783964934.582329:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947405a4e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+15:5809:x1870622732854912:12345-0@lo:503: Request processed in 246us (731us total) trans 0 rc 0/0 00000100:00100000:1.0:1783964934.582336:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1783964934.583944:0:5809:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9474368d4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae0997f7-3a15-4fc6-865a-35b2f101956e:5809:1870622732854912:0@lo:503: 00000100:00100000:0.0:1783964934.585647:0:6635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947436335c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae0997f7-3a15-4fc6-865a-35b2f101956e:6635:1870622732855040:0@lo:502: 00000100:00100000:0.0:1783964934.586434:0:6635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783964934.586491:0:6635:0:(client.c:2702:ptlrpc_set_wait()) set ffff9473048c2480 going to sleep for 11 seconds 00000100:00100000:3.0:1783964934.586693:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732855040 00000100:00100000:3.0:1783964934.586704:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732855040 00000100:00100000:3.0:1783964934.587014:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1783964934.587029:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947405a4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae0997f7-3a15-4fc6-865a-35b2f101956e+15:6635:x1870622732855040:12345-0@lo:502: 00000100:00100000:3.0:1783964934.588013:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947405a4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae0997f7-3a15-4fc6-865a-35b2f101956e+15:6635:x1870622732855040:12345-0@lo:502: Request processed in 985us (1576us total) trans 0 rc 0/0 00000100:00100000:3.0:1783964934.588024:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1783964934.588123:0:6635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947436335c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae0997f7-3a15-4fc6-865a-35b2f101956e:6635:1870622732855040:0@lo:502: 00000020:01000000:3.0:1783964934.588268:0:6635:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783964934.588282:0:6635:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783964934.588285:0:6635:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1783964934.588293:0:6635:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff947403dc3000 00000020:00000080:3.0:1783964934.588296:0:6635:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1783964934.589145:0:6635:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9474368d4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae0997f7-3a15-4fc6-865a-35b2f101956e:6635:1870622732855168:0@lo:502: 00000100:00100000:3.0:1783964934.589728:0:6635:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783964934.589791:0:6635:0:(client.c:2702:ptlrpc_set_wait()) set ffff947429e5de40 going to sleep for 11 seconds 00000100:00100000:2.0:1783964934.589845:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732855168 00000100:00100000:2.0:1783964934.589854:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732855168 00000100:00100000:2.0:1783964934.589926:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1783964934.589947:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947405a4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+15:6635:x1870622732855168:12345-0@lo:502: 00000100:00100000:2.0:1783964934.590235:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947405a4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+15:6635:x1870622732855168:12345-0@lo:502: Request processed in 290us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1783964934.590243:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1783964934.590314:0:6635:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9474368d4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae0997f7-3a15-4fc6-865a-35b2f101956e:6635:1870622732855168:0@lo:502: 00000020:01000000:3.0:1783964934.590425:0:6635:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783964934.590438:0:6635:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783964934.590441:0:6635:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:3.0:1783964934.590447:0:6635:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:0.0:1783964934.590829:0:5809:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1783964934.590859:0:5809:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783964934.590873:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.112@tcp lock: ffff9474420ff200/0xe782b916994fd2c3 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fd2ca expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964934.590887:0:5809:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.112@tcp lock: ffff9474420ff200/0xe782b916994fd2c3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fd2ca expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783964934.590898:0:5809:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1783964934.590901:0:5809:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff947407224d40 from 1 10000000:01000000:0.0:1783964934.590905:0:5809:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1783964934.590959:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.112@tcp lock: ffff947400030000/0xe782b916994fd2d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964934.590980:0:5809:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.112@tcp lock: ffff947400030000/0xe782b916994fd2d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964934.590992:0:5809:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.112@tcp lock: ffff947400030000/0xe782b916994fd2d1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783964934.591014:0:5809:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947436335880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae0997f7-3a15-4fc6-865a-35b2f101956e:5809:1870622732855296:0@lo:101: 00000100:00100000:0.0:1783964934.591061:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783964934.591097:0:5809:0:(client.c:2702:ptlrpc_set_wait()) set ffff9473048c2f00 going to sleep for 11 seconds 00000100:00100000:3.0:1783964934.591520:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732855296 00000100:00100000:3.0:1783964934.591527:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732855296 00000100:00100000:3.0:1783964934.591582:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1783964934.591593:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947405a4e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae0997f7-3a15-4fc6-865a-35b2f101956e+15:5809:x1870622732855296:12345-0@lo:101: 00010000:00010000:3.0:1783964934.591608:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783964934.591960:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9474420fea00/0xe782b916994fd2d8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xe782b916994fd2d1 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964934.591995:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9474420fea00/0xe782b916994fd2d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe782b916994fd2d1 expref: 16 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964934.592008:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9474420fea00/0xe782b916994fd2d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe782b916994fd2d1 expref: 16 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964934.592019:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9474420fea00, rc 0) 00000100:00100000:3.0:1783964934.592097:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947405a4e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae0997f7-3a15-4fc6-865a-35b2f101956e+16:5809:x1870622732855296:12345-0@lo:101: Request processed in 504us (1034us total) trans 0 rc 0/0 00000100:00100000:3.0:1783964934.592104:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1783964934.592979:0:5809:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947436335880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae0997f7-3a15-4fc6-865a-35b2f101956e:5809:1870622732855296:0@lo:101: 00010000:00010000:1.0:1783964934.593003:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.112@tcp lock: ffff947400030000/0xe782b916994fd2d1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fd2d8 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964934.593015:0:5809:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.112@tcp lock: ffff947400030000/0xe782b916994fd2d1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xe782b916994fd2d8 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783964934.593102:0:5809:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947436307b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae0997f7-3a15-4fc6-865a-35b2f101956e:5809:1870622732855424:0@lo:501: 00000100:00100000:1.0:1783964934.593148:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783964934.593595:0:5809:0:(client.c:2702:ptlrpc_set_wait()) set ffff947408caa9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783964934.595629:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732855424 00000100:00100000:3.0:1783964934.595647:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732855424 00000100:00100000:3.0:1783964934.595731:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1783964934.595816:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947405a4c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae0997f7-3a15-4fc6-865a-35b2f101956e+16:5809:x1870622732855424:12345-0@lo:501: 00000100:00100000:3.0:1783964934.596164:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947405a4c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae0997f7-3a15-4fc6-865a-35b2f101956e+16:5809:x1870622732855424:12345-0@lo:501: Request processed in 422us (3013us total) trans 0 rc -2/-2 00000100:00100000:3.0:1783964934.596173:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1783964934.596272:0:5809:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947436307b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae0997f7-3a15-4fc6-865a-35b2f101956e:5809:1870622732855424:0@lo:501: 10000000:01000000:3.0:1783964934.596323:0:5809:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.112@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1783964934.596334:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.112@tcp lock: ffff947400030000/0xe782b916994fd2d1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fd2d8 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964934.596405:0:5809:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.112@tcp lock: ffff947400030000/0xe782b916994fd2d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fd2d8 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783964934.614107:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947405adec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae0997f7-3a15-4fc6-865a-35b2f101956e+15:6605:x1870622732854016:12345-0@lo:253: Request processed in 121510us (121624us total) trans 0 rc 0/0 00000100:00100000:1.0:1783964934.614126:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1783964934.614260:0:6605:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9474368d4a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae0997f7-3a15-4fc6-865a-35b2f101956e:6605:1870622732854016:0@lo:253: 10000000:01000000:2.0:1783964934.614280:0:6605:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1783964934.614284:0:6605:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1783964934.614286:0:6605:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1783964934.614287:0:6605:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1783964934.614289:0:6605:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1783964934.614290:0:6605:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1783964934.614291:0:6605:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1783964934.614293:0:6605:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1783964934.614294:0:6605:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1783964934.614296:0:6605:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1783964934.614298:0:6605:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1783964934.614299:0:6605:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1783964934.614318:0:6605:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1783964934.620769:0:6605:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1783964934.621040:0:6605:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1783964934.621809:0:6605:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1783964934.622041:0:6605:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1783964934.622482:0:6605:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1783964934.622853:0:6605:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1783964934.625161:0:6605:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:1.0:1783964934.827754:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1783964934.853361:0:6605:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1783964934.853372:0:6605:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1783964934.853415:0:6605:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1783964934.853496:0:6605:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.112@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1783964934.853520:0:6605:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1783964934.853559:0:6605:0:(super25.c:181:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:1.0:1783964935.851585:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783964936.876703:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783964937.900479:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783964938.923461:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1783964939.824691:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783964939.824701:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1783964939.824705:0:38:0:(import.c:65:import_set_state_nolock()) ffff947425afd800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783964939.824717:0:38:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff947425afd800 using connection 192.168.204.112@tcp/0@lo 00000100:00100000:1.0:1783964939.824739:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff947436304a80 x1870622732855936/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783964939.824804:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947436305c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ae0997f7-3a15-4fc6-865a-35b2f101956e:3322:1870622732855552:0@lo:400: 00000100:00100000:1.0:1783964939.824946:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783964939.824960:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947436304700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3323:1870622732855680:0@lo:400: 00000100:00100000:1.0:1783964939.825011:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947436306d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3324:1870622732855808:0@lo:400: 00000100:00100000:1.0:1783964939.825043:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783964939.825075:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947436304a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3321:1870622732855936:0@lo:8: 00000100:00100000:1.0:1783964939.825106:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783964939.825149:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732855552 00000100:00100000:1.0:1783964939.825157:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732855552 00000100:00100000:1.0:1783964939.825216:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1783964939.825226:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947405a4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae0997f7-3a15-4fc6-865a-35b2f101956e+15:3322:x1870622732855552:12345-0@lo:400: 00000100:00100000:1.0:1783964939.825276:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947405a4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae0997f7-3a15-4fc6-865a-35b2f101956e+15:3322:x1870622732855552:12345-0@lo:400: Request processed in 51us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1783964939.825283:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1783964939.825316:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732855808 00000100:00100000:1.0:1783964939.825329:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732855808 00000100:00100000:1.0:1783964939.825372:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783964939.825378:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436304000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3324:x1870622732855808:12345-0@lo:400: 00000100:00100000:1.0:1783964939.825414:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436304000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3324:x1870622732855808:12345-0@lo:400: Request processed in 36us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1783964939.825419:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783964939.825444:0:6609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732855936 00000100:00100000:1.0:1783964939.825448:0:6609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732855936 00000100:00100000:1.0:1783964939.825469:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783964939.825474:0:6609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436305f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:3321:x1870622732855936:12345-0@lo:8: 00000100:00100000:3.0:1783964939.825483:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1783964939.825497:0:6609:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 174 last 0 00000020:00000080:1.0:1783964939.825527:0:6609:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe782b916994fd2df 00000100:00100000:3.0:1783964939.825568:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732855680 00002000:00100000:1.0:1783964939.825571:0:6609:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff94743e4ce800 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136a2 ocd_grant: 0 ocd_index: 0 ocd_group 0 00000100:00100000:3.0:1783964939.825573:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732855680 00002000:00080000:1.0:1783964939.825579:0:6609:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:1.0:1783964939.825583:0:6609:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:3.0:1783964939.825602:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783964939.825610:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9474368d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3323:x1870622732855680:12345-0@lo:400: 00000100:00100000:3.0:1783964939.825654:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9474368d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3323:x1870622732855680:12345-0@lo:400: Request processed in 45us (172us total) trans 0 rc 0/0 00000100:00100000:3.0:1783964939.825662:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1783964939.825705:0:3323:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff947436304700 x1870622732855680/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783964955 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783964939.825720:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947436304700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3323:1870622732855680:0@lo:400: 00002000:00100000:1.0:1783964939.825723:0:6609:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00080000:3.0:1783964939.826399:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783964939.826873:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947436305c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ae0997f7-3a15-4fc6-865a-35b2f101956e:3322:1870622732855552:0@lo:400: 00010000:00080000:1.0:1783964939.828046:0:3324:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff947436306d80 x1870622732855808/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783964955 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783964939.828062:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947436306d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3324:1870622732855808:0@lo:400: 00002000:00080000:1.0:1783964939.828263:0:6609:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1783964939.828299:0:6609:0:(import.c:65:import_set_state_nolock()) ffff94743e4cc800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783964939.828378:0:6609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436305f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3321:x1870622732855936:12345-0@lo:8: Request processed in 2902us (3270us total) trans 0 rc 0/0 00000100:00100000:1.0:1783964939.828387:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1783964939.828427:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff947436304a80 x1870622732855936/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783964949 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1783964939.828454:0:3321:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1783964939.828463:0:3321:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1783964939.828467:0:3321:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1783964939.828470:0:3321:0:(import.c:65:import_set_state_nolock()) ffff947425afd800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1783964939.828491:0:3321:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1783964939.828496:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947436304a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3321:1870622732855936:0@lo:8: 00000004:00080000:0.0:1783964939.828992:0:6633:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1783964939.829970:0:6633:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 174058766868ns, next at 0ns, rc = 0 00000100:00100000:1.0:1783964939.891237:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9474072aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3325:1870622732856064:0@lo:13: 00000100:00100000:1.0:1783964939.891320:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1783964939.891405:0:6634:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:2.0:1783964939.891431:0:6634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9474072a9180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6634:1870622732856192:0@lo:7: 00000100:00100000:2.0:1783964939.891465:0:6634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783964939.891484:0:6634:0:(client.c:2702:ptlrpc_set_wait()) set ffff9474028e9780 going to sleep for 11 seconds 00000004:00080000:2.0:1783964939.891500:0:5835:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:2.0:1783964939.891547:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732856192 00000100:00100000:2.0:1783964939.891553:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732856192 00000100:00100000:2.0:1783964939.891605:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783964939.891613:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9474072ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6634:x1870622732856192:12345-0@lo:7: 00000100:00100000:1.0:1783964939.895127:0:6610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732856064 00000100:00100000:1.0:1783964939.895140:0:6610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732856064 00000100:00100000:1.0:1783964939.895197:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783964939.895222:0:6610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436304a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3325:x1870622732856064:12345-0@lo:13: 00002000:00000024:1.0:1783964939.895360:0:6610:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:1.0:1783964939.895452:0:6610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436304a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3325:x1870622732856064:12345-0@lo:13: Request processed in 233us (4132us total) trans 0 rc 0/0 00000100:00100000:1.0:1783964939.895460:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1783964939.895539:0:3325:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9474072aa300 x1870622732856064/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783964955 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783964939.895560:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9474072aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3325:1870622732856064:0@lo:13: 00000100:00080000:3.0:1783964939.896274:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:1.0:1783964939.898009:0:6608:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:1.0:1783964939.898018:0:6608:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:1.0:1783964939.898409:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9474072ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6634:x1870622732856192:12345-0@lo:7: Request processed in 6792us (6938us total) trans 0 rc 0/0 00000100:00100000:1.0:1783964939.898420:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1783964939.898660:0:6634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9474072a9180 x1870622732856192/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1783964955 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783964939.898677:0:6634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9474072a9180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6634:1870622732856192:0@lo:7: 00000004:00080000:3.0:1783964939.898693:0:6634:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:3.0:1783964939.898733:0:6634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9474368d6300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6634:1870622732856320:0@lo:5: 00000100:00100000:3.0:1783964939.898769:0:6634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783964939.898947:0:6634:0:(client.c:2702:ptlrpc_set_wait()) set ffff94743fa8b840 going to sleep for 11 seconds 00000100:00100000:1.0:1783964939.899018:0:6609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732856320 00000100:00100000:1.0:1783964939.899025:0:6609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732856320 00000100:00100000:1.0:1783964939.899073:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783964939.899081:0:6609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9474368d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6634:x1870622732856320:12345-0@lo:5: 00002000:00080000:1.0:1783964939.899109:0:6609:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1783964939.899119:0:6609:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:1.0:1783964939.899580:0:6609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9474368d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:6634:x1870622732856320:12345-0@lo:5: Request processed in 499us (809us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1783964939.899588:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1783964939.899659:0:6634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9474368d6300 x1870622732856320/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783964955 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783964939.899671:0:6634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9474368d6300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6634:1870622732856320:0@lo:5: 00000004:00080000:3.0:1783964939.899680:0:6634:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:3.0:1783964939.899707:0:6634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9474368d5c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6634:1870622732856448:0@lo:700: 00000100:00100000:3.0:1783964939.899732:0:6634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783964939.899796:0:6634:0:(client.c:2702:ptlrpc_set_wait()) set ffff94743fa8b840 going to sleep for 11 seconds 00000100:00100000:1.0:1783964939.899856:0:6615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732856448 00000100:00100000:1.0:1783964939.899861:0:6615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732856448 00000100:00100000:1.0:1783964939.899894:0:6615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783964939.899900:0:6615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9474368d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6634:x1870622732856448:12345-0@lo:700: 00000100:00100000:1.0:1783964939.899929:0:6615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947436306d80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6615:1870622732856576:0@lo:700: 00000100:00100000:1.0:1783964939.899957:0:6615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783964939.899975:0:6615:0:(client.c:2702:ptlrpc_set_wait()) set ffff947429fbc600 going to sleep for 11 seconds 00000100:00100000:1.0:1783964939.899993:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732856576 00000100:00100000:1.0:1783964939.899996:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732856576 00000100:00100000:1.0:1783964939.900022:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783964939.900028:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436304380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6615:x1870622732856576:12345-0@lo:700: 40000000:02000000:1.0:1783964939.922227:0:5818:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:1.0:1783964939.929444:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436304380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6615:x1870622732856576:12345-0@lo:700: Request processed in 29406us (29475us total) trans 0 rc 0/0 00000100:00100000:1.0:1783964939.929457:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1783964939.929638:0:6615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff947436306d80 x1870622732856576/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1783964955 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783964939.929653:0:6615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947436306d80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6615:1870622732856576:0@lo:700: 40000000:02000000:3.0:1783964939.929666:0:6615:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00010000:00010000:3.0:1783964939.958853:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1783964940.001985:0:6637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:3.0:1783964940.002011:0:6637:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:0.0:1783964940.002163:0:6615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9474368d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:6634:x1870622732856448:12345-0@lo:700: Request processed in 102257us (102424us total) trans 0 rc 0/0 00000100:00100000:0.0:1783964940.002186:0:6615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1783964940.002309:0:6634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9474368d5c00 x1870622732856448/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1783964955 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783964940.002322:0:6634:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1783964940.002352:0:6634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9474368d5c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6634:1870622732856448:0@lo:700: 00000004:02000040:3.0:1783964940.030458:0:6634:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:2.0:1783964940.037982:0:6634:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9474072a8700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6634:1870622732856704:0@lo:5: 00000100:00100000:2.0:1783964940.038060:0:6634:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783964940.038126:0:6634:0:(client.c:2702:ptlrpc_set_wait()) set ffff94743fa8bf00 going to sleep for 11 seconds 00000100:00100000:0.0:1783964940.038381:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732856704 00000100:00100000:0.0:1783964940.038390:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732856704 00000100:00100000:0.0:1783964940.038449:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1783964940.038459:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9474072a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:6634:x1870622732856704:12345-0@lo:5: 00002000:00080000:0.0:1783964940.051614:0:6608:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:0.0:1783964940.051636:0:6608:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:1.0:1783964940.056239:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9474072a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:6634:x1870622732856704:12345-0@lo:5: Request processed in 17775us (18172us total) trans 4294967298 rc 0/0 00010000:00080000:0.0:1783964940.056293:0:6634:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9474072a8700 x1870622732856704/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783964956 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783964940.056312:0:6634:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9474072a8700 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6634:1870622732856704:0@lo:5: 00000004:00080000:0.0:1783964940.056338:0:6634:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00000100:00100000:1.0:1783964940.057429:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000001:02000400:1.0:1783964940.314296:0:6979:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg412-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1783964940.973313:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783964941.995383:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783964943.020295:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783964944.050462:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1783964944.427446:0:5809:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1783964944.427457:0:5809:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff947403dc3000 from 4 10000000:01000000:3.0:1783964944.427462:0:5809:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1783964944.427526:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.112@tcp lock: ffff9474420fee00/0xe782b916994fd2e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964944.427539:0:5809:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.112@tcp lock: ffff9474420fee00/0xe782b916994fd2e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964944.427552:0:5809:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.112@tcp lock: ffff9474420fee00/0xe782b916994fd2e6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783964944.427581:0:5809:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9474368d5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae0997f7-3a15-4fc6-865a-35b2f101956e:5809:1870622732856832:0@lo:101: 00000100:00100000:3.0:1783964944.427664:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783964944.427800:0:5809:0:(client.c:2702:ptlrpc_set_wait()) set ffff9474059ffe40 going to sleep for 11 seconds 00000100:00100000:1.0:1783964944.427942:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732856832 00000100:00100000:1.0:1783964944.427951:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732856832 00000100:00100000:1.0:1783964944.428008:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1783964944.428018:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947405a4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae0997f7-3a15-4fc6-865a-35b2f101956e+15:5809:x1870622732856832:12345-0@lo:101: 00010000:00010000:1.0:1783964944.428050:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783964944.428064:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff947401483000/0xe782b916994fd2ed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe782b916994fd2e6 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964944.428089:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff947401483000/0xe782b916994fd2ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe782b916994fd2e6 expref: 16 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964944.428100:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff947401483000/0xe782b916994fd2ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe782b916994fd2e6 expref: 16 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964944.428109:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff947401483000, rc 0) 00000100:00100000:1.0:1783964944.428150:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947405a4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae0997f7-3a15-4fc6-865a-35b2f101956e+16:5809:x1870622732856832:12345-0@lo:101: Request processed in 134us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1783964944.428157:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1783964944.431367:0:5809:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9474368d5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae0997f7-3a15-4fc6-865a-35b2f101956e:5809:1870622732856832:0@lo:101: 00010000:00010000:2.0:1783964944.431399:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.112@tcp lock: ffff9474420fee00/0xe782b916994fd2e6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fd2ed expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783964944.431870:0:5809:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.112@tcp lock: ffff9474420fee00/0xe782b916994fd2e6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe782b916994fd2ed expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783964944.431967:0:5809:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9474072ab800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae0997f7-3a15-4fc6-865a-35b2f101956e:5809:1870622732856960:0@lo:256: 00000100:00100000:2.0:1783964944.432045:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783964944.432103:0:5809:0:(client.c:2702:ptlrpc_set_wait()) set ffff94741cede6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783964944.432704:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732856960 00000100:00100000:1.0:1783964944.432798:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732856960 00000100:00100000:1.0:1783964944.432856:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1783964944.432866:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94740951d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+16:5809:x1870622732856960:12345-0@lo:256: 20000000:01000000:1.0:1783964944.432891:0:5805:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1783964944.432914:0:5805:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1783964944.432918:0:5805:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:1.0:1783964944.433024:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94740951d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+16:5809:x1870622732856960:12345-0@lo:256: Request processed in 158us (977us total) trans 0 rc 0/0 00000100:00100000:1.0:1783964944.433032:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1783964944.433487:0:5809:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9474072ab800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae0997f7-3a15-4fc6-865a-35b2f101956e:5809:1870622732856960:0@lo:256: 10000000:01000000:2.0:1783964944.433558:0:5809:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.112@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1783964944.433568:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.112@tcp lock: ffff9474420fee00/0xe782b916994fd2e6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fd2ed expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783964944.433579:0:5809:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.112@tcp lock: ffff9474420fee00/0xe782b916994fd2e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fd2ed expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783964944.726132:0:6637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00000100:00100000:1.0:1783964944.940408:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947436335f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ae0997f7-3a15-4fc6-865a-35b2f101956e:3322:1870622732857088:0@lo:400: 00000100:00100000:1.0:1783964944.940505:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783964944.940569:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947436334380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3323:1870622732857216:0@lo:400: 00000100:00100000:0.0:1783964944.940607:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783964944.940644:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732857216 00000100:00100000:2.0:1783964944.940654:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732857216 00000100:00100000:0.0:1783964944.940682:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947436336680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3324:1870622732857344:0@lo:400: 00000100:00100000:2.0:1783964944.940713:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783964944.940723:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436337800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3323:x1870622732857216:12345-0@lo:400: 00000100:00100000:0.0:1783964944.940741:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783964944.940789:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732857344 00000100:00100000:0.0:1783964944.940794:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732857344 00000100:00100000:2.0:1783964944.940803:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436337800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3323:x1870622732857216:12345-0@lo:400: Request processed in 81us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1783964944.940820:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1783964944.940840:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783964944.940849:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436335880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3324:x1870622732857344:12345-0@lo:400: 00000100:00100000:0.0:1783964944.940893:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436335880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3324:x1870622732857344:12345-0@lo:400: Request processed in 46us (161us total) trans 0 rc 0/0 00000100:00100000:0.0:1783964944.940900:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1783964944.940918:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1783964944.940967:0:3324:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff947436336680 x1870622732857344/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783964960 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783964944.940984:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947436336680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3324:1870622732857344:0@lo:400: 00000100:00100000:1.0:1783964944.941002:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732857088 00000100:00100000:1.0:1783964944.941007:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732857088 00000100:00100000:1.0:1783964944.941050:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1783964944.941056:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94740951e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae0997f7-3a15-4fc6-865a-35b2f101956e+16:3322:x1870622732857088:12345-0@lo:400: 00000100:00100000:1.0:1783964944.941091:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94740951e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae0997f7-3a15-4fc6-865a-35b2f101956e+16:3322:x1870622732857088:12345-0@lo:400: Request processed in 35us (586us total) trans 0 rc 0/0 00000100:00100000:1.0:1783964944.941097:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1783964944.941135:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947436335f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ae0997f7-3a15-4fc6-865a-35b2f101956e:3322:1870622732857088:0@lo:400: 00000100:00100000:2.0:1783964944.941283:0:3324:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783964944.941292:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9474072ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3324:1870622732857472:0@lo:13: 00000100:00100000:2.0:1783964944.941323:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783964944.941416:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732857472 00000100:00100000:3.0:1783964944.941421:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732857472 00000100:00080000:2.0:1783964944.941463:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1783964944.941775:0:3323:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff947436334380 x1870622732857216/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783964960 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783964944.941786:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947436334380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3323:1870622732857216:0@lo:400: 00000100:00100000:0.0:1783964944.941977:0:3323:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783964944.941986:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947436334e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3323:1870622732857600:0@lo:400: 00000100:00100000:0.0:1783964944.942022:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783964944.942224:0:6609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732857600 00000100:00100000:2.0:1783964944.942229:0:6609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732857600 00000100:00100000:2.0:1783964944.942270:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783964944.942278:0:6609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436334380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3323:x1870622732857600:12345-0@lo:400: 00000100:00100000:2.0:1783964944.942425:0:6609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436334380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3323:x1870622732857600:12345-0@lo:400: Request processed in 147us (400us total) trans 0 rc 0/0 00000100:00100000:2.0:1783964944.942433:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1783964944.942498:0:3323:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff947436334e00 x1870622732857600/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783964960 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783964944.942507:0:3323:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1783964944.942518:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947436334e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3323:1870622732857600:0@lo:400: 00000100:00100000:2.0:1783964944.944144:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783964944.944235:0:6610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9474072a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3324:x1870622732857472:12345-0@lo:13: 00002000:00000024:2.0:1783964944.944277:0:6610:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783964944.944348:0:6610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9474072a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3324:x1870622732857472:12345-0@lo:13: Request processed in 120us (3023us total) trans 0 rc 0/0 00000100:00100000:2.0:1783964944.944354:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1783964944.944627:0:3324:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9474072ab800 x1870622732857472/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783964960 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783964944.944659:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9474072ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3324:1870622732857472:0@lo:13: 00010000:00010000:0.0:1783964945.068416:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783964946.091731:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783964947.120871:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783964948.139535:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783964949.164063:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1783964949.701621:0:7506:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1783964949.701625:0:7506:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:0.0:1783964949.701959:0:7506:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff9474369fb000 00000020:01000004:0.0:1783964949.701985:0:7506:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:0.0:1783964949.701998:0:7506:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:0.0:1783964949.702013:0:7506:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9474259ccd40) 00000020:00000080:0.0:1783964949.702030:0:7506:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1783964949.722405:0:7506:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1783964949.722622:0:7506:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:1.0:1783964949.743267:0:7506:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:1.0:1783964949.748444:0:7506:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1783964949.748478:0:7506:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:1.0:1783964949.748534:0:7506:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1783964949.748562:0:7506:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:1.0:1783964949.748922:0:7506:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1783964949.748934:0:7506:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:1.0:1783964949.748945:0:7506:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xe782b916994fd2fb 00000020:01000004:1.0:1783964949.748953:0:7506:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:1.0:1783964949.748972:0:7506:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.112@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1783964949.748975:0:7506:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.112@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1783964949.748981:0:7506:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1783964949.749010:0:7506:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:1.0:1783964949.749014:0:7506:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.112@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:0.0:1783964949.772581:0:7506:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.112@tcp ctxt 0 is initialized 00000020:01000004:0.0:1783964949.772893:0:7506:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.112@tcp, index=0001, flags=0x20062 00000020:01000004:0.0:1783964949.772898:0:7506:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1783964949.772900:0:7506:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1783964949.772901:0:7506:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783964949.772902:0:7506:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783964949.772903:0:7506:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783964949.772904:0:7506:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783964949.772906:0:7506:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783964949.772907:0:7506:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1783964949.772909:0:7506:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1783964949.772911:0:7506:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783964949.772913:0:7506:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1783964949.772917:0:7506:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:0.0:1783964949.772919:0:7506:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1783964949.772920:0:7506:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1783964949.772921:0:7506:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783964949.772922:0:7506:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783964949.772923:0:7506:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783964949.772924:0:7506:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783964949.772925:0:7506:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783964949.772926:0:7506:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1783964949.772927:0:7506:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1783964949.772928:0:7506:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783964949.772928:0:7506:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1783964949.772957:0:7506:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1783964949.772976:0:7506:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947436334e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae0997f7-3a15-4fc6-865a-35b2f101956e:7506:1870622732857728:0@lo:253: 00000100:00100000:0.0:1783964949.773054:0:7506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783964949.773179:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732857728 00000100:00100000:1.0:1783964949.773187:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732857728 00000100:00100000:0.0:1783964949.773261:0:7506:0:(client.c:2702:ptlrpc_set_wait()) set ffff94743fa8ba80 going to sleep for 11 seconds 00000100:00100000:1.0:1783964949.773272:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1783964949.773280:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94740951c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae0997f7-3a15-4fc6-865a-35b2f101956e+16:7506:x1870622732857728:12345-0@lo:253: 20000000:01000000:1.0:1783964949.773322:0:5807:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1783964949.773326:0:5807:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:1.0:1783964949.773336:0:5807:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:1.0:1783964949.773340:0:5807:0:(mgs_llog.c:3858:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:1.0:1783964949.774655:0:5807:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783964949.774889:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:1.0:1783964949.774905:0:5807:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:1.0:1783964949.774945:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:1.0:1783964949.774953:0:5807:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:1.0:1783964949.774983:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:1.0:1783964949.775031:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:1.0:1783964949.775504:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:1.0:1783964949.775524:0:5807:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.204.112@tcp 20000000:01000000:1.0:1783964949.775526:0:5807:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.112@tcp (null) (null) (null) 00000040:00080000:1.0:1783964949.775558:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:1.0:1783964949.775565:0:5807:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1783964949.775602:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:1.0:1783964949.775609:0:5807:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.204.112@tcp (null) (null) 00000040:00080000:1.0:1783964949.775653:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:1.0:1783964949.775664:0:5807:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1783964949.775710:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:1.0:1783964949.775778:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:2.0:1783964949.776824:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:2.0:1783964949.776847:0:5807:0:(mgs_llog.c:3811:mgs_write_log_osc_to_lov()) add nid 192.168.204.112@tcp 20000000:01000000:2.0:1783964949.776850:0:5807:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.204.112@tcp (null) (null) (null) 00000040:00080000:2.0:1783964949.776996:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:2.0:1783964949.777006:0:5807:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1783964949.777039:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:2.0:1783964949.777046:0:5807:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.204.112@tcp (null) (null) 00000040:00080000:2.0:1783964949.777075:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:2.0:1783964949.777084:0:5807:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:2.0:1783964949.777130:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:2.0:1783964949.777169:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:2.0:1783964949.777185:0:5807:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:2.0:1783964949.777189:0:5807:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:2.0:1783964949.777195:0:5807:0:(mgs_llog.c:5248:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:2.0:1783964949.777197:0:5807:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1783964949.777220:0:5807:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1783964949.777234:0:5807:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1783964949.777237:0:5807:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1783964949.777269:0:5807:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1783964949.777272:0:5807:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1783964949.782982:0:7508:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 14 1->4: lustre sys.timeout 20000000:01000000:0.0:1783964949.783468:0:7508:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 14 2->4: lustre sys.timeout 00000040:00080000:0.0:1783964949.783507:0:7508:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:2.0:1783964949.784440:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:2.0:1783964949.784487:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:2.0:1783964949.784546:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:2.0:1783964949.784574:0:5807:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1783964949.784576:0:5807:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1783964949.785838:0:7509:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 15 1->4: lustre sys.timeout 20000000:01000000:0.0:1783964949.785909:0:7509:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 15 2->4: lustre sys.timeout 00000040:00080000:0.0:1783964949.785967:0:7509:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:2.0:1783964949.788905:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:2.0:1783964949.788961:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:2.0:1783964949.789498:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:2.0:1783964949.789517:0:5807:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1783964949.789520:0:5807:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1783964949.790453:0:7510:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 16 1->4: lustre sys.timeout 20000000:01000000:0.0:1783964949.790515:0:7510:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 16 2->4: lustre sys.timeout 00000040:00080000:0.0:1783964949.790566:0:7510:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:2.0:1783964949.790939:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:2.0:1783964949.790984:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:3.0:1783964949.791458:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:3.0:1783964949.791478:0:5807:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1783964949.791480:0:5807:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:0.0:1783964949.791907:0:7511:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:3.0:1783964949.792563:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:3.0:1783964949.792603:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:3.0:1783964949.792690:0:5807:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 10000000:01000000:3.0:1783964949.792710:0:5807:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1783964949.792732:0:5807:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9474420fe000/0xe782b916994fd302 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964949.792760:0:5807:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff947430c10200/0xe782b916994fd245 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe782b916994fd23e expref: 16 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964949.792770:0:5807:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff947401482a00/0xe782b916994fd26f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe782b916994fd268 expref: 16 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964949.792777:0:5807:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff947400030200/0xe782b916994fd27d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe782b916994fd276 expref: 16 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964949.792784:0:5807:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff947401482200/0xe782b916994fd28b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe782b916994fd284 expref: 16 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964949.792791:0:5807:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9474420fea00/0xe782b916994fd2d8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe782b916994fd2d1 expref: 16 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964949.792799:0:5807:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9474420fe000/0xe782b916994fd302 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964949.792843:0:5807:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9474420fea00/0xe782b916994fd2d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe782b916994fd2d1 expref: 16 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964949.792861:0:5807:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9474420fea00/0xe782b916994fd2d8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe782b916994fd2d1 expref: 16 pid: 5806 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783964949.792878:0:5807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9474368d6300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5807:1870622732857856:0@lo:104: 00000100:00100000:3.0:1783964949.792954:0:5807:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783964949.793192:0:5807:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff947401482200/0xe782b916994fd28b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe782b916994fd284 expref: 16 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964949.793232:0:5807:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff947401482200/0xe782b916994fd28b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe782b916994fd284 expref: 16 pid: 5807 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783964949.793253:0:5807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9474368d5880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5807:1870622732857984:0@lo:104: 00010000:00010000:3.0:1783964949.793283:0:5807:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff947400030200/0xe782b916994fd27d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe782b916994fd276 expref: 16 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964949.793291:0:5807:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff947400030200/0xe782b916994fd27d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe782b916994fd276 expref: 16 pid: 5805 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783964949.793299:0:5807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9474368d7100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5807:1870622732858112:0@lo:104: 00010000:00010000:3.0:1783964949.793324:0:5807:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff947401482a00/0xe782b916994fd26f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe782b916994fd268 expref: 16 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964949.793331:0:5807:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff947401482a00/0xe782b916994fd26f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe782b916994fd268 expref: 16 pid: 5806 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783964949.793339:0:5807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9474368d5180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5807:1870622732858240:0@lo:104: 00010000:00010000:3.0:1783964949.793360:0:5807:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff947430c10200/0xe782b916994fd245 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe782b916994fd23e expref: 16 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964949.793367:0:5807:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff947430c10200/0xe782b916994fd245 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe782b916994fd23e expref: 16 pid: 5805 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783964949.793374:0:5807:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9474368d5500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5807:1870622732858368:0@lo:104: 00000100:00100000:3.0:1783964949.793390:0:5807:0:(client.c:2702:ptlrpc_set_wait()) set ffff9474400a4240 going to sleep for 11 seconds 00000100:00100000:1.0:1783964949.793815:0:5795:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1783964949.793838:0:5795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783964949.793870:0:5795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783964949.793878:0:5795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783964949.793886:0:5795:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783964949.793898:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732857856 00000100:00100000:1.0:1783964949.793904:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732857856 00000100:00100000:1.0:1783964949.793940:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732857984 00000100:00100000:1.0:1783964949.793943:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732857984 00000100:00100000:1.0:1783964949.793954:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732858112 00000100:00100000:1.0:1783964949.793956:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732858112 00000100:00100000:1.0:1783964949.793966:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732858240 00000100:00100000:1.0:1783964949.793968:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732858240 00000100:00100000:1.0:1783964949.793989:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732858368 00000100:00100000:1.0:1783964949.793991:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732858368 00000100:00100000:1.0:1783964949.794003:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783964949.794010:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947429ee9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ae0997f7-3a15-4fc6-865a-35b2f101956e+7:5807:x1870622732857856:12345-0@lo:104: 00010000:00010000:1.0:1783964949.794036:0:5795:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.112@tcp lock: ffff947400030000/0xe782b916994fd2d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xe782b916994fd2d8 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964949.794330:0:5795:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783964949.794337:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947429ee9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ae0997f7-3a15-4fc6-865a-35b2f101956e+7:5807:x1870622732857856:12345-0@lo:104: Request processed in 327us (1382us total) trans 0 rc 0/0 00000100:00100000:1.0:1783964949.794345:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783964949.794388:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783964949.794394:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436306680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ae0997f7-3a15-4fc6-865a-35b2f101956e+6:5807:x1870622732857984:12345-0@lo:104: 00010000:00010000:1.0:1783964949.794403:0:5795:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.112@tcp lock: ffff9474420fe600/0xe782b916994fd284 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xe782b916994fd28b expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964949.794437:0:5795:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1783964949.794442:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436306680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ae0997f7-3a15-4fc6-865a-35b2f101956e+6:5807:x1870622732857984:12345-0@lo:104: Request processed in 49us (604us total) trans 0 rc 0/0 00000100:00100000:1.0:1783964949.794448:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783964949.794460:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783964949.794466:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436304e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ae0997f7-3a15-4fc6-865a-35b2f101956e+5:5807:x1870622732858112:12345-0@lo:104: 00010000:00010000:1.0:1783964949.794475:0:5795:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.112@tcp lock: ffff947430c10a00/0xe782b916994fd276 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xe782b916994fd27d expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964949.794500:0:5795:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1783964949.794505:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436304e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ae0997f7-3a15-4fc6-865a-35b2f101956e+5:5807:x1870622732858112:12345-0@lo:104: Request processed in 40us (635us total) trans 0 rc 0/0 00000100:00100000:1.0:1783964949.794521:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783964949.794534:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1783964949.794540:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436307800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ae0997f7-3a15-4fc6-865a-35b2f101956e+4:5807:x1870622732858240:12345-0@lo:104: 00010000:00010000:1.0:1783964949.794547:0:5795:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.112@tcp lock: ffff947430c11400/0xe782b916994fd268 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xe782b916994fd26f expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964949.794575:0:5795:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1783964949.794580:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436307800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ae0997f7-3a15-4fc6-865a-35b2f101956e+4:5807:x1870622732858240:12345-0@lo:104: Request processed in 41us (700us total) trans 0 rc 0/0 00000100:00100000:1.0:1783964949.794585:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1783964949.794595:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1783964949.794601:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436306a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ae0997f7-3a15-4fc6-865a-35b2f101956e+3:5807:x1870622732858368:12345-0@lo:104: 00010000:00010000:1.0:1783964949.794608:0:5795:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.112@tcp lock: ffff947430c10e00/0xe782b916994fd23e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xe782b916994fd245 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964949.794633:0:5795:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:1.0:1783964949.794637:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436306a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ae0997f7-3a15-4fc6-865a-35b2f101956e+3:5807:x1870622732858368:12345-0@lo:104: Request processed in 37us (750us total) trans 0 rc 0/0 00000100:00100000:1.0:1783964949.794655:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:1.0:1783964949.794673:0:5801:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1783964949.794679:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.112@tcp lock: ffff947400030000/0xe782b916994fd2d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xe782b916994fd2d8 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964949.794687:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947400030000 already unused, calling callback (ffffffffc1ca8c20) 10000000:00010000:1.0:1783964949.794691:0:5801:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.112@tcp lock: ffff947400030000/0xe782b916994fd2d1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xe782b916994fd2d8 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964949.794710:0:5801:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.112@tcp lock: ffff947400030000/0xe782b916994fd2d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xe782b916994fd2d8 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783964949.794718:0:5801:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.112@tcp lock: ffff947400030000/0xe782b916994fd2d1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xe782b916994fd2d8 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783964949.794724:0:5801:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783964949.794761:0:5801:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.112@tcp lock: ffff947400030000/0xe782b916994fd2d1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe782b916994fd2d8 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964949.794768:0:5801:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783964949.794788:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.112@tcp lock: ffff947400030000/0xe782b916994fd2d1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe782b916994fd2d8 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964949.794795:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.112@tcp lock: ffff947400030000/0xe782b916994fd2d1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe782b916994fd2d8 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964949.794811:0:5801:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1783964949.794815:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.112@tcp lock: ffff9474420fe600/0xe782b916994fd284 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xe782b916994fd28b expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964949.794820:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9474420fe600 already unused, calling callback (ffffffffc1ca8c20) 10000000:00010000:1.0:1783964949.794823:0:5801:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.112@tcp lock: ffff9474420fe600/0xe782b916994fd284 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xe782b916994fd28b expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964949.794830:0:5801:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.112@tcp lock: ffff9474420fe600/0xe782b916994fd284 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xe782b916994fd28b expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783964949.794836:0:5801:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.112@tcp lock: ffff9474420fe600/0xe782b916994fd284 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xe782b916994fd28b expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783964949.794847:0:5801:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783964949.794861:0:5801:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.112@tcp lock: ffff9474420fe600/0xe782b916994fd284 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe782b916994fd28b expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964949.794867:0:5801:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783964949.794883:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.112@tcp lock: ffff9474420fe600/0xe782b916994fd284 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe782b916994fd28b expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964949.794890:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.112@tcp lock: ffff9474420fe600/0xe782b916994fd284 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe782b916994fd28b expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964949.794901:0:5801:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1783964949.794904:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.112@tcp lock: ffff947430c10a00/0xe782b916994fd276 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe782b916994fd27d expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964949.794909:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947430c10a00 already unused, calling callback (ffffffffc1ca8c20) 10000000:00010000:1.0:1783964949.794912:0:5801:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.112@tcp lock: ffff947430c10a00/0xe782b916994fd276 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xe782b916994fd27d expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964949.794919:0:5801:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.112@tcp lock: ffff947430c10a00/0xe782b916994fd276 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xe782b916994fd27d expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783964949.794925:0:5801:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.112@tcp lock: ffff947430c10a00/0xe782b916994fd276 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xe782b916994fd27d expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783964949.794930:0:5801:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783964949.794940:0:5801:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.112@tcp lock: ffff947430c10a00/0xe782b916994fd276 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe782b916994fd27d expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964949.794946:0:5801:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783964949.794961:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.112@tcp lock: ffff947430c10a00/0xe782b916994fd276 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe782b916994fd27d expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964949.794967:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.112@tcp lock: ffff947430c10a00/0xe782b916994fd276 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe782b916994fd27d expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964949.794976:0:5801:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783964949.794979:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.112@tcp lock: ffff947430c11400/0xe782b916994fd268 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe782b916994fd26f expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964949.794985:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947430c11400 already unused, calling callback (ffffffffc1ca8c20) 10000000:00010000:1.0:1783964949.794988:0:5801:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.112@tcp lock: ffff947430c11400/0xe782b916994fd268 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xe782b916994fd26f expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964949.794995:0:5801:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.112@tcp lock: ffff947430c11400/0xe782b916994fd268 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xe782b916994fd26f expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783964949.795002:0:5801:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.112@tcp lock: ffff947430c11400/0xe782b916994fd268 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xe782b916994fd26f expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783964949.795007:0:5801:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783964949.795034:0:5801:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.112@tcp lock: ffff947430c11400/0xe782b916994fd268 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe782b916994fd26f expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964949.795040:0:5801:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783964949.795045:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.112@tcp lock: ffff947430c11400/0xe782b916994fd268 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe782b916994fd26f expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964949.795052:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.112@tcp lock: ffff947430c11400/0xe782b916994fd268 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe782b916994fd26f expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783964949.795189:0:5807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9474368d6300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5807:1870622732857856:0@lo:104: 00000100:00100000:0.0:1783964949.795223:0:5807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9474368d5880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5807:1870622732857984:0@lo:104: 00000100:00100000:0.0:1783964949.795234:0:5807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9474368d7100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5807:1870622732858112:0@lo:104: 00000100:00100000:0.0:1783964949.795241:0:5807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9474368d5180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5807:1870622732858240:0@lo:104: 00000100:00100000:0.0:1783964949.795248:0:5807:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9474368d5500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5807:1870622732858368:0@lo:104: 00010000:00010000:0.0:1783964949.795273:0:5807:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9474420fe000/0xe782b916994fd302 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964949.795526:0:5801:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783964949.795537:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.112@tcp lock: ffff947430c10e00/0xe782b916994fd23e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe782b916994fd245 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964949.795543:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947430c10e00 already unused, calling callback (ffffffffc1ca8c20) 10000000:00010000:1.0:1783964949.795547:0:5801:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.112@tcp lock: ffff947430c10e00/0xe782b916994fd23e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe782b916994fd245 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964949.795553:0:5801:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.112@tcp lock: ffff947430c10e00/0xe782b916994fd23e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe782b916994fd245 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783964949.795559:0:5801:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.112@tcp lock: ffff947430c10e00/0xe782b916994fd23e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe782b916994fd245 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783964949.795564:0:5801:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783964949.795580:0:5801:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.112@tcp lock: ffff947430c10e00/0xe782b916994fd23e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe782b916994fd245 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964949.795587:0:5801:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783964949.795591:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.112@tcp lock: ffff947430c10e00/0xe782b916994fd23e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe782b916994fd245 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964949.795598:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.112@tcp lock: ffff947430c10e00/0xe782b916994fd23e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe782b916994fd245 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964949.795611:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783964949.795613:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783964949.795615:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783964949.795622:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783964949.796289:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947436305180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ae0997f7-3a15-4fc6-865a-35b2f101956e:3322:1870622732858880:0@lo:103: 00000100:00100000:0.0:1783964949.796340:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783964949.796395:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1783964949.796401:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947436306300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ae0997f7-3a15-4fc6-865a-35b2f101956e:3322:1870622732858496:0@lo:103: 00000100:00100000:0.0:1783964949.796421:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783964949.796439:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947436306d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ae0997f7-3a15-4fc6-865a-35b2f101956e:3322:1870622732859008:0@lo:103: 00000100:00100000:0.0:1783964949.796456:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783964949.796544:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732858880 00000100:00100000:3.0:1783964949.796550:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732858880 00010000:00010000:3.0:1783964949.796581:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff947401482a00/0xe782b916994fd26f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe782b916994fd268 expref: 17 pid: 5806 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783964949.796612:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732858496 00000100:00100000:3.0:1783964949.796616:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732858496 00010000:00010000:3.0:1783964949.796629:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9474420fea00/0xe782b916994fd2d8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe782b916994fd2d1 expref: 18 pid: 5806 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783964949.796640:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732859008 00000100:00100000:3.0:1783964949.796653:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732859008 00010000:00010000:3.0:1783964949.796666:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff947430c10200/0xe782b916994fd245 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe782b916994fd23e expref: 19 pid: 5805 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783964949.796680:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1783964949.796687:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436335c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ae0997f7-3a15-4fc6-865a-35b2f101956e+19:3322:x1870622732858880:12345-0@lo:103: 00010000:00010000:3.0:1783964949.796700:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783964949.796705:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff947401482a00/0xe782b916994fd26f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe782b916994fd268 expref: 19 pid: 5806 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964949.796716:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff947401482a00/0xe782b916994fd26f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe782b916994fd268 expref: 19 pid: 5806 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964949.796732:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff947401482a00/0xe782b916994fd26f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe782b916994fd268 expref: 19 pid: 5806 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964949.796748:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783964949.796793:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436335c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ae0997f7-3a15-4fc6-865a-35b2f101956e+18:3322:x1870622732858880:12345-0@lo:103: Request processed in 106us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1783964949.796800:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1783964949.796815:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1783964949.796822:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436334a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ae0997f7-3a15-4fc6-865a-35b2f101956e+17:3322:x1870622732858496:12345-0@lo:103: 00010000:00010000:3.0:1783964949.796850:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783964949.796855:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9474420fea00/0xe782b916994fd2d8 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe782b916994fd2d1 expref: 17 pid: 5806 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964949.796865:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9474420fea00/0xe782b916994fd2d8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe782b916994fd2d1 expref: 17 pid: 5806 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964949.796875:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9474420fea00/0xe782b916994fd2d8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe782b916994fd2d1 expref: 17 pid: 5806 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964949.796886:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783964949.796922:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436334a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ae0997f7-3a15-4fc6-865a-35b2f101956e+16:3322:x1870622732858496:12345-0@lo:103: Request processed in 88us (487us total) trans 0 rc 0/0 00000100:00100000:3.0:1783964949.796929:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1783964949.796941:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1783964949.796952:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436335180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ae0997f7-3a15-4fc6-865a-35b2f101956e+15:3322:x1870622732859008:12345-0@lo:103: 00010000:00010000:3.0:1783964949.796960:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783964949.796965:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff947430c10200/0xe782b916994fd245 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe782b916994fd23e expref: 15 pid: 5805 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964949.796974:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff947430c10200/0xe782b916994fd245 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe782b916994fd23e expref: 15 pid: 5805 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964949.796985:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff947430c10200/0xe782b916994fd245 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe782b916994fd23e expref: 15 pid: 5805 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964949.796997:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783964949.797102:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947436307480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ae0997f7-3a15-4fc6-865a-35b2f101956e:3324:1870622732858624:0@lo:103: 00000100:00100000:0.0:1783964949.797620:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947436306300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ae0997f7-3a15-4fc6-865a-35b2f101956e:3322:1870622732858496:0@lo:103: 00000100:00100000:0.0:1783964949.797635:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947436306d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ae0997f7-3a15-4fc6-865a-35b2f101956e:3322:1870622732859008:0@lo:103: 00000100:00100000:0.0:1783964949.797657:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947436305180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ae0997f7-3a15-4fc6-865a-35b2f101956e:3322:1870622732858880:0@lo:103: 00000100:00100000:0.0:1783964949.798487:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947436305500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ae0997f7-3a15-4fc6-865a-35b2f101956e:3325:1870622732858752:0@lo:103: 00000100:00100000:3.0:1783964949.800193:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436335180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ae0997f7-3a15-4fc6-865a-35b2f101956e+14:3322:x1870622732859008:12345-0@lo:103: Request processed in 3236us (3725us total) trans 0 rc 0/0 00000100:00100000:3.0:1783964949.800226:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783964949.800382:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783964949.800454:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732858624 00000100:00100000:2.0:1783964949.800463:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732858624 00010000:00010000:2.0:1783964949.800498:0:5798:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff947401482200/0xe782b916994fd28b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe782b916994fd284 expref: 14 pid: 5807 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783964949.800533:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783964949.800542:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436305c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ae0997f7-3a15-4fc6-865a-35b2f101956e+14:3324:x1870622732858624:12345-0@lo:103: 00010000:00010000:2.0:1783964949.800556:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783964949.800562:0:5798:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff947401482200/0xe782b916994fd28b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe782b916994fd284 expref: 14 pid: 5807 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783964949.800574:0:5798:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff947401482200/0xe782b916994fd28b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe782b916994fd284 expref: 14 pid: 5807 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783964949.800590:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff947401482200/0xe782b916994fd28b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe782b916994fd284 expref: 14 pid: 5807 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783964949.800605:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783964949.800663:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436305c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ae0997f7-3a15-4fc6-865a-35b2f101956e+13:3324:x1870622732858624:12345-0@lo:103: Request processed in 122us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1783964949.800671:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1783964949.800698:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947436307480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ae0997f7-3a15-4fc6-865a-35b2f101956e:3324:1870622732858624:0@lo:103: 00000100:00100000:0.0:1783964949.802122:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783964949.802482:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732858752 00000100:00100000:1.0:1783964949.802489:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732858752 00010000:00010000:1.0:1783964949.802518:0:5799:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff947400030200/0xe782b916994fd27d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe782b916994fd276 expref: 13 pid: 5805 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783964949.802551:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1783964949.802559:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436335500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ae0997f7-3a15-4fc6-865a-35b2f101956e+13:3325:x1870622732858752:12345-0@lo:103: 00010000:00010000:1.0:1783964949.802572:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783964949.802576:0:5799:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff947400030200/0xe782b916994fd27d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe782b916994fd276 expref: 13 pid: 5805 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964949.802593:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff947400030200/0xe782b916994fd27d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe782b916994fd276 expref: 13 pid: 5805 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964949.802609:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff947400030200/0xe782b916994fd27d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe782b916994fd276 expref: 13 pid: 5805 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964949.802624:0:5799:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9474420fe000/0xe782b916994fd302 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964949.802632:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9474420fe000/0xe782b916994fd302 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964949.802655:0:5799:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9474420fe000/0xe782b916994fd302 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964949.802663:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9474420fe000/0xe782b916994fd302 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964949.802671:0:5799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9474420fe000/0xe782b916994fd302 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964949.802693:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9474420fe000/0xe782b916994fd302 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964949.802699:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9474420fe000 already unused, calling callback (ffffffffc168d230) 00010000:00010000:1.0:1783964949.802703:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9474420fe000/0xe782b916994fd302 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964949.802711:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9474420fe000/0xe782b916994fd302 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964949.802737:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9474420fe000/0xe782b916994fd302 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964949.802749:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783964949.802797:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436335500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ae0997f7-3a15-4fc6-865a-35b2f101956e+12:3325:x1870622732858752:12345-0@lo:103: Request processed in 239us (680us total) trans 0 rc 0/0 00000100:00100000:1.0:1783964949.802819:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1783964949.802864:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947436305500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ae0997f7-3a15-4fc6-865a-35b2f101956e:3325:1870622732858752:0@lo:103: 00010000:00010000:2.0:1783964949.803290:0:5807:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9474420fe000/0xe782b916994fd302 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783964949.803308:0:5807:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9474420fe000/0xe782b916994fd302 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783964949.803314:0:5807:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9474420fe000/0xe782b916994fd302 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1783964949.803329:0:5807:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1783964949.864743:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94740951c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae0997f7-3a15-4fc6-865a-35b2f101956e+11:7506:x1870622732857728:12345-0@lo:253: Request processed in 91453us (91678us total) trans 0 rc 0/0 00000100:00100000:2.0:1783964949.864758:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1783964949.865139:0:7506:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947436334e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae0997f7-3a15-4fc6-865a-35b2f101956e:7506:1870622732857728:0@lo:253: 10000000:01000000:0.0:1783964949.865156:0:7506:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1783964949.865159:0:7506:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1783964949.865161:0:7506:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1783964949.865162:0:7506:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783964949.865163:0:7506:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:0.0:1783964949.865165:0:7506:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783964949.865167:0:7506:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783964949.865168:0:7506:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783964949.865170:0:7506:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1783964949.865172:0:7506:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783964949.865173:0:7506:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1783964949.865224:0:7506:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9474369fb000 from lustre-OST0001 10000000:01000000:0.0:1783964949.865252:0:7506:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1783964949.865255:0:7506:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1783964949.865264:0:7506:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff947407224d40 local copy 10000000:01000000:0.0:1783964949.865268:0:7506:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1783964949.865306:0:7506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.112@tcp lock: ffff947400031600/0xe782b916994fd309 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964949.865319:0:7506:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.204.112@tcp lock: ffff947400031600/0xe782b916994fd309 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964949.865328:0:7506:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.112@tcp lock: ffff947400031600/0xe782b916994fd309 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783964949.865365:0:7506:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947436334e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae0997f7-3a15-4fc6-865a-35b2f101956e:7506:1870622732859136:0@lo:101: 00000100:00100000:0.0:1783964949.865407:0:7506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783964949.865548:0:7506:0:(client.c:2702:ptlrpc_set_wait()) set ffff94743fa8b300 going to sleep for 11 seconds 00000100:00100000:1.0:1783964949.865596:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732859136 00000100:00100000:1.0:1783964949.865603:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732859136 00000100:00100000:1.0:1783964949.865654:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1783964949.865663:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94740951c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+11:7506:x1870622732859136:12345-0@lo:101: 00010000:00010000:1.0:1783964949.865676:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783964949.865690:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff947401483600/0xe782b916994fd310 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe782b916994fd309 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964949.865714:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff947401483600/0xe782b916994fd310 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe782b916994fd309 expref: 12 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964949.865736:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff947401483600/0xe782b916994fd310 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe782b916994fd309 expref: 12 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964949.865746:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff947401483600, rc 0) 00000100:00100000:1.0:1783964949.865793:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94740951c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+12:7506:x1870622732859136:12345-0@lo:101: Request processed in 131us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1783964949.865799:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1783964949.865943:0:7506:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947436334e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae0997f7-3a15-4fc6-865a-35b2f101956e:7506:1870622732859136:0@lo:101: 00010000:00010000:0.0:1783964949.865959:0:7506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.112@tcp lock: ffff947400031600/0xe782b916994fd309 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0xe782b916994fd310 expref: -99 pid: 7506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964949.865969:0:7506:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.112@tcp lock: ffff947400031600/0xe782b916994fd309 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xe782b916994fd310 expref: -99 pid: 7506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783964949.866091:0:7506:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947436334e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae0997f7-3a15-4fc6-865a-35b2f101956e:7506:1870622732859264:0@lo:501: 00000100:00100000:0.0:1783964949.866121:0:7506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783964949.866134:0:7506:0:(client.c:2702:ptlrpc_set_wait()) set ffff94743fa8b300 going to sleep for 11 seconds 00000100:00100000:3.0:1783964949.866341:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732859264 00000100:00100000:3.0:1783964949.866346:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732859264 00000100:00100000:3.0:1783964949.866382:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1783964949.866390:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94740951ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae0997f7-3a15-4fc6-865a-35b2f101956e+12:7506:x1870622732859264:12345-0@lo:501: 00000100:00100000:3.0:1783964949.866606:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94740951ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae0997f7-3a15-4fc6-865a-35b2f101956e+12:7506:x1870622732859264:12345-0@lo:501: Request processed in 216us (483us total) trans 0 rc -2/-2 00000100:00100000:3.0:1783964949.866613:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1783964949.866735:0:7506:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947436334e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae0997f7-3a15-4fc6-865a-35b2f101956e:7506:1870622732859264:0@lo:501: 10000000:01000000:0.0:1783964949.866750:0:7506:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.112@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1783964949.866777:0:7506:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.112@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1783964949.866782:0:7506:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.112@tcp lock: ffff947400031600/0xe782b916994fd309 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0xe782b916994fd310 expref: -99 pid: 7506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964949.866791:0:7506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.112@tcp lock: ffff947400031600/0xe782b916994fd309 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xe782b916994fd310 expref: -99 pid: 7506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964949.866799:0:7506:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.112@tcp lock: ffff947400031600/0xe782b916994fd309 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0xe782b916994fd310 expref: -99 pid: 7506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964949.866819:0:7506:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1783964949.866919:0:7506:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9474369fb000 10000000:01000000:0.0:1783964949.866925:0:7506:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1783964949.866930:0:7506:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1783964949.866932:0:7506:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1783964949.866937:0:7506:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1783964949.866939:0:7506:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1783964949.866956:0:7506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.112@tcp lock: ffff947400030a00/0xe782b916994fd317 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964949.866964:0:7506:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.112@tcp lock: ffff947400030a00/0xe782b916994fd317 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964949.866972:0:7506:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.112@tcp lock: ffff947400030a00/0xe782b916994fd317 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783964949.866983:0:7506:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947436334e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae0997f7-3a15-4fc6-865a-35b2f101956e:7506:1870622732859392:0@lo:101: 00000100:00100000:0.0:1783964949.867007:0:7506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783964949.867170:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732859392 00000100:00100000:3.0:1783964949.867174:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732859392 00000100:00100000:3.0:1783964949.867217:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1783964949.867224:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94740951dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae0997f7-3a15-4fc6-865a-35b2f101956e+12:7506:x1870622732859392:12345-0@lo:101: 00010000:00010000:3.0:1783964949.867232:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783964949.867241:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9474420fea00/0xe782b916994fd31e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe782b916994fd317 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964949.867256:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9474420fea00/0xe782b916994fd31e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe782b916994fd317 expref: 13 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964949.867265:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9474420fea00/0xe782b916994fd31e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe782b916994fd317 expref: 13 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964949.867272:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9474420fea00, rc 0) 00000100:00100000:3.0:1783964949.867294:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94740951dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae0997f7-3a15-4fc6-865a-35b2f101956e+13:7506:x1870622732859392:12345-0@lo:101: Request processed in 71us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1783964949.867300:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00010000:00010000:1.0:1783964949.867355:0:5801:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783964949.867362:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.112@tcp lock: ffff947400031600/0xe782b916994fd309 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xe782b916994fd310 expref: -99 pid: 7506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964949.867369:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947400031600 already unused, calling callback (ffffffffc1ca8c20) 10000000:00010000:1.0:1783964949.867373:0:5801:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.112@tcp lock: ffff947400031600/0xe782b916994fd309 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0xe782b916994fd310 expref: -99 pid: 7506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964949.867381:0:5801:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.112@tcp lock: ffff947400031600/0xe782b916994fd309 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0xe782b916994fd310 expref: -99 pid: 7506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783964949.867389:0:5801:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.112@tcp lock: ffff947400031600/0xe782b916994fd309 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0xe782b916994fd310 expref: -99 pid: 7506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783964949.867394:0:5801:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1783964949.867413:0:5801:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.112@tcp lock: ffff947400031600/0xe782b916994fd309 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xe782b916994fd310 expref: -99 pid: 7506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964949.867418:0:5801:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783964949.867442:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.112@tcp lock: ffff947400031600/0xe782b916994fd309 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xe782b916994fd310 expref: -99 pid: 7506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964949.867460:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.112@tcp lock: ffff947400031600/0xe782b916994fd309 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0xe782b916994fd310 expref: -99 pid: 7506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964949.867473:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783964949.867474:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783964949.867476:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783964949.867483:0:3325:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783964949.867493:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947436305500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ae0997f7-3a15-4fc6-865a-35b2f101956e:3325:1870622732859520:0@lo:103: 00000100:00100000:1.0:1783964949.867519:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783964949.867670:0:7506:0:(client.c:2702:ptlrpc_set_wait()) set ffff94743fa8b6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783964949.867683:0:7506:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947436334e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae0997f7-3a15-4fc6-865a-35b2f101956e:7506:1870622732859392:0@lo:101: 00010000:00010000:0.0:1783964949.867695:0:7506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.112@tcp lock: ffff947400030a00/0xe782b916994fd317 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fd31e expref: -99 pid: 7506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964949.867703:0:7506:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.112@tcp lock: ffff947400030a00/0xe782b916994fd317 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe782b916994fd31e expref: -99 pid: 7506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783964949.867763:0:7506:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947436334e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae0997f7-3a15-4fc6-865a-35b2f101956e:7506:1870622732859648:0@lo:501: 00000100:00100000:0.0:1783964949.867785:0:7506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783964949.867898:0:7506:0:(client.c:2702:ptlrpc_set_wait()) set ffff94743fa8b6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783964949.867943:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732859520 00000100:00100000:1.0:1783964949.867947:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732859520 00000100:00100000:1.0:1783964949.868022:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783964949.868029:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436307480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ae0997f7-3a15-4fc6-865a-35b2f101956e+13:3325:x1870622732859520:12345-0@lo:103: 00010000:00010000:1.0:1783964949.868038:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783964949.868051:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff947401483600/0xe782b916994fd310 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe782b916994fd309 expref: 13 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964949.868069:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783964949.868100:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436307480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ae0997f7-3a15-4fc6-865a-35b2f101956e+12:3325:x1870622732859520:12345-0@lo:103: Request processed in 72us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1783964949.868106:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783964949.868130:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732859648 00000100:00100000:3.0:1783964949.868133:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732859648 00000100:00100000:3.0:1783964949.868154:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1783964949.868158:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94740951fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae0997f7-3a15-4fc6-865a-35b2f101956e+12:7506:x1870622732859648:12345-0@lo:501: 00000100:00100000:3.0:1783964949.868353:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94740951fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae0997f7-3a15-4fc6-865a-35b2f101956e+12:7506:x1870622732859648:12345-0@lo:501: Request processed in 194us (567us total) trans 0 rc 0/0 00000100:00100000:3.0:1783964949.868359:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1783964949.868524:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947436305500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ae0997f7-3a15-4fc6-865a-35b2f101956e:3325:1870622732859520:0@lo:103: 00000100:00100000:0.0:1783964949.868553:0:7506:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947436334e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae0997f7-3a15-4fc6-865a-35b2f101956e:7506:1870622732859648:0@lo:501: 00000100:00100000:0.0:1783964949.868579:0:7506:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947436334e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae0997f7-3a15-4fc6-865a-35b2f101956e:7506:1870622732859776:0@lo:503: 00000100:00100000:0.0:1783964949.868612:0:7506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783964949.868637:0:7506:0:(client.c:2702:ptlrpc_set_wait()) set ffff94743fa8b6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783964949.868692:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732859776 00000100:00100000:3.0:1783964949.868695:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732859776 00000100:00100000:3.0:1783964949.868711:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1783964949.868715:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94741cee0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae0997f7-3a15-4fc6-865a-35b2f101956e+12:7506:x1870622732859776:12345-0@lo:503: 00000100:00100000:3.0:1783964949.868885:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94741cee0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae0997f7-3a15-4fc6-865a-35b2f101956e+12:7506:x1870622732859776:12345-0@lo:503: Request processed in 168us (271us total) trans 0 rc 0/0 00000100:00100000:3.0:1783964949.868891:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1783964949.869525:0:7506:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947436334e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae0997f7-3a15-4fc6-865a-35b2f101956e:7506:1870622732859776:0@lo:503: 00000040:00080000:0.0:1783964949.869807:0:7506:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1783964949.869954:0:7506:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947436334e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae0997f7-3a15-4fc6-865a-35b2f101956e:7506:1870622732859904:0@lo:502: 00000100:00100000:0.0:1783964949.869997:0:7506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783964949.870198:0:7506:0:(client.c:2702:ptlrpc_set_wait()) set ffff94743fa8b6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783964949.870313:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732859904 00000100:00100000:3.0:1783964949.870319:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732859904 00000100:00100000:3.0:1783964949.870398:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1783964949.870406:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94741cee1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae0997f7-3a15-4fc6-865a-35b2f101956e+12:7506:x1870622732859904:12345-0@lo:502: 00000100:00100000:3.0:1783964949.870585:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94741cee1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae0997f7-3a15-4fc6-865a-35b2f101956e+12:7506:x1870622732859904:12345-0@lo:502: Request processed in 179us (587us total) trans 0 rc 0/0 00000100:00100000:3.0:1783964949.870592:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1783964949.870675:0:7506:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947436334e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae0997f7-3a15-4fc6-865a-35b2f101956e:7506:1870622732859904:0@lo:502: 00000040:00080000:0.0:1783964949.870957:0:7506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1783964949.871008:0:7506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:0.0:1783964949.871068:0:7506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:0.0:1783964949.871121:0:7506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:0.0:1783964949.871160:0:7506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:0.0:1783964949.871197:0:7506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:0.0:1783964949.871264:0:7506:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947436334e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae0997f7-3a15-4fc6-865a-35b2f101956e:7506:1870622732860032:0@lo:502: 00000100:00100000:0.0:1783964949.871307:0:7506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783964949.871721:0:7506:0:(client.c:2702:ptlrpc_set_wait()) set ffff94743fa8b6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783964949.871812:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732860032 00000100:00100000:2.0:1783964949.871819:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732860032 00000100:00100000:2.0:1783964949.871859:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1783964949.871866:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94741cee2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae0997f7-3a15-4fc6-865a-35b2f101956e+12:7506:x1870622732860032:12345-0@lo:502: 00000100:00100000:2.0:1783964949.872047:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94741cee2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae0997f7-3a15-4fc6-865a-35b2f101956e+12:7506:x1870622732860032:12345-0@lo:502: Request processed in 181us (740us total) trans 0 rc 0/0 00000100:00100000:0.0:1783964949.872251:0:7506:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947436334e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae0997f7-3a15-4fc6-865a-35b2f101956e:7506:1870622732860032:0@lo:502: 00000040:00080000:0.0:1783964949.872361:0:7506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1783964949.872371:0:7506:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:0.0:1783964949.872680:0:7513:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1783964949.872688:0:7513:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:0.0:1783964949.872695:0:7513:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783964949.872697:0:7513:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1783964949.872709:0:7513:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1783964949.872726:0:7513:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9474259cb380) 00000020:00000080:0.0:1783964949.872747:0:7513:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:0.0:1783964949.872753:0:7513:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1783964949.872821:0:7513:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9474369fb000 from lustre-OST0001, refs=2 00080000:01000000:0.0:1783964949.872923:0:7513:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:0.0:1783964949.872932:0:7513:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xe782b916994fd32c 00000100:00100000:2.0:1783964949.873939:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00010000:00010000:0.0:1783964949.877912:0:7513:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:0.0:1783964949.878531:0:7513:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:0.0:1783964949.881604:0:7513:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:0.0:1783964949.881992:0:7513:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:3.0:1783964949.888511:0:7513:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:3.0:1783964949.888988:0:7513:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:0.0:1783964949.890467:0:7513:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1783964949.890480:0:7513:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783964949.890485:0:7513:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783964949.890487:0:7513:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1783964949.890490:0:7513:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783964949.890494:0:7513:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783964949.890496:0:7513:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:0.0:1783964949.890499:0:7513:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1783964949.890501:0:7513:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1783964949.890547:0:7513:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783964949.890551:0:7513:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783964949.890552:0:7513:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:0.0:1783964949.890555:0:7513:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1783964949.891927:0:7506:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:2.0:1783964949.891962:0:7506:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.112@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1783964949.891985:0:7506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.112@tcp lock: ffff947400030a00/0xe782b916994fd317 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fd31e expref: -99 pid: 7506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783964949.891997:0:7506:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.112@tcp lock: ffff947400030a00/0xe782b916994fd317 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fd31e expref: -99 pid: 7506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783964949.892006:0:7506:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9474369fb000 from 1 10000000:01000000:2.0:1783964949.892008:0:7506:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783964949.892044:0:7506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.112@tcp lock: ffff947430c10200/0xe782b916994fd333 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783964949.892121:0:7506:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.112@tcp lock: ffff947430c10200/0xe782b916994fd333 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783964949.892134:0:7506:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.112@tcp lock: ffff947430c10200/0xe782b916994fd333 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783964949.892158:0:7506:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9474072ab800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae0997f7-3a15-4fc6-865a-35b2f101956e:7506:1870622732860160:0@lo:101: 00000100:00100000:2.0:1783964949.892238:0:7506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783964949.892276:0:7506:0:(client.c:2702:ptlrpc_set_wait()) set ffff9474400a3e40 going to sleep for 11 seconds 00000100:00100000:0.0:1783964949.892364:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732860160 00000100:00100000:0.0:1783964949.892370:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732860160 00000100:00100000:0.0:1783964949.892409:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1783964949.892418:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94741cee0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae0997f7-3a15-4fc6-865a-35b2f101956e+12:7506:x1870622732860160:12345-0@lo:101: 00010000:00010000:0.0:1783964949.892431:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783964949.892442:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff947400030c00/0xe782b916994fd33a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe782b916994fd333 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964949.892476:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff947400030c00/0xe782b916994fd33a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe782b916994fd333 expref: 13 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964949.892485:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff947400030c00/0xe782b916994fd33a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe782b916994fd333 expref: 13 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964949.892493:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff947400030c00, rc 0) 00000100:00100000:0.0:1783964949.892533:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94741cee0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae0997f7-3a15-4fc6-865a-35b2f101956e+13:7506:x1870622732860160:12345-0@lo:101: Request processed in 116us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1783964949.892540:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1783964949.892593:0:7506:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9474072ab800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae0997f7-3a15-4fc6-865a-35b2f101956e:7506:1870622732860160:0@lo:101: 00010000:00010000:0.0:1783964949.892607:0:7506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.112@tcp lock: ffff947430c10200/0xe782b916994fd333 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fd33a expref: -99 pid: 7506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964949.892616:0:7506:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.112@tcp lock: ffff947430c10200/0xe782b916994fd333 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe782b916994fd33a expref: -99 pid: 7506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783964949.892720:0:7506:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947436334e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae0997f7-3a15-4fc6-865a-35b2f101956e:7506:1870622732860288:0@lo:501: 00000100:00100000:0.0:1783964949.892745:0:7506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783964949.892765:0:7506:0:(client.c:2702:ptlrpc_set_wait()) set ffff94743fa8b780 going to sleep for 11 seconds 00000100:00100000:2.0:1783964949.893154:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732860288 00000100:00100000:2.0:1783964949.893160:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732860288 00000100:00100000:2.0:1783964949.893193:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1783964949.893227:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94741cee0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae0997f7-3a15-4fc6-865a-35b2f101956e+13:7506:x1870622732860288:12345-0@lo:501: 00000100:00100000:2.0:1783964949.893479:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94741cee0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae0997f7-3a15-4fc6-865a-35b2f101956e+13:7506:x1870622732860288:12345-0@lo:501: Request processed in 278us (732us total) trans 0 rc 0/0 00000100:00100000:2.0:1783964949.893486:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1783964949.893579:0:7506:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947436334e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae0997f7-3a15-4fc6-865a-35b2f101956e:7506:1870622732860288:0@lo:501: 00000100:00100000:3.0:1783964949.893622:0:7506:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9474368d7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae0997f7-3a15-4fc6-865a-35b2f101956e:7506:1870622732860416:0@lo:503: 00000100:00100000:3.0:1783964949.893692:0:7506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783964949.893707:0:7506:0:(client.c:2702:ptlrpc_set_wait()) set ffff9474400a4600 going to sleep for 11 seconds 00000100:00100000:0.0:1783964949.893964:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732860416 00000100:00100000:0.0:1783964949.893969:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732860416 00000100:00100000:0.0:1783964949.893990:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1783964949.893997:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94741cee2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae0997f7-3a15-4fc6-865a-35b2f101956e+13:7506:x1870622732860416:12345-0@lo:503: 00000100:00100000:0.0:1783964949.894402:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94741cee2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae0997f7-3a15-4fc6-865a-35b2f101956e+13:7506:x1870622732860416:12345-0@lo:503: Request processed in 404us (708us total) trans 0 rc 0/0 00000100:00100000:0.0:1783964949.894409:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:3.0:1783964949.895972:0:7506:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9474368d7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae0997f7-3a15-4fc6-865a-35b2f101956e:7506:1870622732860416:0@lo:503: 00000040:00080000:3.0:1783964949.896414:0:7506:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1783964949.896499:0:7506:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9474368d7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae0997f7-3a15-4fc6-865a-35b2f101956e:7506:1870622732860544:0@lo:502: 00000100:00100000:3.0:1783964949.896564:0:7506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783964949.896613:0:7506:0:(client.c:2702:ptlrpc_set_wait()) set ffff9474400a4600 going to sleep for 11 seconds 00000100:00100000:1.0:1783964949.896781:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732860544 00000100:00100000:1.0:1783964949.896787:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732860544 00000100:00100000:1.0:1783964949.896983:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1783964949.896993:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94741cee1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+13:7506:x1870622732860544:12345-0@lo:502: 00000100:00100000:1.0:1783964949.898043:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94741cee1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+13:7506:x1870622732860544:12345-0@lo:502: Request processed in 1049us (1476us total) trans 0 rc 0/0 00000100:00100000:1.0:1783964949.898061:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1783964949.898159:0:7506:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9474368d7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae0997f7-3a15-4fc6-865a-35b2f101956e:7506:1870622732860544:0@lo:502: 00000040:00080000:3.0:1783964949.898449:0:7506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1783964949.898484:0:7506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1783964949.898510:0:7506:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9474368d7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae0997f7-3a15-4fc6-865a-35b2f101956e:7506:1870622732860672:0@lo:502: 00000100:00100000:3.0:1783964949.898543:0:7506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783964949.898618:0:7506:0:(client.c:2702:ptlrpc_set_wait()) set ffff9474400a4600 going to sleep for 11 seconds 00000100:00100000:2.0:1783964949.898906:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732860672 00000100:00100000:2.0:1783964949.898912:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732860672 00000100:00100000:2.0:1783964949.899031:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1783964949.899040:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94741cee3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae0997f7-3a15-4fc6-865a-35b2f101956e+13:7506:x1870622732860672:12345-0@lo:502: 00000100:00100000:2.0:1783964949.899242:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94741cee3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae0997f7-3a15-4fc6-865a-35b2f101956e+13:7506:x1870622732860672:12345-0@lo:502: Request processed in 202us (695us total) trans 0 rc 0/0 00000100:00100000:2.0:1783964949.899249:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1783964949.899298:0:7506:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9474368d7480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae0997f7-3a15-4fc6-865a-35b2f101956e:7506:1870622732860672:0@lo:502: 00000040:00080000:2.0:1783964949.899389:0:7506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1783964949.899400:0:7506:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1783964949.901465:0:7517:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783964949.901478:0:7517:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783964949.901481:0:7517:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1783964949.901488:0:7517:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9474369fb000 00000020:00000080:2.0:1783964949.901491:0:7517:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1783964949.901512:0:7517:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783964949.901515:0:7517:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783964949.901516:0:7517:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1783964949.901520:0:7517:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1783964949.902318:0:7506:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1783964949.902346:0:7506:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783964949.902399:0:7506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.112@tcp lock: ffff947430c10200/0xe782b916994fd333 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fd33a expref: -99 pid: 7506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964949.902412:0:7506:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.112@tcp lock: ffff947430c10200/0xe782b916994fd333 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fd33a expref: -99 pid: 7506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783964949.902461:0:7506:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1783964949.902464:0:7506:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9474369fb000 10000000:01000000:3.0:1783964949.902467:0:7506:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9474369fb000 10000000:01000000:3.0:1783964949.902471:0:7506:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1783964949.902477:0:7506:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9474369fb000 from 1 10000000:01000000:3.0:1783964949.902480:0:7506:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1783964949.902516:0:7506:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.112@tcp lock: ffff9474420fe800/0xe782b916994fd341 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964949.902524:0:7506:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.112@tcp lock: ffff9474420fe800/0xe782b916994fd341 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964949.902534:0:7506:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.112@tcp lock: ffff9474420fe800/0xe782b916994fd341 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783964949.902564:0:7506:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9474368d7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae0997f7-3a15-4fc6-865a-35b2f101956e:7506:1870622732860800:0@lo:101: 00000100:00100000:3.0:1783964949.902781:0:7506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783964949.902830:0:7506:0:(client.c:2702:ptlrpc_set_wait()) set ffff9474400a4f00 going to sleep for 11 seconds 00000100:00100000:2.0:1783964949.902895:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732860800 00000100:00100000:2.0:1783964949.902902:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732860800 00000100:00100000:2.0:1783964949.902956:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1783964949.902965:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94741cee1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+13:7506:x1870622732860800:12345-0@lo:101: 00010000:00010000:2.0:1783964949.902979:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783964949.902991:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff947430c10e00/0xe782b916994fd348 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe782b916994fd341 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783964949.903019:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff947430c10e00/0xe782b916994fd348 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe782b916994fd341 expref: 14 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783964949.903030:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff947430c10e00/0xe782b916994fd348 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe782b916994fd341 expref: 14 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783964949.903038:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff947430c10e00, rc 0) 00000100:00100000:2.0:1783964949.903082:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94741cee1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+14:7506:x1870622732860800:12345-0@lo:101: Request processed in 118us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1783964949.903088:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1783964949.903135:0:7506:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9474368d7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae0997f7-3a15-4fc6-865a-35b2f101956e:7506:1870622732860800:0@lo:101: 00010000:00010000:2.0:1783964949.903150:0:7506:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.112@tcp lock: ffff9474420fe800/0xe782b916994fd341 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fd348 expref: -99 pid: 7506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783964949.903170:0:7506:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.112@tcp lock: ffff9474420fe800/0xe782b916994fd341 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe782b916994fd348 expref: -99 pid: 7506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783964949.903276:0:7506:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9474072aa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae0997f7-3a15-4fc6-865a-35b2f101956e:7506:1870622732860928:0@lo:501: 00000100:00100000:2.0:1783964949.903302:0:7506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783964949.903321:0:7506:0:(client.c:2702:ptlrpc_set_wait()) set ffff9474400a3f00 going to sleep for 11 seconds 00000100:00100000:2.0:1783964949.903335:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732860928 00000100:00100000:2.0:1783964949.903338:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732860928 00000100:00100000:2.0:1783964949.903359:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1783964949.903364:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94741cee3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae0997f7-3a15-4fc6-865a-35b2f101956e+14:7506:x1870622732860928:12345-0@lo:501: 00000100:00100000:2.0:1783964949.903587:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94741cee3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae0997f7-3a15-4fc6-865a-35b2f101956e+14:7506:x1870622732860928:12345-0@lo:501: Request processed in 221us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1783964949.903593:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:0.0:1783964949.903965:0:7506:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9474072aa680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae0997f7-3a15-4fc6-865a-35b2f101956e:7506:1870622732860928:0@lo:501: 00000100:00100000:0.0:1783964949.903999:0:7506:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947436336300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae0997f7-3a15-4fc6-865a-35b2f101956e:7506:1870622732861056:0@lo:503: 00000100:00100000:0.0:1783964949.904040:0:7506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783964949.904767:0:7506:0:(client.c:2702:ptlrpc_set_wait()) set ffff94743fa8b6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783964949.905810:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732861056 00000100:00100000:2.0:1783964949.905820:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732861056 00000100:00100000:3.0:1783964949.906040:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1783964949.906052:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94741cee3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae0997f7-3a15-4fc6-865a-35b2f101956e+14:7506:x1870622732861056:12345-0@lo:503: 00000100:00100000:3.0:1783964949.906355:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94741cee3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae0997f7-3a15-4fc6-865a-35b2f101956e+14:7506:x1870622732861056:12345-0@lo:503: Request processed in 305us (2314us total) trans 0 rc 0/0 00000100:00100000:3.0:1783964949.906363:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1783964949.906469:0:7506:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947436336300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae0997f7-3a15-4fc6-865a-35b2f101956e:7506:1870622732861056:0@lo:503: 00000040:00080000:1.0:1783964949.906800:0:7506:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1783964949.906871:0:7506:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947436304700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae0997f7-3a15-4fc6-865a-35b2f101956e:7506:1870622732861184:0@lo:502: 00000100:00100000:1.0:1783964949.906918:0:7506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783964949.907495:0:7506:0:(client.c:2702:ptlrpc_set_wait()) set ffff94743faa6c00 going to sleep for 11 seconds 00000100:00100000:2.0:1783964949.907570:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732861184 00000100:00100000:2.0:1783964949.907577:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732861184 00000100:00100000:2.0:1783964949.907617:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1783964949.907625:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94741cee3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+14:7506:x1870622732861184:12345-0@lo:502: 00000100:00100000:2.0:1783964949.907852:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94741cee3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+14:7506:x1870622732861184:12345-0@lo:502: Request processed in 227us (933us total) trans 0 rc 0/0 00000100:00100000:2.0:1783964949.907877:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1783964949.907928:0:7506:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947436304700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae0997f7-3a15-4fc6-865a-35b2f101956e:7506:1870622732861184:0@lo:502: 00000040:00080000:1.0:1783964949.908315:0:7506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1783964949.908482:0:7506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1783964949.908512:0:7506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1783964949.908566:0:7506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1783964949.908606:0:7506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1783964949.908673:0:7506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1783964949.908761:0:7506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1783964949.908790:0:7506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1783964949.908828:0:7506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1783964949.908867:0:7506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1783964949.908903:0:7506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1783964949.909020:0:7506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1783964949.909059:0:7506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1783964949.909091:0:7506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1783964949.909159:0:7506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1783964949.909198:0:7506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1783964949.909288:0:7506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1783964949.909348:0:7506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1783964949.909388:0:7506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1783964949.909532:0:7506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1783964949.909627:0:7506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1783964949.909681:0:7506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1783964949.909729:0:7506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1783964949.909780:0:7506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1783964949.909854:0:7506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:0.0:1783964949.909891:0:7506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:0.0:1783964949.909957:0:7506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:0.0:1783964949.909996:0:7506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:0.0:1783964949.910032:0:7506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:0.0:1783964949.910796:0:7506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:0.0:1783964949.911311:0:7506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:0.0:1783964949.911352:0:7506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:0.0:1783964949.911388:0:7506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:0.0:1783964949.911465:0:7506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:0.0:1783964949.911508:0:7506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:0.0:1783964949.911573:0:7506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:0.0:1783964949.911756:0:7506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:0.0:1783964949.911811:0:7506:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947436336a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae0997f7-3a15-4fc6-865a-35b2f101956e:7506:1870622732861312:0@lo:502: 00000100:00100000:0.0:1783964949.911956:0:7506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783964949.912043:0:7506:0:(client.c:2702:ptlrpc_set_wait()) set ffff94743fa8be40 going to sleep for 11 seconds 00000100:00100000:2.0:1783964949.912284:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732861312 00000100:00100000:2.0:1783964949.912292:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732861312 00000100:00100000:2.0:1783964949.912371:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1783964949.912381:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94741cee0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+14:7506:x1870622732861312:12345-0@lo:502: 00000100:00100000:2.0:1783964949.912650:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94741cee0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+14:7506:x1870622732861312:12345-0@lo:502: Request processed in 261us (683us total) trans 0 rc 0/0 00000100:00100000:2.0:1783964949.912658:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1783964949.912690:0:7506:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947436336a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae0997f7-3a15-4fc6-865a-35b2f101956e:7506:1870622732861312:0@lo:502: 00000040:00080000:1.0:1783964949.912784:0:7506:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:1.0:1783964949.912804:0:7506:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:2.0:1783964949.913669:0:7518:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:2.0:1783964949.913752:0:7518:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff947304bf8000) 00000020:00000080:2.0:1783964949.913776:0:7518:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:2.0:1783964949.914075:0:7518:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9474369fb000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1783964949.914080:0:7518:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9474369fb000 from lustre-OST0001, refs=3 00000020:01000004:2.0:1783964949.914083:0:7518:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9474369fb000 3 00010000:00080000:2.0:1783964949.914113:0:7518:0:(ldlm_lib.c:102:import_set_conn()) imp ffff947304b99800@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.112@tcp at head 00010000:00010000:3.0:1783964949.918596:0:7518:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:3.0:1783964949.918726:0:7518:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1783964949.918776:0:7518:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1783964949.918790:0:7518:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xe782b916994fd356 00000100:00080000:3.0:1783964949.918802:0:7518:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1783964949.918809:0:7518:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff947304b99800 using connection 192.168.204.112@tcp/0@lo 00000100:00100000:3.0:1783964949.918850:0:7518:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9474368d4e00 x1870622732861440/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783964949.918878:0:7518:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000040:00080000:0.0:1783964949.919564:0:7518:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000100:00080000:0.0:1783964949.920046:0:7520:0:(client.c:1832:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff947436336a00 x1870622732861568/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783964949.920058:0:7520:0:(client.c:2702:ptlrpc_set_wait()) set ffff94743fa8b540 going to sleep for 0 seconds 00000100:00100000:0.0:1783964949.920096:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9474072a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3325:1870622732861696:0@lo:400: 00000100:00100000:0.0:1783964949.920168:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783964949.920242:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9474072a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3322:1870622732861824:0@lo:400: 00000100:00100000:0.0:1783964949.920268:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783964949.920287:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783964949.920293:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9474072a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3322:1870622732861952:0@lo:400: 00000100:00100000:0.0:1783964949.920317:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783964949.920355:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732861696 00000100:00100000:0.0:1783964949.920361:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732861696 00000100:00100000:2.0:1783964949.920388:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732861824 00000100:00100000:2.0:1783964949.920393:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732861824 00000100:00100000:0.0:1783964949.920402:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783964949.920410:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436336300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3325:x1870622732861696:12345-0@lo:400: 00000100:00100000:2.0:1783964949.920423:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1783964949.920429:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436334e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3322:x1870622732861824:12345-0@lo:400: 00000100:00100000:2.0:1783964949.920459:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436334e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3322:x1870622732861824:12345-0@lo:400: Request processed in 31us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1783964949.920459:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436336300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3325:x1870622732861696:12345-0@lo:400: Request processed in 49us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1783964949.920466:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783964949.920529:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9474368d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3321:1870622732861440:0@lo:38: 00000100:00100000:1.0:1783964949.920569:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:1.0:1783964949.920601:0:7506:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:1.0:1783964949.920633:0:7506:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.112@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1783964949.920658:0:7506:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.112@tcp lock: ffff9474420fe800/0xe782b916994fd341 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fd348 expref: -99 pid: 7506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964949.920669:0:7506:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.112@tcp lock: ffff9474420fe800/0xe782b916994fd341 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fd348 expref: -99 pid: 7506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1783964949.920720:0:7506:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1783964949.920723:0:7506:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1783964949.920725:0:7506:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783964949.920726:0:7506:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783964949.920727:0:7506:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783964949.920728:0:7506:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783964949.920730:0:7506:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783964949.920731:0:7506:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1783964949.920733:0:7506:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1783964949.920734:0:7506:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783964949.920736:0:7506:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1783964949.920741:0:7506:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:1.0:1783964949.920743:0:7506:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1783964949.920744:0:7506:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1783964949.920746:0:7506:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783964949.920747:0:7506:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783964949.920748:0:7506:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783964949.920749:0:7506:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783964949.920750:0:7506:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783964949.920751:0:7506:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1783964949.920752:0:7506:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1783964949.920753:0:7506:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783964949.920754:0:7506:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1783964949.920768:0:7506:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1783964949.920777:0:7506:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947436307b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae0997f7-3a15-4fc6-865a-35b2f101956e:7506:1870622732862080:0@lo:253: 00000100:00100000:1.0:1783964949.920818:0:7506:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783964949.920834:0:7506:0:(client.c:2702:ptlrpc_set_wait()) set ffff947405a496c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783964949.920852:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732861952 00000100:00100000:1.0:1783964949.920856:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732861952 00000100:00100000:1.0:1783964949.920889:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783964949.920896:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436337100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3322:x1870622732861952:12345-0@lo:400: 00000100:00100000:1.0:1783964949.920929:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436337100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3322:x1870622732861952:12345-0@lo:400: Request processed in 34us (610us total) trans 0 rc 0/0 00000100:00100000:2.0:1783964949.920931:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1783964949.920947:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732861440 00000100:00100000:2.0:1783964949.920951:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732861440 00000100:00100000:2.0:1783964949.920964:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783964949.920968:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436304700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3321:x1870622732861440:12345-0@lo:38: 00010000:00080000:2.0:1783964949.920987:0:5812:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 184 last 0 00000020:00000080:2.0:1783964949.921019:0:5812:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xe782b916994fd35d 00000004:00100000:2.0:1783964949.921033:0:5812:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1783964949.921138:0:5812:0:(import.c:65:import_set_state_nolock()) ffff947304b98800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783964949.921265:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436304700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1870622732861440:12345-0@lo:38: Request processed in 294us (694us total) trans 0 rc 0/0 00000100:00100000:2.0:1783964949.921280:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:2.0:1783964949.921297:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783964949.921300:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1783964949.921414:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9474072a8000 x1870622732861952/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783964965 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783964949.921430:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9474072a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3322:1870622732861952:0@lo:400: 00010000:00080000:0.0:1783964949.921441:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9474072a9f80 x1870622732861824/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783964965 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783964949.921450:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9474072a9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3322:1870622732861824:0@lo:400: 00010000:00080000:0.0:1783964949.921479:0:3325:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9474072a8380 x1870622732861696/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783964965 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783964949.921488:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9474072a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3325:1870622732861696:0@lo:400: 00000100:00100000:1.0:1783964949.921815:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783964949.922761:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732862080 00000100:00100000:2.0:1783964949.922770:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732862080 00000100:00100000:2.0:1783964949.922809:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1783964949.922818:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94741cee1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae0997f7-3a15-4fc6-865a-35b2f101956e+14:7506:x1870622732862080:12345-0@lo:253: 20000000:01000000:2.0:1783964949.922847:0:5807:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1783964949.922859:0:5807:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:1.0:1783964949.923037:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9474368d4e00 x1870622732861440/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783964959 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783964949.923048:0:3321:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1783964949.923056:0:3321:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:1.0:1783964949.923064:0:3321:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1783964949.923069:0:3321:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1783964949.923072:0:3321:0:(import.c:65:import_set_state_nolock()) ffff947304b99800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00080000:1.0:1783964949.923080:0:3321:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 000000004ac43dbb): req@ffff947436336a00 x1870622732861568/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783964949.923094:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9474368d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3321:1870622732861440:0@lo:38: 00000100:00100000:1.0:1783964949.923325:0:7520:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783964949.923351:0:7520:0:(client.c:2702:ptlrpc_set_wait()) set ffff94743fa8b540 going to sleep for 11 seconds 00000100:00100000:3.0:1783964949.923416:0:5822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732861568 00000100:00100000:3.0:1783964949.923421:0:5822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732861568 00000100:00100000:3.0:1783964949.923460:0:5822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783964949.923467:0:5822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436305880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7520:x1870622732861568:12345-0@lo:901: 00000100:00100000:3.0:1783964949.924239:0:5822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436305880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7520:x1870622732861568:12345-0@lo:901: Request processed in 768us (910us total) trans 0 rc 0/0 00000100:00100000:3.0:1783964949.924248:0:5822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1783964949.924440:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1783964949.925269:0:7520:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff947436336a00 x1870622732861568/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1783964965 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783964949.925286:0:7520:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947436336a00 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7520:1870622732861568:0@lo:901: 20000000:01000000:2.0:1783964949.982940:0:5807:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1783964949.982961:0:5807:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1783964949.983021:0:5827:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1783964949.983042:0:5827:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1783964949.983133:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9474420fe000/0xe782b916994fd364 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964949.983154:0:5827:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff947401483000/0xe782b916994fd2ed lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe782b916994fd2e6 expref: 14 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964949.983164:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9474420fe000/0xe782b916994fd364 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964949.983236:0:5827:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff947401483000/0xe782b916994fd2ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe782b916994fd2e6 expref: 14 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964949.983253:0:5827:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff947401483000/0xe782b916994fd2ed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe782b916994fd2e6 expref: 14 pid: 5807 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783964949.983269:0:5827:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9474368d6680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5827:1870622732862208:0@lo:104: 00000100:00100000:3.0:1783964949.983333:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783964949.983386:0:5827:0:(client.c:2702:ptlrpc_set_wait()) set ffff9474400a4a80 going to sleep for 11 seconds 00000100:00100000:2.0:1783964949.984147:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732862208 00000100:00100000:2.0:1783964949.984158:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732862208 00000100:00100000:2.0:1783964949.984276:0:5795:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1783964949.984287:0:5795:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9474368d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ae0997f7-3a15-4fc6-865a-35b2f101956e+3:5827:x1870622732862208:12345-0@lo:104: 00010000:00010000:2.0:1783964949.984302:0:5795:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.112@tcp lock: ffff9474420fee00/0xe782b916994fd2e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe782b916994fd2ed expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783964949.984368:0:5795:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1783964949.984374:0:5795:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9474368d4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:ae0997f7-3a15-4fc6-865a-35b2f101956e+3:5827:x1870622732862208:12345-0@lo:104: Request processed in 91us (1041us total) trans 0 rc 0/0 00000100:00100000:2.0:1783964949.984382:0:5795:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1783964949.984514:0:5827:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9474368d6680 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5827:1870622732862208:0@lo:104: 00010000:00010000:1.0:1783964949.984536:0:5827:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9474420fe000/0xe782b916994fd364 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964949.991359:0:5800:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783964949.991374:0:5800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.112@tcp lock: ffff9474420fee00/0xe782b916994fd2e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe782b916994fd2ed expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964949.991387:0:5800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9474420fee00 already unused, calling callback (ffffffffc1ca8c20) 10000000:00010000:3.0:1783964949.991392:0:5800:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.112@tcp lock: ffff9474420fee00/0xe782b916994fd2e6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe782b916994fd2ed expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964949.991404:0:5800:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.112@tcp lock: ffff9474420fee00/0xe782b916994fd2e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe782b916994fd2ed expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783964949.991412:0:5800:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.112@tcp lock: ffff9474420fee00/0xe782b916994fd2e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe782b916994fd2ed expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783964949.991434:0:5800:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1783964949.991486:0:5800:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.112@tcp lock: ffff9474420fee00/0xe782b916994fd2e6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe782b916994fd2ed expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964949.991494:0:5800:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783964949.991517:0:5800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.112@tcp lock: ffff9474420fee00/0xe782b916994fd2e6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe782b916994fd2ed expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964949.991526:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.112@tcp lock: ffff9474420fee00/0xe782b916994fd2e6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe782b916994fd2ed expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964949.991545:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783964949.991547:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783964949.991549:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783964949.991672:0:3325:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783964949.991694:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9474368d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ae0997f7-3a15-4fc6-865a-35b2f101956e:3325:1870622732862336:0@lo:103: 00000100:00100000:0.0:1783964949.991764:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783964949.993006:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732862336 00000100:00100000:3.0:1783964949.993016:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732862336 00010000:00010000:3.0:1783964949.993050:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff947401483000/0xe782b916994fd2ed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe782b916994fd2e6 expref: 15 pid: 5807 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783964949.993095:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1783964949.993104:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94741843c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ae0997f7-3a15-4fc6-865a-35b2f101956e+15:3325:x1870622732862336:12345-0@lo:103: 00010000:00010000:3.0:1783964949.993118:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783964949.993124:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff947401483000/0xe782b916994fd2ed lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe782b916994fd2e6 expref: 15 pid: 5807 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964949.993136:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff947401483000/0xe782b916994fd2ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe782b916994fd2e6 expref: 15 pid: 5807 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964949.993154:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff947401483000/0xe782b916994fd2ed lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe782b916994fd2e6 expref: 15 pid: 5807 timeout: 334 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964949.993182:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9474420fe000/0xe782b916994fd364 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964949.993191:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9474420fe000/0xe782b916994fd364 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1783964949.993224:0:5797:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.010183544s 00010000:00010000:3.0:1783964949.993230:0:5797:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9474420fe000/0xe782b916994fd364 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964949.993238:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9474420fe000/0xe782b916994fd364 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964949.993245:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9474420fe000/0xe782b916994fd364 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964949.993252:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9474420fe000/0xe782b916994fd364 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964949.993258:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9474420fe000 already unused, calling callback (ffffffffc168d230) 00010000:00010000:3.0:1783964949.993262:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9474420fe000/0xe782b916994fd364 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964949.993270:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9474420fe000/0xe782b916994fd364 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964949.993286:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9474420fe000/0xe782b916994fd364 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964949.993297:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783964949.993355:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94741843c450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ae0997f7-3a15-4fc6-865a-35b2f101956e+14:3325:x1870622732862336:12345-0@lo:103: Request processed in 252us (1590us total) trans 0 rc 0/0 00000100:00100000:3.0:1783964949.993363:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1783964949.993534:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9474368d7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ae0997f7-3a15-4fc6-865a-35b2f101956e:3325:1870622732862336:0@lo:103: 00010000:00010000:1.0:1783964949.996084:0:5827:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9474420fe000/0xe782b916994fd364 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964949.996123:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9474420fe000/0xe782b916994fd364 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964949.996131:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9474420fe000/0xe782b916994fd364 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783964949.999235:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94741cee1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae0997f7-3a15-4fc6-865a-35b2f101956e+13:7506:x1870622732862080:12345-0@lo:253: Request processed in 76383us (78381us total) trans 0 rc 0/0 00000100:00100000:2.0:1783964949.999251:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1783964949.999416:0:7506:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947436307b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:ae0997f7-3a15-4fc6-865a-35b2f101956e:7506:1870622732862080:0@lo:253: 10000000:01000000:1.0:1783964949.999433:0:7506:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1783964949.999437:0:7506:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1783964949.999439:0:7506:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1783964949.999441:0:7506:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1783964949.999443:0:7506:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1783964949.999445:0:7506:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1783964949.999447:0:7506:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1783964949.999448:0:7506:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1783964949.999450:0:7506:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1783964949.999452:0:7506:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1783964949.999454:0:7506:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1783964949.999456:0:7506:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1783964949.999473:0:7506:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1783964950.015421:0:7506:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1783964950.015633:0:7506:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1783964950.015828:0:7506:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1783964950.015963:0:7506:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1783964950.016117:0:7506:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1783964950.016556:0:7506:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1783964950.017535:0:7506:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00000100:00100000:3.0:1783964950.068075:0:3324:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783964950.068101:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9474072aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3324:1870622732862464:0@lo:13: 00000100:00100000:3.0:1783964950.068173:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783964950.068454:0:6610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732862464 00000100:00100000:2.0:1783964950.068462:0:6610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732862464 00000100:00100000:2.0:1783964950.068509:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783964950.068526:0:6610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9474368d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3324:x1870622732862464:12345-0@lo:13: 00002000:00000024:2.0:1783964950.068563:0:6610:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783964950.068625:0:6610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9474368d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3324:x1870622732862464:12345-0@lo:13: Request processed in 101us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1783964950.068632:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1783964950.070007:0:3324:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9474072aad80 x1870622732862464/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783964966 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783964950.070031:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9474072aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3324:1870622732862464:0@lo:13: 00010000:00010000:2.0:1783964950.187687:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1783964950.223765:0:7506:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1783964950.223775:0:7506:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1783964950.223813:0:7506:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1783964950.223883:0:7506:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.112@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1783964950.223900:0:7506:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1783964950.223930:0:7506:0:(super25.c:181:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:3.0:1783964951.217317:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783964952.235384:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783964953.259380:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783964954.283575:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783964955.179385:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9474072a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3323:1870622732862720:0@lo:400: 00000100:00100000:2.0:1783964955.179466:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783964955.179524:0:3323:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1783964955.179531:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9474072abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ae0997f7-3a15-4fc6-865a-35b2f101956e:3323:1870622732862592:0@lo:400: 00000100:00100000:2.0:1783964955.179575:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783964955.179599:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9474072a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3323:1870622732863104:0@lo:400: 00000100:00100000:2.0:1783964955.179626:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783964955.179652:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9474072ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3324:1870622732862848:0@lo:400: 00000100:00100000:2.0:1783964955.179675:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783964955.179693:0:3324:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783964955.179698:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9474072aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3324:1870622732862976:0@lo:400: 00000100:00100000:2.0:1783964955.179723:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783964955.179754:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732862720 00000100:00100000:2.0:1783964955.179761:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732862720 00000100:00100000:2.0:1783964955.179803:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732863104 00000100:00100000:2.0:1783964955.179807:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732863104 00000100:00100000:2.0:1783964955.179829:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732862848 00000100:00100000:2.0:1783964955.179832:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732862848 00000100:00100000:2.0:1783964955.179850:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1783964955.179858:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9474072a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3323:x1870622732862720:12345-0@lo:400: 00000100:00100000:2.0:1783964955.179924:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9474072a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3323:x1870622732862720:12345-0@lo:400: Request processed in 66us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1783964955.179932:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1783964955.179948:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783964955.179953:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9474072a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3323:x1870622732863104:12345-0@lo:400: 00000100:00100000:2.0:1783964955.179994:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9474072a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3323:x1870622732863104:12345-0@lo:400: Request processed in 41us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1783964955.180000:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783964955.180010:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1783964955.180016:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9474072aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3324:x1870622732862848:12345-0@lo:400: 00000100:00100000:2.0:1783964955.180044:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9474072aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3324:x1870622732862848:12345-0@lo:400: Request processed in 28us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1783964955.180050:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1783964955.180068:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732862592 00000100:00100000:2.0:1783964955.180071:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732862592 00000100:00100000:2.0:1783964955.180096:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1783964955.180102:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94741cee2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+13:3323:x1870622732862592:12345-0@lo:400: 00000100:00100000:2.0:1783964955.180128:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94741cee2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+13:3323:x1870622732862592:12345-0@lo:400: Request processed in 27us (553us total) trans 0 rc 0/0 00000100:00100000:2.0:1783964955.180135:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1783964955.180165:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732862976 00000100:00100000:2.0:1783964955.180169:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732862976 00000100:00100000:2.0:1783964955.180193:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783964955.180219:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9474072ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3324:x1870622732862976:12345-0@lo:400: 00000100:00100000:2.0:1783964955.180250:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9474072ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3324:x1870622732862976:12345-0@lo:400: Request processed in 51us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1783964955.180266:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1783964955.180285:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783964955.180290:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1783964955.180323:0:3324:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9474072aad80 x1870622732862976/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783964971 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783964955.180337:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9474072aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3324:1870622732862976:0@lo:400: 00010000:00080000:2.0:1783964955.180348:0:3324:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9474072ab100 x1870622732862848/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783964971 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783964955.180356:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9474072ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3324:1870622732862848:0@lo:400: 00000100:00100000:2.0:1783964955.180384:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9474072abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ae0997f7-3a15-4fc6-865a-35b2f101956e:3323:1870622732862592:0@lo:400: 00010000:00080000:2.0:1783964955.180393:0:3323:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9474072a8380 x1870622732863104/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783964971 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783964955.180401:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9474072a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3323:1870622732863104:0@lo:400: 00010000:00080000:2.0:1783964955.180410:0:3323:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9474072a9880 x1870622732862720/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783964971 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783964955.180416:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9474072a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3323:1870622732862720:0@lo:400: 00000100:00100000:3.0:1783964955.180927:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783964955.180939:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9474072a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3322:1870622732863232:0@lo:13: 00000100:00100000:3.0:1783964955.181036:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783964955.181118:0:6610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732863232 00000100:00100000:2.0:1783964955.181122:0:6610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732863232 00000100:00100000:2.0:1783964955.181159:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783964955.181167:0:6610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9474368d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1870622732863232:12345-0@lo:13: 00002000:00000024:2.0:1783964955.181195:0:6610:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783964955.181257:0:6610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9474368d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1870622732863232:12345-0@lo:13: Request processed in 91us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1783964955.181263:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1783964955.181344:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9474072a9880 x1870622732863232/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783964971 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783964955.181360:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9474072a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3322:1870622732863232:0@lo:13: 00010000:00010000:3.0:1783964955.307384:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783964956.332737:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1783964956.485977:0:7863:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg412-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1783964957.356773:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1783964958.252099:0:5809:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1783964958.252108:0:5809:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff94743e519000 from 30 10000000:01000000:1.0:1783964958.252114:0:5809:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1783964958.252165:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.112@tcp lock: ffff947401482c00/0xe782b916994fd36b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964958.252197:0:5809:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.112@tcp lock: ffff947401482c00/0xe782b916994fd36b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964958.252238:0:5809:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.112@tcp lock: ffff947401482c00/0xe782b916994fd36b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783964958.252263:0:5809:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947436307b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae0997f7-3a15-4fc6-865a-35b2f101956e:5809:1870622732863360:0@lo:101: 00000100:00100000:1.0:1783964958.252330:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783964958.252385:0:5809:0:(client.c:2702:ptlrpc_set_wait()) set ffff947408b90a80 going to sleep for 11 seconds 00000100:00100000:2.0:1783964958.252655:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732863360 00000100:00100000:2.0:1783964958.252663:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732863360 00000100:00100000:2.0:1783964958.252719:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1783964958.252728:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94741cee2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae0997f7-3a15-4fc6-865a-35b2f101956e+13:5809:x1870622732863360:12345-0@lo:101: 00010000:00010000:2.0:1783964958.252751:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783964958.252764:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff947430c10a00/0xe782b916994fd372 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe782b916994fd36b expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783964958.252793:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff947430c10a00/0xe782b916994fd372 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe782b916994fd36b expref: 14 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783964958.252803:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff947430c10a00/0xe782b916994fd372 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe782b916994fd36b expref: 14 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783964958.252812:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff947430c10a00, rc 0) 00000100:00100000:2.0:1783964958.252856:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94741cee2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae0997f7-3a15-4fc6-865a-35b2f101956e+14:5809:x1870622732863360:12345-0@lo:101: Request processed in 129us (526us total) trans 0 rc 0/0 00000100:00100000:2.0:1783964958.252863:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1783964958.252994:0:5809:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947436307b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae0997f7-3a15-4fc6-865a-35b2f101956e:5809:1870622732863360:0@lo:101: 00010000:00010000:1.0:1783964958.253009:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.112@tcp lock: ffff947401482c00/0xe782b916994fd36b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fd372 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964958.253017:0:5809:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.112@tcp lock: ffff947401482c00/0xe782b916994fd36b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe782b916994fd372 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783964958.253067:0:5809:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947436307b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae0997f7-3a15-4fc6-865a-35b2f101956e:5809:1870622732863488:0@lo:501: 00000100:00100000:1.0:1783964958.253092:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783964958.253114:0:5809:0:(client.c:2702:ptlrpc_set_wait()) set ffff947408b90a80 going to sleep for 11 seconds 00000100:00100000:0.0:1783964958.253408:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732863488 00000100:00100000:0.0:1783964958.253412:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732863488 00000100:00100000:0.0:1783964958.253447:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1783964958.253455:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947408ec8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae0997f7-3a15-4fc6-865a-35b2f101956e+14:5809:x1870622732863488:12345-0@lo:501: 00000100:00100000:0.0:1783964958.253813:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947408ec8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae0997f7-3a15-4fc6-865a-35b2f101956e+14:5809:x1870622732863488:12345-0@lo:501: Request processed in 358us (719us total) trans 0 rc 0/0 00000100:00100000:0.0:1783964958.253820:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1783964958.254097:0:5809:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947436307b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae0997f7-3a15-4fc6-865a-35b2f101956e:5809:1870622732863488:0@lo:501: 00000100:00100000:1.0:1783964958.254131:0:5809:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947436307b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae0997f7-3a15-4fc6-865a-35b2f101956e:5809:1870622732863616:0@lo:503: 00000100:00100000:1.0:1783964958.254168:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783964958.254197:0:5809:0:(client.c:2702:ptlrpc_set_wait()) set ffff947408b90a80 going to sleep for 11 seconds 00000100:00100000:0.0:1783964958.254427:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732863616 00000100:00100000:0.0:1783964958.254432:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732863616 00000100:00100000:0.0:1783964958.254464:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1783964958.254472:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947408ec9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+14:5809:x1870622732863616:12345-0@lo:503: 00000100:00100000:0.0:1783964958.254785:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947408ec9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+14:5809:x1870622732863616:12345-0@lo:503: Request processed in 312us (615us total) trans 0 rc 0/0 00000100:00100000:0.0:1783964958.254792:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1783964958.254814:0:5809:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947436307b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae0997f7-3a15-4fc6-865a-35b2f101956e:5809:1870622732863616:0@lo:503: 00000100:00100000:1.0:1783964958.255310:0:7968:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947436307b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae0997f7-3a15-4fc6-865a-35b2f101956e:7968:1870622732863744:0@lo:502: 00000100:00100000:1.0:1783964958.255360:0:7968:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783964958.255390:0:7968:0:(client.c:2702:ptlrpc_set_wait()) set ffff947408b90780 going to sleep for 11 seconds 00000100:00100000:2.0:1783964958.255393:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732863744 00000100:00100000:2.0:1783964958.255398:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732863744 00000100:00100000:2.0:1783964958.255430:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1783964958.255437:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947408eca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae0997f7-3a15-4fc6-865a-35b2f101956e+14:7968:x1870622732863744:12345-0@lo:502: 00000100:00100000:2.0:1783964958.255737:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947408eca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae0997f7-3a15-4fc6-865a-35b2f101956e+14:7968:x1870622732863744:12345-0@lo:502: Request processed in 300us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1783964958.255744:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1783964958.255819:0:7968:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947436307b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae0997f7-3a15-4fc6-865a-35b2f101956e:7968:1870622732863744:0@lo:502: 00000100:00100000:0.0:1783964958.255861:0:7968:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947436336a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae0997f7-3a15-4fc6-865a-35b2f101956e:7968:1870622732863872:0@lo:502: 00000100:00100000:0.0:1783964958.255893:0:7968:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783964958.255912:0:7968:0:(client.c:2702:ptlrpc_set_wait()) set ffff947408caaf00 going to sleep for 11 seconds 00000100:00100000:2.0:1783964958.255953:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732863872 00000100:00100000:2.0:1783964958.255957:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732863872 00000100:00100000:2.0:1783964958.255983:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1783964958.255995:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947408eca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae0997f7-3a15-4fc6-865a-35b2f101956e+14:7968:x1870622732863872:12345-0@lo:502: 00000100:00100000:2.0:1783964958.256118:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947408eca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae0997f7-3a15-4fc6-865a-35b2f101956e+14:7968:x1870622732863872:12345-0@lo:502: Request processed in 122us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1783964958.256128:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1783964958.256153:0:7968:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947436336a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae0997f7-3a15-4fc6-865a-35b2f101956e:7968:1870622732863872:0@lo:502: 00000040:00080000:1.0:1783964958.256177:0:7968:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1783964958.256428:0:5809:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1783964958.256448:0:5809:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.112@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1783964958.256458:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.112@tcp lock: ffff947401482c00/0xe782b916994fd36b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fd372 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783964958.256469:0:5809:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.112@tcp lock: ffff947401482c00/0xe782b916994fd36b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fd372 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783964958.256479:0:5809:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1783964958.256493:0:5809:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:2.0:1783964958.256497:0:5809:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1783964958.256521:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.112@tcp lock: ffff947430c11400/0xe782b916994fd379 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783964958.256529:0:5809:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.112@tcp lock: ffff947430c11400/0xe782b916994fd379 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783964958.256538:0:5809:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.112@tcp lock: ffff947430c11400/0xe782b916994fd379 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783964958.256550:0:5809:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9474072a8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae0997f7-3a15-4fc6-865a-35b2f101956e:5809:1870622732864000:0@lo:101: 00000100:00100000:2.0:1783964958.256577:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783964958.256595:0:5809:0:(client.c:2702:ptlrpc_set_wait()) set ffff947425815840 going to sleep for 11 seconds 00000100:00100000:0.0:1783964958.256697:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732864000 00000100:00100000:0.0:1783964958.256702:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732864000 00000100:00100000:0.0:1783964958.256730:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1783964958.256737:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947408ec8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae0997f7-3a15-4fc6-865a-35b2f101956e+14:5809:x1870622732864000:12345-0@lo:101: 00010000:00010000:0.0:1783964958.256746:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783964958.256757:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff947400031600/0xe782b916994fd380 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe782b916994fd379 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964958.256778:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff947400031600/0xe782b916994fd380 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe782b916994fd379 expref: 15 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964958.256788:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff947400031600/0xe782b916994fd380 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe782b916994fd379 expref: 15 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964958.256796:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff947400031600, rc 0) 00000100:00100000:0.0:1783964958.256836:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947408ec8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae0997f7-3a15-4fc6-865a-35b2f101956e+15:5809:x1870622732864000:12345-0@lo:101: Request processed in 100us (259us total) trans 0 rc 0/0 00000100:00100000:0.0:1783964958.256842:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1783964958.256939:0:5809:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9474072a8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae0997f7-3a15-4fc6-865a-35b2f101956e:5809:1870622732864000:0@lo:101: 00010000:00010000:1.0:1783964958.256951:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.112@tcp lock: ffff947430c11400/0xe782b916994fd379 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fd380 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964958.256960:0:5809:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.112@tcp lock: ffff947430c11400/0xe782b916994fd379 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xe782b916994fd380 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783964958.257000:0:5809:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947436307100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae0997f7-3a15-4fc6-865a-35b2f101956e:5809:1870622732864128:0@lo:501: 00000100:00100000:1.0:1783964958.257025:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783964958.257085:0:5809:0:(client.c:2702:ptlrpc_set_wait()) set ffff94740b1f43c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783964958.257117:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732864128 00000100:00100000:0.0:1783964958.257122:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732864128 00000100:00100000:0.0:1783964958.257187:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1783964958.257194:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947408ec9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+15:5809:x1870622732864128:12345-0@lo:501: 00000100:00100000:0.0:1783964958.257453:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947408ec9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+15:5809:x1870622732864128:12345-0@lo:501: Request processed in 259us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1783964958.257459:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1783964958.257602:0:5809:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947436307100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae0997f7-3a15-4fc6-865a-35b2f101956e:5809:1870622732864128:0@lo:501: 00000100:00100000:1.0:1783964958.257625:0:5809:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947436307100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae0997f7-3a15-4fc6-865a-35b2f101956e:5809:1870622732864256:0@lo:503: 00000100:00100000:1.0:1783964958.257656:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783964958.258097:0:5809:0:(client.c:2702:ptlrpc_set_wait()) set ffff94740b1f43c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783964958.258170:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732864256 00000100:00100000:2.0:1783964958.258175:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732864256 00000100:00100000:3.0:1783964958.258455:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1783964958.258465:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947408eca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae0997f7-3a15-4fc6-865a-35b2f101956e+15:5809:x1870622732864256:12345-0@lo:503: 00000100:00100000:3.0:1783964958.258807:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947408eca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae0997f7-3a15-4fc6-865a-35b2f101956e+15:5809:x1870622732864256:12345-0@lo:503: Request processed in 344us (1149us total) trans 0 rc 0/0 00000100:00100000:3.0:1783964958.258814:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1783964958.258882:0:5809:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947436307100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae0997f7-3a15-4fc6-865a-35b2f101956e:5809:1870622732864256:0@lo:503: 00000100:00100000:1.0:1783964958.259347:0:7969:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947436307100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae0997f7-3a15-4fc6-865a-35b2f101956e:7969:1870622732864384:0@lo:502: 00000100:00100000:1.0:1783964958.259387:0:7969:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783964958.259694:0:7969:0:(client.c:2702:ptlrpc_set_wait()) set ffff94740b1f43c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783964958.259720:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732864384 00000100:00100000:0.0:1783964958.259725:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732864384 00000100:00100000:3.0:1783964958.259762:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1783964958.259770:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947408ec8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae0997f7-3a15-4fc6-865a-35b2f101956e+15:7969:x1870622732864384:12345-0@lo:502: 00000100:00100000:3.0:1783964958.259953:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947408ec8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae0997f7-3a15-4fc6-865a-35b2f101956e+15:7969:x1870622732864384:12345-0@lo:502: Request processed in 184us (564us total) trans 0 rc 0/0 00000100:00100000:3.0:1783964958.259960:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1783964958.260016:0:7969:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947436307100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae0997f7-3a15-4fc6-865a-35b2f101956e:7969:1870622732864384:0@lo:502: 00000020:01000000:1.0:1783964958.260039:0:7969:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783964958.260047:0:7969:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783964958.260053:0:7969:0:(obd_config.c:1561:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:1.0:1783964958.260058:0:7969:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1783964958.260060:0:7969:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1783964958.260073:0:7969:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947436307100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae0997f7-3a15-4fc6-865a-35b2f101956e:7969:1870622732864512:0@lo:502: 00000100:00100000:1.0:1783964958.260099:0:7969:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783964958.260218:0:7969:0:(client.c:2702:ptlrpc_set_wait()) set ffff9474259ee6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783964958.260295:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732864512 00000100:00100000:2.0:1783964958.260299:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732864512 00000100:00100000:2.0:1783964958.260329:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1783964958.260335:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947408ec8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae0997f7-3a15-4fc6-865a-35b2f101956e+15:7969:x1870622732864512:12345-0@lo:502: 00000100:00100000:2.0:1783964958.260456:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947408ec8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae0997f7-3a15-4fc6-865a-35b2f101956e+15:7969:x1870622732864512:12345-0@lo:502: Request processed in 120us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1783964958.260462:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1783964958.260585:0:7969:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947436307100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae0997f7-3a15-4fc6-865a-35b2f101956e:7969:1870622732864512:0@lo:502: 00000020:01000000:1.0:1783964958.260605:0:7969:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783964958.260609:0:7969:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783964958.260610:0:7969:0:(obd_config.c:1561:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:1.0:1783964958.260614:0:7969:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:2.0:1783964958.260784:0:5809:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:2.0:1783964958.260803:0:5809:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.112@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1783964958.260811:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.112@tcp lock: ffff947430c11400/0xe782b916994fd379 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fd380 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783964958.260821:0:5809:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.112@tcp lock: ffff947430c11400/0xe782b916994fd379 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fd380 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783964958.260830:0:5809:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1783964958.260833:0:5809:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff947403dc3000 from 30 10000000:01000000:2.0:1783964958.260836:0:5809:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1783964958.260857:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.112@tcp lock: ffff947430c10000/0xe782b916994fd387 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783964958.260865:0:5809:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.112@tcp lock: ffff947430c10000/0xe782b916994fd387 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783964958.260874:0:5809:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.112@tcp lock: ffff947430c10000/0xe782b916994fd387 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783964958.260888:0:5809:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9474072abb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae0997f7-3a15-4fc6-865a-35b2f101956e:5809:1870622732864640:0@lo:101: 00000100:00100000:2.0:1783964958.260914:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783964958.260943:0:5809:0:(client.c:2702:ptlrpc_set_wait()) set ffff947425815840 going to sleep for 11 seconds 00000100:00100000:1.0:1783964958.260986:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732864640 00000100:00100000:1.0:1783964958.260990:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732864640 00000100:00100000:1.0:1783964958.261010:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1783964958.261016:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947408ecac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae0997f7-3a15-4fc6-865a-35b2f101956e+15:5809:x1870622732864640:12345-0@lo:101: 00010000:00010000:1.0:1783964958.261024:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783964958.261036:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff947401482a00/0xe782b916994fd38e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xe782b916994fd387 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964958.261054:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff947401482a00/0xe782b916994fd38e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe782b916994fd387 expref: 16 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964958.261063:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff947401482a00/0xe782b916994fd38e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe782b916994fd387 expref: 16 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964958.261071:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff947401482a00, rc 0) 00000100:00100000:1.0:1783964958.261105:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947408ecac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae0997f7-3a15-4fc6-865a-35b2f101956e+16:5809:x1870622732864640:12345-0@lo:101: Request processed in 89us (189us total) trans 0 rc 0/0 00000100:00100000:1.0:1783964958.261110:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1783964958.261162:0:5809:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9474072abb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae0997f7-3a15-4fc6-865a-35b2f101956e:5809:1870622732864640:0@lo:101: 00010000:00010000:2.0:1783964958.261173:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.112@tcp lock: ffff947430c10000/0xe782b916994fd387 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fd38e expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783964958.261181:0:5809:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.112@tcp lock: ffff947430c10000/0xe782b916994fd387 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xe782b916994fd38e expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783964958.261251:0:5809:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9474072abb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae0997f7-3a15-4fc6-865a-35b2f101956e:5809:1870622732864768:0@lo:501: 00000100:00100000:2.0:1783964958.261274:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783964958.261288:0:5809:0:(client.c:2702:ptlrpc_set_wait()) set ffff947425815840 going to sleep for 11 seconds 00000100:00100000:1.0:1783964958.261350:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732864768 00000100:00100000:1.0:1783964958.261359:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732864768 00000100:00100000:1.0:1783964958.261376:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1783964958.261381:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947408ec9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae0997f7-3a15-4fc6-865a-35b2f101956e+16:5809:x1870622732864768:12345-0@lo:501: 00000100:00100000:1.0:1783964958.261590:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947408ec9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae0997f7-3a15-4fc6-865a-35b2f101956e+16:5809:x1870622732864768:12345-0@lo:501: Request processed in 208us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1783964958.261597:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1783964958.261876:0:5809:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9474072abb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae0997f7-3a15-4fc6-865a-35b2f101956e:5809:1870622732864768:0@lo:501: 00000100:00100000:2.0:1783964958.261901:0:5809:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9474072abb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae0997f7-3a15-4fc6-865a-35b2f101956e:5809:1870622732864896:0@lo:503: 00000100:00100000:2.0:1783964958.261935:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783964958.261962:0:5809:0:(client.c:2702:ptlrpc_set_wait()) set ffff947425815840 going to sleep for 11 seconds 00000100:00100000:1.0:1783964958.262004:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732864896 00000100:00100000:1.0:1783964958.262008:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732864896 00000100:00100000:1.0:1783964958.262024:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1783964958.262030:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947408ecbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae0997f7-3a15-4fc6-865a-35b2f101956e+16:5809:x1870622732864896:12345-0@lo:503: 00000100:00100000:1.0:1783964958.262166:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947408ecbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae0997f7-3a15-4fc6-865a-35b2f101956e+16:5809:x1870622732864896:12345-0@lo:503: Request processed in 135us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1783964958.262172:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1783964958.262280:0:5809:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9474072abb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae0997f7-3a15-4fc6-865a-35b2f101956e:5809:1870622732864896:0@lo:503: 00000100:00100000:2.0:1783964958.262624:0:7970:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9474072abb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae0997f7-3a15-4fc6-865a-35b2f101956e:7970:1870622732865024:0@lo:502: 00000100:00100000:2.0:1783964958.262657:0:7970:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783964958.262684:0:7970:0:(client.c:2702:ptlrpc_set_wait()) set ffff94741ce2ccc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783964958.262720:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732865024 00000100:00100000:1.0:1783964958.262725:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732865024 00000100:00100000:1.0:1783964958.262742:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1783964958.262747:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947408ec9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae0997f7-3a15-4fc6-865a-35b2f101956e+16:7970:x1870622732865024:12345-0@lo:502: 00000100:00100000:1.0:1783964958.262904:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947408ec9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae0997f7-3a15-4fc6-865a-35b2f101956e+16:7970:x1870622732865024:12345-0@lo:502: Request processed in 156us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1783964958.262910:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1783964958.263111:0:7970:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9474072abb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae0997f7-3a15-4fc6-865a-35b2f101956e:7970:1870622732865024:0@lo:502: 00000100:00100000:2.0:1783964958.263146:0:7970:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9474072abb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae0997f7-3a15-4fc6-865a-35b2f101956e:7970:1870622732865152:0@lo:502: 00000100:00100000:2.0:1783964958.263173:0:7970:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783964958.263192:0:7970:0:(client.c:2702:ptlrpc_set_wait()) set ffff94741ce2ccc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783964958.263259:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732865152 00000100:00100000:1.0:1783964958.263263:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732865152 00000100:00100000:1.0:1783964958.263281:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1783964958.263285:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947408ecb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae0997f7-3a15-4fc6-865a-35b2f101956e+16:7970:x1870622732865152:12345-0@lo:502: 00000100:00100000:1.0:1783964958.263503:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947408ecb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae0997f7-3a15-4fc6-865a-35b2f101956e+16:7970:x1870622732865152:12345-0@lo:502: Request processed in 216us (329us total) trans 0 rc 0/0 00000100:00100000:1.0:1783964958.263508:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1783964958.263575:0:7970:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9474072abb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae0997f7-3a15-4fc6-865a-35b2f101956e:7970:1870622732865152:0@lo:502: 00000040:00080000:2.0:1783964958.263593:0:7970:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:1.0:1783964958.263732:0:5809:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:1.0:1783964958.263753:0:5809:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.112@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1783964958.263762:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.112@tcp lock: ffff947430c10000/0xe782b916994fd387 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fd38e expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964958.263773:0:5809:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.112@tcp lock: ffff947430c10000/0xe782b916994fd387 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fd38e expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783964958.263782:0:5809:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1783964958.263785:0:5809:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff947403dc3000 from 5 10000000:01000000:1.0:1783964958.263788:0:5809:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1783964958.263811:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.112@tcp lock: ffff947401482200/0xe782b916994fd395 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964958.263818:0:5809:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.112@tcp lock: ffff947401482200/0xe782b916994fd395 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964958.263826:0:5809:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.112@tcp lock: ffff947401482200/0xe782b916994fd395 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783964958.263837:0:5809:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947436307100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae0997f7-3a15-4fc6-865a-35b2f101956e:5809:1870622732865280:0@lo:101: 00000100:00100000:1.0:1783964958.263863:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783964958.263893:0:5809:0:(client.c:2702:ptlrpc_set_wait()) set ffff9473048cc480 going to sleep for 11 seconds 00000100:00100000:2.0:1783964958.263929:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732865280 00000100:00100000:2.0:1783964958.263938:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732865280 00000100:00100000:2.0:1783964958.263956:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1783964958.263962:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947408ecb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae0997f7-3a15-4fc6-865a-35b2f101956e+16:5809:x1870622732865280:12345-0@lo:101: 00010000:00010000:2.0:1783964958.263971:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783964958.263984:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff947430c11600/0xe782b916994fd39c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe782b916994fd395 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783964958.264003:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff947430c11600/0xe782b916994fd39c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe782b916994fd395 expref: 17 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783964958.264013:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff947430c11600/0xe782b916994fd39c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe782b916994fd395 expref: 17 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783964958.264022:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff947430c11600, rc 0) 00000100:00100000:2.0:1783964958.264058:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947408ecb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae0997f7-3a15-4fc6-865a-35b2f101956e+17:5809:x1870622732865280:12345-0@lo:101: Request processed in 97us (194us total) trans 0 rc 0/0 00000100:00100000:2.0:1783964958.264064:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1783964958.264123:0:5809:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947436307100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae0997f7-3a15-4fc6-865a-35b2f101956e:5809:1870622732865280:0@lo:101: 00010000:00010000:1.0:1783964958.264133:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.112@tcp lock: ffff947401482200/0xe782b916994fd395 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fd39c expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964958.264142:0:5809:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.112@tcp lock: ffff947401482200/0xe782b916994fd395 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe782b916994fd39c expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783964958.264191:0:5809:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947436307100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae0997f7-3a15-4fc6-865a-35b2f101956e:5809:1870622732865408:0@lo:256: 00000100:00100000:1.0:1783964958.264258:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783964958.264278:0:5809:0:(client.c:2702:ptlrpc_set_wait()) set ffff9473048cc480 going to sleep for 11 seconds 00000100:00100000:2.0:1783964958.264410:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732865408 00000100:00100000:2.0:1783964958.264414:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732865408 00000100:00100000:2.0:1783964958.264430:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1783964958.264436:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947408ecb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae0997f7-3a15-4fc6-865a-35b2f101956e+17:5809:x1870622732865408:12345-0@lo:256: 20000000:01000000:2.0:1783964958.264449:0:5806:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1783964958.264464:0:5806:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1783964958.264467:0:5806:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:2.0:1783964958.264551:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947408ecb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae0997f7-3a15-4fc6-865a-35b2f101956e+17:5809:x1870622732865408:12345-0@lo:256: Request processed in 115us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1783964958.264558:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1783964958.264586:0:5809:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947436307100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae0997f7-3a15-4fc6-865a-35b2f101956e:5809:1870622732865408:0@lo:256: 10000000:01000000:2.0:1783964958.264626:0:5809:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.112@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1783964958.264635:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.112@tcp lock: ffff947401482200/0xe782b916994fd395 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fd39c expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783964958.264643:0:5809:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.112@tcp lock: ffff947401482200/0xe782b916994fd395 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fd39c expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783964958.264650:0:5809:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1783964958.264651:0:5809:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:2.0:1783964958.264653:0:5809:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1783964958.264670:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.112@tcp lock: ffff947430c11000/0xe782b916994fd3a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783964958.264677:0:5809:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.112@tcp lock: ffff947430c11000/0xe782b916994fd3a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783964958.264684:0:5809:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.112@tcp lock: ffff947430c11000/0xe782b916994fd3a3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783964958.264695:0:5809:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9474072abb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae0997f7-3a15-4fc6-865a-35b2f101956e:5809:1870622732865536:0@lo:101: 00000100:00100000:2.0:1783964958.264719:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783964958.264732:0:5809:0:(client.c:2702:ptlrpc_set_wait()) set ffff94741ce2c240 going to sleep for 11 seconds 00000100:00100000:2.0:1783964958.264743:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732865536 00000100:00100000:2.0:1783964958.264746:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732865536 00000100:00100000:2.0:1783964958.264763:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1783964958.264768:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947405adfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae0997f7-3a15-4fc6-865a-35b2f101956e+17:5809:x1870622732865536:12345-0@lo:101: 00010000:00010000:2.0:1783964958.264774:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783964958.264796:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff947425975600/0xe782b916994fd3aa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xe782b916994fd3a3 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783964958.264812:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff947425975600/0xe782b916994fd3aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe782b916994fd3a3 expref: 18 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783964958.264825:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff947425975600/0xe782b916994fd3aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe782b916994fd3a3 expref: 18 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783964958.264831:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff947425975600, rc 0) 00000100:00100000:2.0:1783964958.264858:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947405adfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae0997f7-3a15-4fc6-865a-35b2f101956e+18:5809:x1870622732865536:12345-0@lo:101: Request processed in 90us (139us total) trans 0 rc 0/0 00000100:00100000:2.0:1783964958.264865:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1783964958.264892:0:5809:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9474072abb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae0997f7-3a15-4fc6-865a-35b2f101956e:5809:1870622732865536:0@lo:101: 00010000:00010000:2.0:1783964958.264903:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.112@tcp lock: ffff947430c11000/0xe782b916994fd3a3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fd3aa expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783964958.264911:0:5809:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.112@tcp lock: ffff947430c11000/0xe782b916994fd3a3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xe782b916994fd3aa expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783964958.264950:0:5809:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9474072abb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae0997f7-3a15-4fc6-865a-35b2f101956e:5809:1870622732865664:0@lo:501: 00000100:00100000:2.0:1783964958.264974:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783964958.264986:0:5809:0:(client.c:2702:ptlrpc_set_wait()) set ffff94741ce2c240 going to sleep for 11 seconds 00000100:00100000:2.0:1783964958.264997:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732865664 00000100:00100000:2.0:1783964958.264999:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732865664 00000100:00100000:2.0:1783964958.265014:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1783964958.265020:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947405add850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae0997f7-3a15-4fc6-865a-35b2f101956e+18:5809:x1870622732865664:12345-0@lo:501: 00000100:00100000:2.0:1783964958.265254:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947405add850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae0997f7-3a15-4fc6-865a-35b2f101956e+18:5809:x1870622732865664:12345-0@lo:501: Request processed in 233us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1783964958.265260:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1783964958.265297:0:5809:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9474072abb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae0997f7-3a15-4fc6-865a-35b2f101956e:5809:1870622732865664:0@lo:501: 00000100:00100000:3.0:1783964958.265700:0:5809:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9474072abb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae0997f7-3a15-4fc6-865a-35b2f101956e:5809:1870622732865792:0@lo:503: 00000100:00100000:3.0:1783964958.265739:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783964958.265790:0:5809:0:(client.c:2702:ptlrpc_set_wait()) set ffff94741cc02c00 going to sleep for 11 seconds 00000100:00100000:2.0:1783964958.265823:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732865792 00000100:00100000:2.0:1783964958.265831:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732865792 00000100:00100000:2.0:1783964958.266093:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1783964958.266101:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947405adf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae0997f7-3a15-4fc6-865a-35b2f101956e+18:5809:x1870622732865792:12345-0@lo:503: 00000100:00100000:2.0:1783964958.266461:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947405adf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae0997f7-3a15-4fc6-865a-35b2f101956e+18:5809:x1870622732865792:12345-0@lo:503: Request processed in 360us (720us total) trans 0 rc 0/0 00000100:00100000:2.0:1783964958.266466:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1783964958.266545:0:5809:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9474072abb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae0997f7-3a15-4fc6-865a-35b2f101956e:5809:1870622732865792:0@lo:503: 00000100:00100000:3.0:1783964958.267000:0:7971:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9474368d5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae0997f7-3a15-4fc6-865a-35b2f101956e:7971:1870622732865920:0@lo:502: 00000100:00100000:3.0:1783964958.267038:0:7971:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783964958.267135:0:7971:0:(client.c:2702:ptlrpc_set_wait()) set ffff94741cc026c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783964958.267238:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732865920 00000100:00100000:0.0:1783964958.267243:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732865920 00000100:00100000:0.0:1783964958.267271:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1783964958.267277:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947405adf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+18:7971:x1870622732865920:12345-0@lo:502: 00000100:00100000:0.0:1783964958.267545:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947405adf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+18:7971:x1870622732865920:12345-0@lo:502: Request processed in 268us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1783964958.267551:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1783964958.267694:0:7971:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9474368d5180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae0997f7-3a15-4fc6-865a-35b2f101956e:7971:1870622732865920:0@lo:502: 00000020:01000000:3.0:1783964958.267720:0:7971:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1783964958.267728:0:7971:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1783964958.267735:0:7971:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783964958.267737:0:7971:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1783964958.267743:0:7971:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1783964958.267746:0:7971:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.112@tcp to nid 0x20000c0a8cc70 (192.168.204.112@tcp) 00000020:01000000:3.0:1783964958.267770:0:7971:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1783964958.267773:0:7971:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1783964958.267789:0:7971:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff947305034d40) 00000020:00000080:3.0:1783964958.267812:0:7971:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:3.0:1783964958.267817:0:7971:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1783964958.267890:0:7971:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1783964958.267896:0:7971:0:(osd_handler.c:1569:osd_obd_connect()) connect #6 00000020:00000080:3.0:1783964958.267906:0:7971:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe782b916994fd3b8 00010000:00080000:3.0:1783964958.267936:0:7971:0:(ldlm_lib.c:102:import_set_conn()) imp ffff947405907800@lustre-OST0001-osc-MDT0000: add connection 192.168.204.112@tcp at head 00010000:00010000:3.0:1783964958.268162:0:7971:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:3.0:1783964958.268553:0:7971:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:3.0:1783964958.268564:0:7971:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1783964958.269106:0:7971:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783964958.269345:0:7971:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783964958.269394:0:7971:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:3.0:1783964958.269468:0:7971:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:0.0:1783964958.275473:0:7972:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1783964958.275489:0:7972:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1783964958.276518:0:7971:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1783964958.276533:0:7971:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1783964958.276567:0:7971:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1783964958.276592:0:7971:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe782b916994fd3bf 00000100:00080000:3.0:1783964958.276603:0:7971:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1783964958.276610:0:7971:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff947405907800 using connection 192.168.204.112@tcp/0@lo 00000100:00100000:3.0:1783964958.276649:0:7971:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9474368d5180 x1870622732866048/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783964958.276678:0:7971:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:3.0:1783964958.276781:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9474368d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3325:1870622732866304:0@lo:400: 00000100:00100000:3.0:1783964958.276846:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783964958.276881:0:3325:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783964958.276887:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9474368d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3325:1870622732866176:0@lo:400: 00000100:00100000:3.0:1783964958.276908:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783964958.276929:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9474368d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3322:1870622732866432:0@lo:400: 00000100:00100000:3.0:1783964958.276951:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783964958.276969:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783964958.276973:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9474368d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3322:1870622732866560:0@lo:400: 00000100:00100000:3.0:1783964958.276998:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783964958.277024:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732866304 00000100:00100000:3.0:1783964958.277030:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732866304 00000100:00100000:3.0:1783964958.277077:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732866176 00000100:00100000:3.0:1783964958.277080:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732866176 00000100:00100000:3.0:1783964958.277093:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732866560 00000100:00100000:3.0:1783964958.277095:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732866560 00000100:00100000:3.0:1783964958.277112:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1783964958.277119:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9474368d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3325:x1870622732866304:12345-0@lo:400: 00000100:00100000:3.0:1783964958.277177:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9474368d5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3325:x1870622732866304:12345-0@lo:400: Request processed in 58us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1783964958.277185:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1783964958.277224:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1783964958.277231:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9474368d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3325:x1870622732866176:12345-0@lo:400: 00000100:00100000:3.0:1783964958.277257:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9474368d4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3325:x1870622732866176:12345-0@lo:400: Request processed in 27us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1783964958.277263:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1783964958.277273:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1783964958.277278:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9474368d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3322:x1870622732866560:12345-0@lo:400: 00000100:00100000:3.0:1783964958.277309:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9474368d7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3322:x1870622732866560:12345-0@lo:400: Request processed in 31us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1783964958.277314:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1783964958.277347:0:6609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732866432 00000100:00100000:3.0:1783964958.277350:0:6609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732866432 00000100:00100000:3.0:1783964958.277376:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783964958.277381:0:6609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9474368d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3322:x1870622732866432:12345-0@lo:400: 00000100:00100000:3.0:1783964958.277409:0:6609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9474368d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3322:x1870622732866432:12345-0@lo:400: Request processed in 28us (457us total) trans 0 rc 0/0 00000100:00100000:3.0:1783964958.277414:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1783964958.277430:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783964958.277434:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1783964958.277462:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9474368d5f80 x1870622732866560/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783964974 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783964958.277476:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9474368d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3322:1870622732866560:0@lo:400: 00010000:00080000:3.0:1783964958.277500:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9474368d6300 x1870622732866432/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783964974 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783964958.277514:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9474368d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3322:1870622732866432:0@lo:400: 00010000:00080000:3.0:1783964958.277545:0:3325:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9474368d7100 x1870622732866176/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783964974 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783964958.277554:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9474368d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3325:1870622732866176:0@lo:400: 00010000:00080000:3.0:1783964958.277563:0:3325:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9474368d5880 x1870622732866304/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783964974 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783964958.277570:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9474368d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3325:1870622732866304:0@lo:400: 00000020:01000000:3.0:1783964958.277620:0:7971:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783964958.277625:0:7971:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783964958.277627:0:7971:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1783964958.277630:0:7971:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783964958.277634:0:7971:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783964958.277635:0:7971:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:3.0:1783964958.277638:0:7971:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1783964958.277640:0:7971:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1783964958.277662:0:7971:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9474368d5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae0997f7-3a15-4fc6-865a-35b2f101956e:7971:1870622732866688:0@lo:502: 00000100:00100000:3.0:1783964958.277701:0:7971:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783964958.277722:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732866688 00000100:00100000:3.0:1783964958.277725:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732866688 00000100:00100000:3.0:1783964958.277743:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1783964958.277749:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947405adf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+18:7971:x1870622732866688:12345-0@lo:502: 00000100:00100000:3.0:1783964958.277959:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947405adf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+18:7971:x1870622732866688:12345-0@lo:502: Request processed in 210us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1783964958.277965:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1783964958.278007:0:7971:0:(client.c:2702:ptlrpc_set_wait()) set ffff94741cc02180 going to sleep for 11 seconds 00000100:00100000:3.0:1783964958.278019:0:7971:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9474368d5880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae0997f7-3a15-4fc6-865a-35b2f101956e:7971:1870622732866688:0@lo:502: 00000020:01000000:3.0:1783964958.278043:0:7971:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783964958.278047:0:7971:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783964958.278048:0:7971:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:3.0:1783964958.278051:0:7971:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:3.0:1783964958.278113:0:5809:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:3.0:1783964958.278131:0:5809:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.112@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1783964958.278141:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.112@tcp lock: ffff947430c11000/0xe782b916994fd3a3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fd3aa expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964958.278151:0:5809:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.112@tcp lock: ffff947430c11000/0xe782b916994fd3a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fd3aa expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783964958.278160:0:5809:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1783964958.278162:0:5809:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff947407224d40 from 1 10000000:01000000:3.0:1783964958.278165:0:5809:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1783964958.278188:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.112@tcp lock: ffff9474420fe600/0xe782b916994fd3c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964958.278196:0:5809:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.112@tcp lock: ffff9474420fe600/0xe782b916994fd3c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964958.278234:0:5809:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.112@tcp lock: ffff9474420fe600/0xe782b916994fd3c6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783964958.278245:0:5809:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9474368d5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae0997f7-3a15-4fc6-865a-35b2f101956e:5809:1870622732866816:0@lo:101: 00000100:00100000:3.0:1783964958.278272:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783964958.278286:0:5809:0:(client.c:2702:ptlrpc_set_wait()) set ffff94741cc02180 going to sleep for 11 seconds 00000100:00100000:3.0:1783964958.278297:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732866816 00000100:00100000:0.0:1783964958.278641:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9474368d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3321:1870622732866048:0@lo:8: 00000100:00100000:0.0:1783964958.278678:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783964958.278882:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732866048 00000100:00100000:2.0:1783964958.278888:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732866048 00000100:00100000:2.0:1783964958.278912:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783964958.278917:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436334700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3321:x1870622732866048:12345-0@lo:8: 00010000:00080000:2.0:1783964958.278940:0:6608:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 192 last 0 00000020:00000080:2.0:1783964958.278972:0:6608:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe782b916994fd3cd 00002000:00100000:2.0:1783964958.278986:0:6608:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff947304b9a800 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136a2 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1783964958.278990:0:6608:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:2.0:1783964958.278994:0:6608:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:2.0:1783964958.279101:0:6608:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1783964958.279271:0:6608:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1783964958.279298:0:6608:0:(import.c:65:import_set_state_nolock()) ffff947304b9f800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783964958.279473:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436334700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3321:x1870622732866048:12345-0@lo:8: Request processed in 553us (793us total) trans 0 rc 0/0 00000100:00100000:2.0:1783964958.279489:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1783964958.279587:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9474368d5180 x1870622732866048/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783964968 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783964958.279597:0:3321:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1783964958.279604:0:3321:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1783964958.279611:0:3321:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1783964958.279617:0:3321:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1783964958.279619:0:3321:0:(import.c:65:import_set_state_nolock()) ffff947405907800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1783964958.279631:0:3321:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1783964958.279637:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9474368d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3321:1870622732866048:0@lo:8: 00000004:00080000:0.0:1783964958.279673:0:7972:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1783964958.279775:0:7972:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 192508572805ns, next at 0ns, rc = 0 00000100:00100000:3.0:1783964958.279937:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732866816 00000100:00100000:3.0:1783964958.279967:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1783964958.279980:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947405adcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+18:5809:x1870622732866816:12345-0@lo:101: 00010000:00010000:3.0:1783964958.279990:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783964958.280006:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9474420fee00/0xe782b916994fd3d4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xe782b916994fd3c6 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964958.280030:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9474420fee00/0xe782b916994fd3d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe782b916994fd3c6 expref: 19 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964958.280041:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9474420fee00/0xe782b916994fd3d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe782b916994fd3c6 expref: 19 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964958.280050:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9474420fee00, rc 0) 00000100:00100000:3.0:1783964958.280140:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947405adcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+19:5809:x1870622732866816:12345-0@lo:101: Request processed in 160us (1866us total) trans 0 rc 0/0 00000100:00100000:3.0:1783964958.280147:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1783964958.287703:0:5809:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9474368d5880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae0997f7-3a15-4fc6-865a-35b2f101956e:5809:1870622732866816:0@lo:101: 00010000:00010000:0.0:1783964958.287734:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.112@tcp lock: ffff9474420fe600/0xe782b916994fd3c6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fd3d4 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964958.287748:0:5809:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.112@tcp lock: ffff9474420fe600/0xe782b916994fd3c6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xe782b916994fd3d4 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783964958.287832:0:5809:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947436337b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae0997f7-3a15-4fc6-865a-35b2f101956e:5809:1870622732866944:0@lo:501: 00000100:00100000:0.0:1783964958.287890:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783964958.287928:0:5809:0:(client.c:2702:ptlrpc_set_wait()) set ffff947408caa000 going to sleep for 11 seconds 00000100:00100000:3.0:1783964958.288026:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732866944 00000100:00100000:3.0:1783964958.288034:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732866944 00000100:00100000:3.0:1783964958.288077:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1783964958.288086:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947405add450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+19:5809:x1870622732866944:12345-0@lo:501: 00000100:00100000:3.0:1783964958.288420:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947405add450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+19:5809:x1870622732866944:12345-0@lo:501: Request processed in 333us (527us total) trans 0 rc -2/-2 00000100:00100000:3.0:1783964958.288428:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1783964958.288469:0:5809:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947436337b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae0997f7-3a15-4fc6-865a-35b2f101956e:5809:1870622732866944:0@lo:501: 10000000:01000000:3.0:1783964958.288507:0:5809:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.112@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1783964958.288514:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.112@tcp lock: ffff9474420fe600/0xe782b916994fd3c6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fd3d4 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964958.288523:0:5809:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.112@tcp lock: ffff9474420fe600/0xe782b916994fd3c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fd3d4 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783964958.343344:0:5835:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:0.0:1783964958.344280:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9474072ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3324:1870622732867072:0@lo:13: 00000100:00100000:0.0:1783964958.344641:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:2.0:1783964958.344799:0:7973:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:2.0:1783964958.344825:0:7973:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9474072aad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7973:1870622732867200:0@lo:7: 00000100:00100000:2.0:1783964958.344864:0:7973:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783964958.344923:0:7973:0:(client.c:2702:ptlrpc_set_wait()) set ffff94741cca0f00 going to sleep for 11 seconds 00000100:00100000:3.0:1783964958.345103:0:6610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732867072 00000100:00100000:3.0:1783964958.345110:0:6610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732867072 00000100:00100000:0.0:1783964958.345602:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732867200 00000100:00100000:0.0:1783964958.345608:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732867200 00000100:00100000:0.0:1783964958.345666:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783964958.345676:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9474072a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:7973:x1870622732867200:12345-0@lo:7: 00000100:00080000:2.0:1783964958.347732:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783964958.348042:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783964958.348054:0:6610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436336d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3324:x1870622732867072:12345-0@lo:13: 00002000:00000024:3.0:1783964958.348082:0:6610:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:3.0:1783964958.349553:0:6610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436336d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3324:x1870622732867072:12345-0@lo:13: Request processed in 1497us (4907us total) trans 0 rc 0/0 00000100:00100000:3.0:1783964958.349565:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1783964958.352082:0:3324:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9474072ab100 x1870622732867072/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783964974 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783964958.352111:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9474072ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3324:1870622732867072:0@lo:13: 00002000:00080000:3.0:1783964958.364070:0:6606:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:3.0:1783964958.364079:0:6606:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:3.0:1783964958.364183:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9474072a8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7973:x1870622732867200:12345-0@lo:7: Request processed in 18504us (19312us total) trans 0 rc 0/0 00000100:00100000:3.0:1783964958.364195:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1783964958.364591:0:7973:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9474072aad80 x1870622732867200/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1783964974 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783964958.364618:0:7973:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9474072aad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7973:1870622732867200:0@lo:7: 00000004:00080000:2.0:1783964958.364634:0:7973:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:2.0:1783964958.364672:0:7973:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9474072aad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7973:1870622732867328:0@lo:5: 00000100:00100000:2.0:1783964958.364704:0:7973:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783964958.364768:0:7973:0:(client.c:2702:ptlrpc_set_wait()) set ffff94741cca0f00 going to sleep for 11 seconds 00000100:00100000:0.0:1783964958.364846:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732867328 00000100:00100000:0.0:1783964958.364853:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732867328 00000100:00100000:0.0:1783964958.364899:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783964958.364909:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9474072a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7973:x1870622732867328:12345-0@lo:5: 00002000:00080000:0.0:1783964958.364936:0:6608:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:0.0:1783964958.364940:0:6608:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:0.0:1783964958.365176:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9474072a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:7973:x1870622732867328:12345-0@lo:5: Request processed in 268us (470us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1783964958.365190:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1783964958.365502:0:7973:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9474072aad80 x1870622732867328/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783964974 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783964958.365514:0:7973:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9474072aad80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7973:1870622732867328:0@lo:5: 00000004:00080000:2.0:1783964958.365522:0:7973:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:2.0:1783964958.365547:0:7973:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9474072aa300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7973:1870622732867456:0@lo:700: 00000100:00100000:2.0:1783964958.365573:0:7973:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783964958.365596:0:7973:0:(client.c:2702:ptlrpc_set_wait()) set ffff94741cca0f00 going to sleep for 11 seconds 00000100:00100000:0.0:1783964958.365694:0:6615:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732867456 00000100:00100000:0.0:1783964958.365698:0:6615:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732867456 00000100:00100000:0.0:1783964958.365729:0:6615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783964958.365736:0:6615:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9474072ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7973:x1870622732867456:12345-0@lo:700: 00000100:00100000:0.0:1783964958.365764:0:6615:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947436334000 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6615:1870622732867584:0@lo:700: 00000100:00100000:0.0:1783964958.365791:0:6615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783964958.365812:0:6615:0:(client.c:2702:ptlrpc_set_wait()) set ffff94743fa8b3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783964958.365900:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732867584 00000100:00100000:1.0:1783964958.365904:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732867584 00000100:00100000:1.0:1783964958.365939:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783964958.365947:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436335f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6615:x1870622732867584:12345-0@lo:700: 00010000:00010000:3.0:1783964958.386122:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 40000000:02000000:3.0:1783964958.414437:0:5818:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:3.0:1783964958.424681:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436335f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6615:x1870622732867584:12345-0@lo:700: Request processed in 58724us (58877us total) trans 0 rc 0/0 00000100:00100000:3.0:1783964958.424704:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1783964958.424982:0:6615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff947436334000 x1870622732867584/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1783964974 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783964958.424998:0:6615:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947436334000 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6615:1870622732867584:0@lo:700: 40000000:02000000:1.0:1783964958.425012:0:6615:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000001:00080000:2.0:1783964958.531089:0:7523:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:2.0:1783964958.531137:0:7523:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1783964958.531828:0:6615:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9474072ab100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:7973:x1870622732867456:12345-0@lo:700: Request processed in 166088us (166249us total) trans 0 rc 0/0 00000100:00100000:3.0:1783964958.531842:0:6615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1783964958.532149:0:7973:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9474072aa300 x1870622732867456/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1783964974 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783964958.532161:0:7973:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1783964958.532181:0:7973:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9474072aa300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7973:1870622732867456:0@lo:700: 00000004:02000040:0.0:1783964958.564801:0:7973:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:1.0:1783964958.575661:0:7973:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947436307100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7973:1870622732867712:0@lo:5: 00000100:00100000:1.0:1783964958.575754:0:7973:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783964958.575838:0:7973:0:(client.c:2702:ptlrpc_set_wait()) set ffff9473048c2840 going to sleep for 11 seconds 00000100:00100000:3.0:1783964958.576121:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732867712 00000100:00100000:3.0:1783964958.576129:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732867712 00000100:00100000:3.0:1783964958.576189:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1783964958.576221:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436307b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:7973:x1870622732867712:12345-0@lo:5: 00002000:00080000:3.0:1783964958.584397:0:6606:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:3.0:1783964958.584425:0:6606:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:3.0:1783964958.590862:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436307b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7973:x1870622732867712:12345-0@lo:5: Request processed in 14656us (15101us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1783964958.590875:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:1.0:1783964958.591005:0:7973:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff947436307100 x1870622732867712/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1783964974 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783964958.591024:0:7973:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947436307100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7973:1870622732867712:0@lo:5: 00000004:00080000:1.0:1783964958.591040:0:7973:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:1.0:1783964959.403695:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783964960.299528:0:3324:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783964960.299558:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9474072aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3324:1870622732867840:0@lo:13: 00000100:00100000:3.0:1783964960.299628:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783964960.299838:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732867840 00000100:00100000:2.0:1783964960.299847:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732867840 00000100:00100000:2.0:1783964960.299986:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783964960.299996:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9474368d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3324:x1870622732867840:12345-0@lo:13: 00002000:00000024:2.0:1783964960.300035:0:6611:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783964960.300086:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9474368d7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3324:x1870622732867840:12345-0@lo:13: Request processed in 92us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1783964960.300103:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1783964960.300149:0:3324:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9474072aa300 x1870622732867840/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783964976 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783964960.300168:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9474072aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3324:1870622732867840:0@lo:13: 00000100:00080000:3.0:1783964960.300266:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1783964960.428554:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1783964961.312263:0:7523:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:2.0:1783964961.452964:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783964961.834783:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783964961.835542:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715019392 00000100:00100000:2.0:1783964961.835555:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715019392 00000100:00100000:2.0:1783964961.835605:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 110 00000100:00100000:2.0:1783964961.835613:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947405ade050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2356:x1870622715019392:12345-192.168.204.12@tcp:250: 00010000:00080000:2.0:1783964961.835643:0:5806:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from 56dff3de-fa1d-4c82-b4b6-6be55f741fe3@192.168.204.12@tcp t0 exp 0000000000000000 cur 196 last 0 00000020:00000080:2.0:1783964961.835671:0:5806:0:(genops.c:1406:class_connect()) connect: client 56dff3de-fa1d-4c82-b4b6-6be55f741fe3, cookie 0xe782b916994fd3db 00000100:00080000:2.0:1783964961.835818:0:5806:0:(import.c:65:import_set_state_nolock()) ffff947304b9c000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783964961.836449:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947405ade050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+5:2356:x1870622715019392:12345-192.168.204.12@tcp:250: Request processed in 832us (1716us total) trans 0 rc 0/0 00000100:00100000:2.0:1783964961.836459:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 110 00000100:00100000:2.0:1783964961.841256:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783964961.841324:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715019520 00000100:00100000:1.0:1783964961.841349:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715019520 00000100:00100000:1.0:1783964961.841410:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 111 00000100:00100000:1.0:1783964961.841430:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947405ade850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+5:5559:x1870622715019520:12345-192.168.204.12@tcp:101: 00010000:00010000:1.0:1783964961.841448:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783964961.841469:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff947401483400/0xe782b916994fd3e2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5efe13 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964961.841500:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff947401483400/0xe782b916994fd3e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5efe13 expref: 6 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964961.841513:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff947401483400/0xe782b916994fd3e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5efe13 expref: 6 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964961.841523:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff947401483400, rc 0) 00000100:00100000:1.0:1783964961.841606:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947405ade850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+6:5559:x1870622715019520:12345-192.168.204.12@tcp:101: Request processed in 176us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1783964961.841614:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 111 00000100:00100000:0.0:1783964961.861776:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783964961.861981:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715019648 00000100:00100000:2.0:1783964961.861997:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715019648 00000100:00100000:2.0:1783964961.862082:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 112 00000100:00100000:2.0:1783964961.862091:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947405adc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+6:5559:x1870622715019648:12345-192.168.204.12@tcp:501: 00000100:00100000:2.0:1783964961.862435:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947405adc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+6:5559:x1870622715019648:12345-192.168.204.12@tcp:501: Request processed in 344us (1032us total) trans 0 rc -2/-2 00000100:00100000:2.0:1783964961.862444:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 112 00000100:00100000:1.0:1783964961.867481:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783964961.867604:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715019776 00000100:00100000:2.0:1783964961.867631:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715019776 00000100:00100000:2.0:1783964961.867697:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 113 00000100:00100000:2.0:1783964961.867708:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947405add050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+6:5559:x1870622715019776:12345-192.168.204.12@tcp:101: 00010000:00010000:2.0:1783964961.867727:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783964961.867748:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff947425975a00/0xe782b916994fd3e9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5efe1a expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783964961.867799:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff947425975a00/0xe782b916994fd3e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5efe1a expref: 7 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783964961.867814:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff947425975a00/0xe782b916994fd3e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5efe1a expref: 7 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783964961.867823:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff947425975a00, rc 0) 00000100:00100000:2.0:1783964961.868148:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947405add050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+7:5559:x1870622715019776:12345-192.168.204.12@tcp:101: Request processed in 441us (679us total) trans 0 rc 0/0 00000100:00100000:2.0:1783964961.868156:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 113 00000100:00100000:2.0:1783964961.877004:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783964961.877229:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715019904 00000100:00100000:3.0:1783964961.877245:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715019904 00000100:00100000:3.0:1783964961.877327:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 114 00000100:00100000:3.0:1783964961.877342:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947405ade450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+7:5559:x1870622715019904:12345-192.168.204.12@tcp:501: 00000100:00100000:3.0:1783964961.877871:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947405ade450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+8:5559:x1870622715019904:12345-192.168.204.12@tcp:501: Request processed in 528us (878us total) trans 0 rc 0/0 00000100:00100000:3.0:1783964961.877881:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 114 00000100:00100000:3.0:1783964961.885447:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783964961.890989:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715020032 00000100:00100000:2.0:1783964961.891004:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715020032 00000100:00100000:2.0:1783964961.891104:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 115 00000100:00100000:2.0:1783964961.891117:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947405adc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+8:5559:x1870622715020032:12345-192.168.204.12@tcp:503: 00000100:00100000:2.0:1783964961.891493:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947405adc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+8:5559:x1870622715020032:12345-192.168.204.12@tcp:503: Request processed in 378us (6056us total) trans 0 rc 0/0 00000100:00100000:2.0:1783964961.891503:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 115 00000100:00100000:0.0:1783964961.901345:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783964961.902997:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715020160 00000100:00100000:3.0:1783964961.903010:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715020160 00000100:00100000:3.0:1783964961.903093:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 116 00000100:00100000:3.0:1783964961.903103:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947405adc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+8:5577:x1870622715020160:12345-192.168.204.12@tcp:502: 00000100:00100000:3.0:1783964961.903496:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947405adc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+8:5577:x1870622715020160:12345-192.168.204.12@tcp:502: Request processed in 393us (2161us total) trans 0 rc 0/0 00000100:00100000:3.0:1783964961.903505:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 116 00000100:00100000:3.0:1783964961.946092:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783964961.946134:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715020288 00000100:00100000:3.0:1783964961.946144:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715020288 00000100:00100000:3.0:1783964961.946192:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 117 00000100:00100000:3.0:1783964961.946240:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947405addc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+8:5577:x1870622715020288:12345-192.168.204.12@tcp:502: 00000100:00100000:3.0:1783964961.946529:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947405addc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+8:5577:x1870622715020288:12345-192.168.204.12@tcp:502: Request processed in 290us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1783964961.946537:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 117 00000100:00100000:0.0:1783964961.954632:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783964961.956296:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715020416 00000100:00100000:3.0:1783964961.956312:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715020416 00000100:00100000:3.0:1783964961.956377:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 118 00000100:00100000:3.0:1783964961.956388:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947405a4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+8:5559:x1870622715020416:12345-192.168.204.12@tcp:101: 00010000:00010000:3.0:1783964961.956406:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783964961.956435:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9474420ffc00/0xe782b916994fd3f0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5efe44 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964961.956465:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9474420ffc00/0xe782b916994fd3f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5efe44 expref: 9 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964961.956478:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9474420ffc00/0xe782b916994fd3f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5efe44 expref: 9 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964961.956486:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9474420ffc00, rc 0) 00000100:00100000:3.0:1783964961.956562:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947405a4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+9:5559:x1870622715020416:12345-192.168.204.12@tcp:101: Request processed in 175us (1938us total) trans 0 rc 0/0 00000100:00100000:3.0:1783964961.956569:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 118 00000100:00100000:3.0:1783964961.959943:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783964961.959977:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715020544 00000100:00100000:3.0:1783964961.959986:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715020544 00000100:00100000:3.0:1783964961.960031:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 119 00000100:00100000:3.0:1783964961.960040:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947405a4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+9:5559:x1870622715020544:12345-192.168.204.12@tcp:256: 20000000:01000000:3.0:1783964961.960075:0:5805:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1783964961.960092:0:5805:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1783964961.960096:0:5805:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1783964961.960099:0:5805:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1783964961.960102:0:5805:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:2.0:1783964961.967864:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947405a4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+9:5559:x1870622715020544:12345-192.168.204.12@tcp:256: Request processed in 7813us (7919us total) trans 0 rc 0/0 00000100:00100000:2.0:1783964961.967879:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 119 00000100:00100000:0.0:1783964961.972495:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783964961.972705:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715020672 00000100:00100000:2.0:1783964961.972722:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715020672 00000100:00100000:2.0:1783964961.972789:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 120 00000100:00100000:2.0:1783964961.972799:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947405a4e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+9:5559:x1870622715020672:12345-192.168.204.12@tcp:101: 00010000:00010000:2.0:1783964961.972820:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783964961.972856:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff947425974c00/0xe782b916994fd3f7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5efe4b expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783964961.972892:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff947425974c00/0xe782b916994fd3f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5efe4b expref: 10 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783964961.972905:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff947425974c00/0xe782b916994fd3f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5efe4b expref: 10 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783964961.972916:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff947425974c00, rc 0) 00000100:00100000:2.0:1783964961.973089:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947405a4e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+10:5559:x1870622715020672:12345-192.168.204.12@tcp:101: Request processed in 290us (603us total) trans 0 rc 0/0 00000100:00100000:2.0:1783964961.973098:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 120 00000100:00100000:2.0:1783964961.976461:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783964961.976542:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715020800 00000100:00100000:3.0:1783964961.976552:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715020800 00000100:00100000:3.0:1783964961.976612:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 121 00000100:00100000:3.0:1783964961.976623:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947405a4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+10:5559:x1870622715020800:12345-192.168.204.12@tcp:501: 00000100:00100000:3.0:1783964961.976890:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947405a4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+10:5559:x1870622715020800:12345-192.168.204.12@tcp:501: Request processed in 268us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1783964961.976899:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 121 00000100:00100000:0.0:1783964961.983406:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783964961.985077:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715020928 00000100:00100000:3.0:1783964961.985092:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715020928 00000100:00100000:3.0:1783964961.985147:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 122 00000100:00100000:3.0:1783964961.985158:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947405a4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+10:5559:x1870622715020928:12345-192.168.204.12@tcp:503: 00000100:00100000:3.0:1783964961.994613:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947405a4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+10:5559:x1870622715020928:12345-192.168.204.12@tcp:503: Request processed in 9445us (11203us total) trans 0 rc 0/0 00000100:00100000:3.0:1783964961.994629:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 122 00000100:00100000:2.0:1783964962.001544:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783964962.001796:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715021056 00000100:00100000:3.0:1783964962.001806:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715021056 00000100:00100000:2.0:1783964962.003393:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 123 00000100:00100000:2.0:1783964962.003420:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947405a4e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+10:5582:x1870622715021056:12345-192.168.204.12@tcp:502: 00000100:00100000:2.0:1783964962.003870:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947405a4e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+10:5582:x1870622715021056:12345-192.168.204.12@tcp:502: Request processed in 465us (2336us total) trans 0 rc 0/0 00000100:00100000:2.0:1783964962.003880:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 123 00000100:00100000:2.0:1783964962.008351:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783964962.008667:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715021184 00000100:00100000:3.0:1783964962.008679:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715021184 00000100:00100000:3.0:1783964962.008820:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 124 00000100:00100000:3.0:1783964962.008841:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947405a4c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+10:5582:x1870622715021184:12345-192.168.204.12@tcp:502: 00000100:00100000:3.0:1783964962.009152:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947405a4c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+10:5582:x1870622715021184:12345-192.168.204.12@tcp:502: Request processed in 314us (947us total) trans 0 rc 0/0 00000100:00100000:3.0:1783964962.009171:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 124 00000100:00100000:1.0:1783964962.014359:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783964962.014960:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715021312 00000100:00100000:3.0:1783964962.014970:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715021312 00000100:00100000:3.0:1783964962.015057:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 4 00000100:00100000:3.0:1783964962.015066:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436305c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2356:x1870622715021312:12345-192.168.204.12@tcp:38: 00010000:00080000:3.0:1783964962.015095:0:5812:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from 9923189b-eb4a-470c-ab45-969435371000@192.168.204.12@tcp t0 exp 0000000000000000 cur 196 last 0 00000020:00000080:3.0:1783964962.015154:0:5812:0:(genops.c:1406:class_connect()) connect: client 9923189b-eb4a-470c-ab45-969435371000, cookie 0xe782b916994fd3fe 00000004:00100000:3.0:1783964962.015185:0:5812:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:3.0:1783964962.015192:0:5812:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:3.0:1783964962.043637:0:5812:0:(import.c:65:import_set_state_nolock()) ffff9474059b6800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783964962.043734:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436305c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9923189b-eb4a-470c-ab45-969435371000+6:2356:x1870622715021312:12345-192.168.204.12@tcp:38: Request processed in 28665us (29383us total) trans 0 rc 0/0 00000100:00100000:3.0:1783964962.043746:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 4 00010000:00010000:3.0:1783964962.475428:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783964963.059842:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783964963.059940:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715021440 00000100:00100000:3.0:1783964963.059953:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715021440 00000100:00100000:3.0:1783964963.060049:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 5 00000100:00100000:3.0:1783964963.060059:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9474072aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9923189b-eb4a-470c-ab45-969435371000+6:0:x1870622715021440:12345-192.168.204.12@tcp:41: 00000004:00000024:3.0:1783964963.060107:0:5811:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1783964963.060183:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9474072aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9923189b-eb4a-470c-ab45-969435371000+6:0:x1870622715021440:12345-192.168.204.12@tcp:41: Request processed in 126us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1783964963.060191:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 5 00000100:00080000:2.0:1783964963.060472:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783964963.072688:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783964963.073184:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715021568 00000100:00100000:3.0:1783964963.073196:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715021568 00000100:00100000:3.0:1783964963.073431:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 6 00000100:00100000:3.0:1783964963.073443:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9474072aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9923189b-eb4a-470c-ab45-969435371000+6:5559:x1870622715021568:12345-192.168.204.12@tcp:41: 00000004:00000024:3.0:1783964963.073492:0:5813:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1783964963.073570:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9474072aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9923189b-eb4a-470c-ab45-969435371000+6:5559:x1870622715021568:12345-192.168.204.12@tcp:41: Request processed in 128us (897us total) trans 0 rc 0/0 00000100:00100000:3.0:1783964963.073578:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 6 00000100:00100000:1.0:1783964963.085093:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783964963.085313:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715021696 00000100:00100000:3.0:1783964963.085324:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715021696 00000100:00100000:3.0:1783964963.085456:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 7 00000100:00100000:3.0:1783964963.085468:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436307480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9923189b-eb4a-470c-ab45-969435371000+6:5559:x1870622715021696:12345-192.168.204.12@tcp:40: 00000100:00100000:3.0:1783964963.085571:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436307480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9923189b-eb4a-470c-ab45-969435371000+6:5559:x1870622715021696:12345-192.168.204.12@tcp:40: Request processed in 105us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1783964963.085579:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 7 00000100:00100000:2.0:1783964963.095064:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783964963.095250:0:6609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715021824 00000100:00100000:1.0:1783964963.095261:0:6609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715021824 00000100:00100000:1.0:1783964963.095313:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 9 00000100:00100000:1.0:1783964963.095322:0:6609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9474072abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2356:x1870622715021824:12345-192.168.204.12@tcp:8: 00010000:00080000:1.0:1783964963.095354:0:6609:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 9923189b-eb4a-470c-ab45-969435371000@192.168.204.12@tcp t0 exp 0000000000000000 cur 197 last 0 00000020:00000080:1.0:1783964963.095385:0:6609:0:(genops.c:1406:class_connect()) connect: client 9923189b-eb4a-470c-ab45-969435371000, cookie 0xe782b916994fd405 00002000:00100000:1.0:1783964963.095407:0:6609:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 9923189b-eb4a-470c-ab45-969435371000/ffff94743e558000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1783964963.095448:0:6609:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1783964963.095770:0:6609:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1783964963.095804:0:6609:0:(import.c:65:import_set_state_nolock()) ffff94743e55c000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783964963.096196:0:6609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9474072abb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9923189b-eb4a-470c-ab45-969435371000+6:2356:x1870622715021824:12345-192.168.204.12@tcp:8: Request processed in 872us (1141us total) trans 0 rc 0/0 00000100:00100000:1.0:1783964963.096297:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 9 00000100:00100000:2.0:1783964963.097924:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783964963.098121:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715021952 00000100:00100000:0.0:1783964963.098130:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715021952 00000100:00100000:0.0:1783964963.098189:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 125 00000100:00100000:0.0:1783964963.098239:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947405adec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+10:2358:x1870622715021952:12345-192.168.204.12@tcp:400: 00000100:00100000:0.0:1783964963.098301:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947405adec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+10:2358:x1870622715021952:12345-192.168.204.12@tcp:400: Request processed in 104us (394us total) trans 0 rc 0/0 00000100:00100000:0.0:1783964963.098308:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 125 00000100:00100000:0.0:1783964963.101651:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783964963.101758:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715022208 00000100:00100000:2.0:1783964963.101767:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715022208 00000100:00100000:2.0:1783964963.101872:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 0 00000100:00100000:2.0:1783964963.101882:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436336680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9923189b-eb4a-470c-ab45-969435371000+6:5559:x1870622715022208:12345-192.168.204.12@tcp:33: 00000100:00100000:0.0:1783964963.108091:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783964963.110425:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715022080 00000100:00100000:3.0:1783964963.110440:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715022080 00000100:00100000:3.0:1783964963.110527:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 10 00000100:00100000:3.0:1783964963.110536:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436334000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2356:x1870622715022080:12345-192.168.204.12@tcp:8: 00010000:00080000:3.0:1783964963.110573:0:6606:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 9923189b-eb4a-470c-ab45-969435371000@192.168.204.12@tcp t0 exp 0000000000000000 cur 197 last 0 00000020:00000080:3.0:1783964963.110610:0:6606:0:(genops.c:1406:class_connect()) connect: client 9923189b-eb4a-470c-ab45-969435371000, cookie 0xe782b916994fd40c 00002000:00100000:3.0:1783964963.110622:0:6606:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 9923189b-eb4a-470c-ab45-969435371000/ffff9474059b4800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1783964963.110647:0:6606:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1783964963.111120:0:6606:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1783964963.111160:0:6606:0:(import.c:65:import_set_state_nolock()) ffff9474059b0000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783964963.111509:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436334000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9923189b-eb4a-470c-ab45-969435371000+6:2356:x1870622715022080:12345-192.168.204.12@tcp:8: Request processed in 970us (3424us total) trans 0 rc 0/0 00000100:00100000:3.0:1783964963.111518:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 10 00000004:00080000:2.0:1783964963.131053:0:5814:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 29085us 00000004:00200000:1.0:1783964963.158180:0:5814:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:1.0:1783964963.158379:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436336680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9923189b-eb4a-470c-ab45-969435371000+6:5559:x1870622715022208:12345-192.168.204.12@tcp:33: Request processed in 56492us (56734us total) trans 0 rc 0/0 00000100:00100000:1.0:1783964963.158407:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 0 00000100:00100000:3.0:1783964963.371706:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947436305500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3322:1870622732867968:0@lo:13: 00000100:00100000:3.0:1783964963.371800:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783964963.371897:0:6610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732867968 00000100:00100000:0.0:1783964963.371906:0:6610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732867968 00000100:00100000:3.0:1783964963.371999:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783964963.372005:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947436305180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ae0997f7-3a15-4fc6-865a-35b2f101956e:3322:1870622732868096:0@lo:400: 00000100:00100000:3.0:1783964963.372036:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1783964963.372055:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783964963.372124:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947436306d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3324:1870622732868224:0@lo:400: 00000100:00100000:1.0:1783964963.372156:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783964963.372930:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783964963.372945:0:6610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9474368d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1870622732867968:12345-0@lo:13: 00002000:00000024:0.0:1783964963.372972:0:6610:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783964963.373023:0:6610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9474368d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1870622732867968:12345-0@lo:13: Request processed in 85us (1224us total) trans 0 rc 0/0 00000100:00100000:0.0:1783964963.373031:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783964963.373063:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e299880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3323:1870622732868608:0@lo:400: 00000100:00100000:0.0:1783964963.373094:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783964963.378513:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732868224 00000100:00100000:2.0:1783964963.378564:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732868096 00000100:00100000:2.0:1783964963.378572:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732868096 00000100:00100000:0.0:1783964963.378594:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732868224 00000100:00100000:2.0:1783964963.378652:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1783964963.378662:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947405a4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+19:3322:x1870622732868096:12345-0@lo:400: 00000100:00100000:2.0:1783964963.378755:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947405a4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+19:3322:x1870622732868096:12345-0@lo:400: Request processed in 95us (6718us total) trans 0 rc 0/0 00000100:00100000:2.0:1783964963.378764:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1783964963.378768:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732868608 00000100:00100000:0.0:1783964963.378773:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732868608 00000100:00080000:2.0:1783964963.378817:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783964963.378851:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947436306300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3325:1870622732868352:0@lo:400: 00000100:00100000:2.0:1783964963.378884:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783964963.379238:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732868352 00000100:00100000:0.0:1783964963.379243:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732868352 00000100:00100000:0.0:1783964963.379272:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1783964963.379279:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e298700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3324:x1870622732868224:12345-0@lo:400: 00000100:00100000:0.0:1783964963.379324:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e298700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3324:x1870622732868224:12345-0@lo:400: Request processed in 46us (7167us total) trans 0 rc 0/0 00000100:00100000:0.0:1783964963.379331:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1783964963.379345:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1783964963.379426:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436337b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3323:x1870622732868608:12345-0@lo:400: 00000100:00100000:0.0:1783964963.379464:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436337b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3323:x1870622732868608:12345-0@lo:400: Request processed in 40us (6368us total) trans 0 rc 0/0 00000100:00100000:0.0:1783964963.379470:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1783964963.379481:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1783964963.379487:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9474072a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3325:x1870622732868352:12345-0@lo:400: 00000100:00100000:0.0:1783964963.379514:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9474072a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3325:x1870622732868352:12345-0@lo:400: Request processed in 27us (629us total) trans 0 rc 0/0 00000100:00100000:0.0:1783964963.379604:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1783964963.388883:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947436305180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ae0997f7-3a15-4fc6-865a-35b2f101956e:3322:1870622732868096:0@lo:400: 00010000:00080000:3.0:1783964963.388913:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff947436305500 x1870622732867968/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783964979 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783964963.388925:0:3322:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00010000:00080000:0.0:1783964963.388942:0:3323:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94743e299880 x1870622732868608/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783964979 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783964963.388957:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947436305500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3322:1870622732867968:0@lo:13: 00000100:00100000:0.0:1783964963.388959:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e299880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3323:1870622732868608:0@lo:400: 00000100:00100000:3.0:1783964963.389000:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e29b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3322:1870622732868480:0@lo:400: 00000100:00100000:3.0:1783964963.389072:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783964963.389128:0:6609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732868480 00000100:00100000:0.0:1783964963.389136:0:6609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732868480 00000100:00080000:3.0:1783964963.389179:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783964963.389185:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783964963.389195:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1783964963.389227:0:6609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9474368d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3322:x1870622732868480:12345-0@lo:400: 00000100:00100000:0.0:1783964963.389299:0:6609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9474368d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3322:x1870622732868480:12345-0@lo:400: Request processed in 94us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1783964963.389306:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1783964963.392056:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94743e29b100 x1870622732868480/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783964979 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783964963.392073:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e29b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3322:1870622732868480:0@lo:400: 00010000:00080000:1.0:1783964963.393067:0:3324:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff947436306d80 x1870622732868224/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783964979 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783964963.393080:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947436306d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3324:1870622732868224:0@lo:400: 00010000:00080000:2.0:1783964963.394142:0:3325:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff947436306300 x1870622732868352/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783964979 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783964963.394155:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947436306300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3325:1870622732868352:0@lo:400: 00000100:00100000:0.0:1783964963.443074:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783964963.443418:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715022336 00000100:00100000:2.0:1783964963.443429:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715022336 00000100:00100000:2.0:1783964963.443504:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 8 00000100:00100000:2.0:1783964963.443515:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436336a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9923189b-eb4a-470c-ab45-969435371000+6:5600:x1870622715022336:12345-192.168.204.12@tcp:101: 00010000:00010000:2.0:1783964963.443565:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783964963.443596:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947425975200/0xe782b916994fd413 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5efe75 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783964963.443669:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff947425974000/0xe782b916994fd41a lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783964963.443683:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947425974000/0xe782b916994fd41a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783964963.443698:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947425974000/0xe782b916994fd41a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783964963.443908:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1783964963.443912:0:5812:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1783964963.443991:0:5812:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff947425974000/0xe782b916994fd41a lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783964963.444018:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947425975200/0xe782b916994fd413 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5efe75 expref: 8 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783964963.444037:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff947425974000/0xe782b916994fd41a lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5efe75 expref: 7 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783964963.444046:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff947402a2d500) 00010000:00010000:2.0:1783964963.444049:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783964963.444052:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff947425974000, rc 0) 00000100:00100000:2.0:1783964963.445964:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436336a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9923189b-eb4a-470c-ab45-969435371000+7:5600:x1870622715022336:12345-192.168.204.12@tcp:101: Request processed in 2441us (2889us total) trans 0 rc 0/0 00000100:00100000:2.0:1783964963.445978:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 8 00010000:00010000:2.0:1783964963.500353:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783964964.523427:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783964965.420365:0:3325:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783964965.420393:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9474072a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3325:1870622732868736:0@lo:13: 00000100:00100000:3.0:1783964965.420470:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783964965.420540:0:6610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732868736 00000100:00100000:0.0:1783964965.420550:0:6610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732868736 00000100:00100000:0.0:1783964965.420606:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783964965.420615:0:6610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9474368d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3325:x1870622732868736:12345-0@lo:13: 00002000:00000024:0.0:1783964965.420657:0:6610:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783964965.420710:0:6610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9474368d6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3325:x1870622732868736:12345-0@lo:13: Request processed in 96us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1783964965.420717:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1783964965.420754:0:3325:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9474072a9880 x1870622732868736/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783964981 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783964965.420772:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9474072a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3325:1870622732868736:0@lo:13: 00000100:00080000:3.0:1783964965.420971:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1783964965.547775:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783964965.622421:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783964965.622580:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715022464 00000100:00100000:3.0:1783964965.622593:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715022464 00000100:00100000:3.0:1783964965.622696:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 9 00000100:00100000:3.0:1783964965.622710:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436335c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9923189b-eb4a-470c-ab45-969435371000+7:5652:x1870622715022464:12345-192.168.204.12@tcp:41: 00000004:00000024:3.0:1783964965.622772:0:5811:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1783964965.622889:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436335c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9923189b-eb4a-470c-ab45-969435371000+7:5652:x1870622715022464:12345-192.168.204.12@tcp:41: Request processed in 182us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1783964965.622898:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 9 00000100:00080000:2.0:1783964965.623107:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783964965.628424:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783964965.629539:0:6610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715022592 00000100:00100000:0.0:1783964965.629581:0:6610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715022592 00000100:00100000:0.0:1783964965.629702:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 8 00000100:00100000:0.0:1783964965.629715:0:6610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9474368d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:9923189b-eb4a-470c-ab45-969435371000+6:5652:x1870622715022592:12345-192.168.204.12@tcp:13: 00002000:00000024:0.0:1783964965.629754:0:6610:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783964965.629843:0:6610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9474368d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:9923189b-eb4a-470c-ab45-969435371000+6:5652:x1870622715022592:12345-192.168.204.12@tcp:13: Request processed in 131us (1435us total) trans 0 rc 0/0 00000100:00100000:0.0:1783964965.629852:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 8 00000100:00080000:2.0:1783964965.631551:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783964965.635445:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783964965.635625:0:6610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715022720 00000100:00100000:0.0:1783964965.635639:0:6610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715022720 00000100:00100000:0.0:1783964965.635730:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 9 00000100:00100000:0.0:1783964965.635743:0:6610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e29bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:9923189b-eb4a-470c-ab45-969435371000+6:5652:x1870622715022720:12345-192.168.204.12@tcp:13: 00002000:00000024:0.0:1783964965.635806:0:6610:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783964965.635905:0:6610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e29bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:9923189b-eb4a-470c-ab45-969435371000+6:5652:x1870622715022720:12345-192.168.204.12@tcp:13: Request processed in 165us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1783964965.635914:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 9 00000100:00080000:2.0:1783964965.635992:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00100000:2.0:1783964966.013806:0:6637:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 9923189b-eb4a-470c-ab45-969435371000 00010000:00010000:3.0:1783964966.571607:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1783964967.548242:0:7523:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 9923189b-eb4a-470c-ab45-969435371000 00000001:00100000:3.0:1783964967.549497:0:5835:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 9923189b-eb4a-470c-ab45-969435371000 00010000:00010000:2.0:1783964967.595531:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783964968.313121:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783964968.313172:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783964968.313237:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783964968.313272:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783964968.313323:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715022848 00000100:00100000:1.0:1783964968.313338:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715022848 00000100:00100000:1.0:1783964968.313405:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 127 00000100:00100000:1.0:1783964968.313417:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947405a4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+10:2357:x1870622715022848:12345-192.168.204.12@tcp:400: 00000100:00100000:1.0:1783964968.313508:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947405a4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+10:2357:x1870622715022848:12345-192.168.204.12@tcp:400: Request processed in 93us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1783964968.313524:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 127 00000100:00100000:1.0:1783964968.313565:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715023104 00000100:00100000:1.0:1783964968.313569:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715023104 00000100:00100000:1.0:1783964968.313607:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715023232 00000100:00100000:1.0:1783964968.313610:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715023232 00000100:00100000:1.0:1783964968.313628:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 5 00000100:00100000:1.0:1783964968.313633:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e299c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9923189b-eb4a-470c-ab45-969435371000+5:2357:x1870622715023104:12345-192.168.204.12@tcp:400: 00000100:00100000:1.0:1783964968.313680:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e299c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9923189b-eb4a-470c-ab45-969435371000+5:2357:x1870622715023104:12345-192.168.204.12@tcp:400: Request processed in 46us (507us total) trans 0 rc 0/0 00000100:00100000:1.0:1783964968.313686:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 5 00000100:00100000:1.0:1783964968.313698:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 6 00000100:00100000:1.0:1783964968.313704:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e298a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9923189b-eb4a-470c-ab45-969435371000+5:2357:x1870622715023232:12345-192.168.204.12@tcp:400: 00000100:00100000:1.0:1783964968.313727:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e298a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9923189b-eb4a-470c-ab45-969435371000+5:2357:x1870622715023232:12345-192.168.204.12@tcp:400: Request processed in 24us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1783964968.313733:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 6 00000100:00100000:1.0:1783964968.313753:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715022976 00000100:00100000:1.0:1783964968.313756:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715022976 00000100:00100000:1.0:1783964968.313801:0:6632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 17 00000100:00100000:1.0:1783964968.313808:0:6632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e29ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9923189b-eb4a-470c-ab45-969435371000+6:2357:x1870622715022976:12345-192.168.204.12@tcp:400: 00000100:00100000:1.0:1783964968.313838:0:6632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e29ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9923189b-eb4a-470c-ab45-969435371000+6:2357:x1870622715022976:12345-192.168.204.12@tcp:400: Request processed in 31us (601us total) trans 0 rc 0/0 00000100:00100000:1.0:1783964968.313845:0:6632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 17 00000100:00080000:1.0:1783964968.314890:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783964968.314900:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783964968.314903:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783964968.491545:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e298000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ae0997f7-3a15-4fc6-865a-35b2f101956e:3325:1870622732868864:0@lo:400: 00000100:00100000:0.0:1783964968.491655:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783964968.491723:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e298e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3325:1870622732869376:0@lo:400: 00000100:00100000:0.0:1783964968.491752:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783964968.491789:0:3325:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783964968.491795:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e29a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3325:1870622732869248:0@lo:400: 00000100:00100000:0.0:1783964968.491824:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783964968.491855:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e298380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3323:1870622732869120:0@lo:400: 00000100:00100000:0.0:1783964968.491881:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783964968.491901:0:3323:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1783964968.491907:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e299f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3323:1870622732868992:0@lo:400: 00000100:00100000:0.0:1783964968.491958:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783964968.491983:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e29b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3323:1870622732869504:0@lo:400: 00000100:00100000:0.0:1783964968.492007:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783964968.492044:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732869376 00000100:00100000:0.0:1783964968.492053:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732869376 00000100:00100000:0.0:1783964968.492138:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732869120 00000100:00100000:0.0:1783964968.492142:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732869120 00000100:00100000:0.0:1783964968.492159:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732868992 00000100:00100000:0.0:1783964968.492161:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732868992 00000100:00100000:0.0:1783964968.492180:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1783964968.492190:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436334a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3325:x1870622732869376:12345-0@lo:400: 00000100:00100000:0.0:1783964968.492309:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436334a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3325:x1870622732869376:12345-0@lo:400: Request processed in 119us (554us total) trans 0 rc 0/0 00000100:00100000:0.0:1783964968.492318:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1783964968.492341:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1783964968.492347:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436335500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3323:x1870622732869120:12345-0@lo:400: 00000100:00100000:0.0:1783964968.492381:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436335500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3323:x1870622732869120:12345-0@lo:400: Request processed in 35us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1783964968.492387:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1783964968.492399:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1783964968.492405:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947429f99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3323:x1870622732868992:12345-0@lo:400: 00000100:00100000:0.0:1783964968.492432:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947429f99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3323:x1870622732868992:12345-0@lo:400: Request processed in 27us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1783964968.492438:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1783964968.492457:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732869248 00000100:00100000:0.0:1783964968.492461:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732869248 00000100:00100000:0.0:1783964968.492488:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732869504 00000100:00100000:0.0:1783964968.492498:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732869504 00000100:00100000:0.0:1783964968.492517:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783964968.492523:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436335180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3325:x1870622732869248:12345-0@lo:400: 00000100:00100000:0.0:1783964968.492556:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436335180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3325:x1870622732869248:12345-0@lo:400: Request processed in 33us (731us total) trans 0 rc 0/0 00000100:00100000:0.0:1783964968.492562:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783964968.492572:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783964968.492578:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947429f98700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3323:x1870622732869504:12345-0@lo:400: 00000100:00100000:0.0:1783964968.492606:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947429f98700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3323:x1870622732869504:12345-0@lo:400: Request processed in 29us (598us total) trans 0 rc 0/0 00000100:00100000:0.0:1783964968.492611:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:0.0:1783964968.492643:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783964968.492648:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783964968.492650:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783964968.492735:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e299f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3323:1870622732868992:0@lo:400: 00010000:00080000:0.0:1783964968.492751:0:3323:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94743e29b800 x1870622732869504/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783964984 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783964968.492762:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e29b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3323:1870622732869504:0@lo:400: 00000100:00100000:0.0:1783964968.492772:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e298380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3323:1870622732869120:0@lo:400: 00010000:00080000:0.0:1783964968.492809:0:3325:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94743e29a680 x1870622732869248/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783964984 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783964968.492818:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e29a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3325:1870622732869248:0@lo:400: 00000100:00100000:0.0:1783964968.492830:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e298e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3325:1870622732869376:0@lo:400: 00000100:00100000:1.0:1783964968.493165:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732868864 00000100:00100000:1.0:1783964968.493178:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732868864 00000100:00100000:1.0:1783964968.493238:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:1.0:1783964968.493247:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94740951d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae0997f7-3a15-4fc6-865a-35b2f101956e+19:3325:x1870622732868864:12345-0@lo:400: 00000100:00100000:1.0:1783964968.493312:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94740951d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae0997f7-3a15-4fc6-865a-35b2f101956e+19:3325:x1870622732868864:12345-0@lo:400: Request processed in 66us (1657us total) trans 0 rc 0/0 00000100:00100000:1.0:1783964968.493319:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1783964968.493621:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783964968.493639:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e29aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3322:1870622732869632:0@lo:13: 00000100:00100000:3.0:1783964968.493682:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783964968.493790:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e298000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ae0997f7-3a15-4fc6-865a-35b2f101956e:3325:1870622732868864:0@lo:400: 00000100:00100000:1.0:1783964968.493864:0:6610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732869632 00000100:00100000:1.0:1783964968.493870:0:6610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732869632 00000100:00100000:1.0:1783964968.493906:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1783964968.493914:0:6610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9474368d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1870622732869632:12345-0@lo:13: 00002000:00000024:1.0:1783964968.493950:0:6610:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783964968.494007:0:6610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9474368d5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1870622732869632:12345-0@lo:13: Request processed in 93us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1783964968.494013:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:0.0:1783964968.494368:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94743e29aa00 x1870622732869632/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783964984 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783964968.494388:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e29aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3322:1870622732869632:0@lo:13: 00000001:02000400:2.0:1783964968.505794:0:8176:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1783964968.620551:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783964969.643980:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783964970.540297:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9474072a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3324:1870622732869760:0@lo:13: 00000100:00100000:0.0:1783964970.540402:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783964970.540597:0:6610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732869760 00000100:00100000:2.0:1783964970.540619:0:6610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732869760 00000100:00080000:0.0:1783964970.540679:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783964970.540704:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1783964970.540718:0:6610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947429f9bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3324:x1870622732869760:12345-0@lo:13: 00002000:00000024:2.0:1783964970.540783:0:6610:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783964970.540849:0:6610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947429f9bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3324:x1870622732869760:12345-0@lo:13: Request processed in 135us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1783964970.540858:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:0.0:1783964970.540894:0:3324:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9474072a9880 x1870622732869760/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783964986 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783964970.540917:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9474072a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3324:1870622732869760:0@lo:13: 00010000:00010000:2.0:1783964970.671486:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783964971.697317:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1783964972.434051:0:8323:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd4aba7910 20000000:00000080:3.0:1783964972.434080:0:8323:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff947440060400 uarg=0000000000000000 20000000:01000000:3.0:1783964972.434140:0:8323:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:3.0:1783964972.434143:0:8323:0:(mgs_llog.c:6065:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:3.0:1783964972.434147:0:8323:0:(mgs_llog.c:6096:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:3.0:1783964972.434153:0:8323:0:(mgs_llog.c:4744:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:3.0:1783964972.434161:0:8323:0:(mgs_llog.c:4177:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:3.0:1783964972.434182:0:8323:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1783964972.434185:0:8323:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1783964972.435703:0:8323:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1783964972.435712:0:8323:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1783964972.437466:0:8324:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:3.0:1783964972.438184:0:8323:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:3.0:1783964972.438324:0:8323:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:3.0:1783964972.438367:0:8323:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:3.0:1783964972.438386:0:8323:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1783964972.438390:0:8323:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1783964972.444191:0:8325:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:3.0:1783964972.450904:0:8323:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:3.0:1783964972.450986:0:8323:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:3.0:1783964972.451051:0:8323:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:3.0:1783964972.451071:0:8323:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1783964972.451075:0:8323:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1783964972.461715:0:8326:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:0.0:1783964972.462586:0:8323:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:0.0:1783964972.462650:0:8323:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:0.0:1783964972.462691:0:8323:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:0.0:1783964972.462710:0:8323:0:(mgs_llog.c:2546:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:0.0:1783964972.462713:0:8323:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1783964972.463861:0:8327:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:3.0:1783964972.464568:0:8323:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:3.0:1783964972.464660:0:8323:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:3.0:1783964972.464707:0:8323:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 10000000:01000000:3.0:1783964972.464739:0:8323:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1783964972.464775:0:8323:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff947436f27400/0xe782b916994fd421 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964972.464800:0:8323:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9474420fea00/0xe782b916994fd31e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe782b916994fd317 expref: 18 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964972.464810:0:8323:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff947430c10e00/0xe782b916994fd348 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe782b916994fd341 expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964972.464818:0:8323:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff947430c10a00/0xe782b916994fd372 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe782b916994fd36b expref: 18 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964972.464826:0:8323:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff947400031600/0xe782b916994fd380 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe782b916994fd379 expref: 18 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964972.464834:0:8323:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff947401482a00/0xe782b916994fd38e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe782b916994fd387 expref: 18 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964972.464841:0:8323:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff947425975600/0xe782b916994fd3aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe782b916994fd3a3 expref: 18 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964972.464848:0:8323:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9474420fee00/0xe782b916994fd3d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe782b916994fd3c6 expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964972.464860:0:8323:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff947401483400/0xe782b916994fd3e2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5efe13 expref: 9 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964972.464882:0:8323:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff947425975a00/0xe782b916994fd3e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5efe1a expref: 9 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964972.464890:0:8323:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff947436f27400/0xe782b916994fd421 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964972.464953:0:8323:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff947425975a00/0xe782b916994fd3e9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5efe1a expref: 9 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964972.464972:0:8323:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff947425975a00/0xe782b916994fd3e9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5efe1a expref: 9 pid: 5806 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783964972.464992:0:8323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947436306300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8323:1870622732869888:192.168.204.12@tcp:104: 00010000:00010000:3.0:1783964972.465141:0:8323:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff947401483400/0xe782b916994fd3e2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5efe13 expref: 9 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964972.465150:0:8323:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff947401483400/0xe782b916994fd3e2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5efe13 expref: 9 pid: 5807 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783964972.465158:0:8323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947436306d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8323:1870622732870016:192.168.204.12@tcp:104: 00010000:00010000:3.0:1783964972.465192:0:8323:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9474420fee00/0xe782b916994fd3d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe782b916994fd3c6 expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964972.465235:0:8323:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9474420fee00/0xe782b916994fd3d4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe782b916994fd3c6 expref: 18 pid: 5805 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783964972.465248:0:8323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947436305500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8323:1870622732870144:0@lo:104: 00000100:00100000:3.0:1783964972.465312:0:8323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783964972.465365:0:8323:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff947425975600/0xe782b916994fd3aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe782b916994fd3a3 expref: 18 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964972.465373:0:8323:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff947425975600/0xe782b916994fd3aa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe782b916994fd3a3 expref: 18 pid: 5806 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783964972.465382:0:8323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947436307100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8323:1870622732870272:0@lo:104: 00000100:00100000:3.0:1783964972.465415:0:8323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783964972.465450:0:5796:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:3.0:1783964972.465461:0:8323:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff947401482a00/0xe782b916994fd38e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe782b916994fd387 expref: 18 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964972.465471:0:8323:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff947401482a00/0xe782b916994fd38e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe782b916994fd387 expref: 18 pid: 5806 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783964972.465471:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732870144 00000100:00100000:1.0:1783964972.465482:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732870144 00000100:00100000:3.0:1783964972.465485:0:8323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e43aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8323:1870622732870400:0@lo:104: 00000100:00100000:1.0:1783964972.465535:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732870272 00000100:00100000:1.0:1783964972.465540:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732870272 00000100:00100000:1.0:1783964972.465558:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783964972.465568:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436305180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ae0997f7-3a15-4fc6-865a-35b2f101956e+4:8323:x1870622732870144:12345-0@lo:104: 00000100:00100000:3.0:1783964972.465593:0:8323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783964972.465618:0:8323:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff947400031600/0xe782b916994fd380 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe782b916994fd379 expref: 18 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964972.465626:0:8323:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff947400031600/0xe782b916994fd380 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe782b916994fd379 expref: 18 pid: 5807 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783964972.465635:0:8323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e43b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8323:1870622732870528:0@lo:104: 00000100:00100000:3.0:1783964972.465659:0:8323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783964972.465666:0:5796:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.112@tcp lock: ffff9474420fe600/0xe782b916994fd3c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xe782b916994fd3d4 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964972.465681:0:8323:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff947430c10a00/0xe782b916994fd372 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe782b916994fd36b expref: 18 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964972.465691:0:8323:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff947430c10a00/0xe782b916994fd372 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe782b916994fd36b expref: 18 pid: 5807 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783964972.465700:0:8323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e439180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8323:1870622732870656:0@lo:104: 00000100:00100000:2.0:1783964972.465909:0:5795:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:2.0:1783964972.465920:0:5795:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00000100:00100000:0.0:1783964972.468512:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732870400 00000100:00100000:0.0:1783964972.468529:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732870400 00000100:00100000:0.0:1783964972.468603:0:5795:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:0.0:1783964972.468614:0:5795:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732870528 00000100:00100000:0.0:1783964972.468617:0:5795:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732870528 00000100:00100000:2.0:1783964972.468781:0:8328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1783964972.468797:0:8328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743fb2f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ae0997f7-3a15-4fc6-865a-35b2f101956e+6:8323:x1870622732870272:12345-0@lo:104: 00010000:00010000:2.0:1783964972.468823:0:8328:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.112@tcp lock: ffff947430c11000/0xe782b916994fd3a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xe782b916994fd3aa expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783964972.470621:0:8323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783964972.470845:0:5796:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1783964972.470855:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783964972.470861:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436305180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ae0997f7-3a15-4fc6-865a-35b2f101956e+6:8323:x1870622732870144:12345-0@lo:104: Request processed in 5289us (5545us total) trans 0 rc 0/0 00000100:00100000:0.0:1783964972.470893:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783964972.470902:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1783964972.470935:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715023488 00000100:00100000:1.0:1783964972.470938:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732870656 00000100:00100000:0.0:1783964972.470946:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715023488 00000100:00100000:1.0:1783964972.470947:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732870656 00010000:00010000:0.0:1783964972.470998:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff947401483400/0xe782b916994fd3e2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5efe13 expref: 10 pid: 5807 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783964972.471003:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1783964972.471017:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e43a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ae0997f7-3a15-4fc6-865a-35b2f101956e+6:8323:x1870622732870400:12345-0@lo:104: 00010000:00010000:1.0:1783964972.471033:0:5796:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.112@tcp lock: ffff947430c10000/0xe782b916994fd387 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xe782b916994fd38e expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783964972.471035:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715023360 00000100:00100000:0.0:1783964972.471048:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715023360 00010000:00010000:0.0:1783964972.471067:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff947425975a00/0xe782b916994fd3e9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5efe1a expref: 11 pid: 5806 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783964972.471085:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 12 00000100:00100000:0.0:1783964972.471094:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947429f99c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+11:2360:x1870622715023488:12345-192.168.204.12@tcp:103: 00010000:00010000:1.0:1783964972.471105:0:5796:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00010000:00010000:0.0:1783964972.471111:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1783964972.471113:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e43a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ae0997f7-3a15-4fc6-865a-35b2f101956e+6:8323:x1870622732870400:12345-0@lo:104: Request processed in 99us (5593us total) trans 0 rc 0/0 00010000:00010000:0.0:1783964972.471121:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff947401483400/0xe782b916994fd3e2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5efe13 expref: 11 pid: 5807 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783964972.471124:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00010000:0.0:1783964972.471139:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff947401483400/0xe782b916994fd3e2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5efe13 expref: 11 pid: 5807 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783964972.471148:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1783964972.471157:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e439500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ae0997f7-3a15-4fc6-865a-35b2f101956e+5:8323:x1870622732870528:12345-0@lo:104: 00010000:00010000:1.0:1783964972.471166:0:5796:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.112@tcp lock: ffff947430c11400/0xe782b916994fd379 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xe782b916994fd380 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964972.471171:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783964972.471258:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947429f99c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+11:2360:x1870622715023488:12345-192.168.204.12@tcp:103: Request processed in 165us (407us total) trans 0 rc 0/0 00000100:00100000:0.0:1783964972.471266:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 12 00000100:00100000:0.0:1783964972.471280:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 13 00000100:00100000:0.0:1783964972.471287:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947429f9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+10:2360:x1870622715023360:12345-192.168.204.12@tcp:103: 00010000:00010000:0.0:1783964972.471295:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783964972.471300:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff947425975a00/0xe782b916994fd3e9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5efe1a expref: 10 pid: 5806 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964972.471312:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff947425975a00/0xe782b916994fd3e9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5efe1a expref: 10 pid: 5806 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964972.471323:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783964972.471343:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947429f9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+10:2360:x1870622715023360:12345-192.168.204.12@tcp:103: Request processed in 56us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1783964972.471358:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 13 00010000:00010000:2.0:1783964972.471563:0:8328:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00010000:00010000:3.0:1783964972.471718:0:8323:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff947430c10e00/0xe782b916994fd348 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe782b916994fd341 expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964972.471743:0:8323:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff947430c10e00/0xe782b916994fd348 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe782b916994fd341 expref: 18 pid: 5805 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783964972.471759:0:8323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e439880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8323:1870622732870784:0@lo:104: 00000100:00100000:3.0:1783964972.471810:0:8323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783964972.471846:0:8323:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9474420fea00/0xe782b916994fd31e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe782b916994fd317 expref: 18 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964972.471855:0:8323:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9474420fea00/0xe782b916994fd31e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe782b916994fd317 expref: 18 pid: 5806 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783964972.471863:0:8323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e43bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8323:1870622732870912:0@lo:104: 00000100:00100000:3.0:1783964972.471885:0:8323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783964972.471899:0:8323:0:(client.c:2702:ptlrpc_set_wait()) set ffff9474400a4480 going to sleep for 11 seconds 00010000:00010000:3.0:1783964972.471932:0:8323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff947425975a00/0xe782b916994fd3e9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5efe1a expref: 9 pid: 5806 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783964972.471951:0:8323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947436306300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8323:1870622732869888:192.168.204.12@tcp:104: 00010000:00010000:3.0:1783964972.471966:0:8323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff947401483400/0xe782b916994fd3e2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5efe13 expref: 8 pid: 5807 timeout: 306 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783964972.471977:0:8323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947436306d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8323:1870622732870016:192.168.204.12@tcp:104: 00000100:00100000:3.0:1783964972.471989:0:8323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947436305500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8323:1870622732870144:0@lo:104: 00000100:00100000:3.0:1783964972.471997:0:8323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947436307100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8323:1870622732870272:0@lo:104: 00000100:00100000:3.0:1783964972.472006:0:8323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e43aa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8323:1870622732870400:0@lo:104: 00000100:00100000:0.0:1783964972.472074:0:5795:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 3 min 2 max 56 00000100:00100000:0.0:1783964972.472084:0:5795:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_003' 00010000:00010000:0.0:1783964972.472279:0:5800:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1783964972.472287:0:5800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.112@tcp lock: ffff9474420fe600/0xe782b916994fd3c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0xe782b916994fd3d4 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964972.472297:0:5800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9474420fe600 already unused, calling callback (ffffffffc1ca8c20) 10000000:00010000:0.0:1783964972.472302:0:5800:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.112@tcp lock: ffff9474420fe600/0xe782b916994fd3c6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0xe782b916994fd3d4 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964972.472311:0:5800:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.112@tcp lock: ffff9474420fe600/0xe782b916994fd3c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0xe782b916994fd3d4 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783964972.472318:0:5800:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.112@tcp lock: ffff9474420fe600/0xe782b916994fd3c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0xe782b916994fd3d4 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783964972.472325:0:5800:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783964972.472360:0:5800:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.112@tcp lock: ffff9474420fe600/0xe782b916994fd3c6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe782b916994fd3d4 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964972.472366:0:5800:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783964972.472385:0:5800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.112@tcp lock: ffff9474420fe600/0xe782b916994fd3c6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe782b916994fd3d4 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964972.472392:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.112@tcp lock: ffff9474420fe600/0xe782b916994fd3c6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe782b916994fd3d4 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964972.472403:0:5800:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783964972.472406:0:5800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.112@tcp lock: ffff947430c10000/0xe782b916994fd387 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0xe782b916994fd38e expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964972.472418:0:5800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947430c10000 already unused, calling callback (ffffffffc1ca8c20) 10000000:00010000:0.0:1783964972.472421:0:5800:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.112@tcp lock: ffff947430c10000/0xe782b916994fd387 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0xe782b916994fd38e expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964972.472427:0:5800:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.112@tcp lock: ffff947430c10000/0xe782b916994fd387 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0xe782b916994fd38e expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783964972.472433:0:5800:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.112@tcp lock: ffff947430c10000/0xe782b916994fd387 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0xe782b916994fd38e expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783964972.472438:0:5800:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783964972.472450:0:5800:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.112@tcp lock: ffff947430c10000/0xe782b916994fd387 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe782b916994fd38e expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964972.472456:0:5800:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783964972.472471:0:5800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.112@tcp lock: ffff947430c10000/0xe782b916994fd387 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe782b916994fd38e expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964972.472477:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.112@tcp lock: ffff947430c10000/0xe782b916994fd387 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe782b916994fd38e expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964972.472486:0:5800:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783964972.472490:0:5800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.112@tcp lock: ffff947430c11000/0xe782b916994fd3a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0xe782b916994fd3aa expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964972.472495:0:5800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947430c11000 already unused, calling callback (ffffffffc1ca8c20) 10000000:00010000:0.0:1783964972.472498:0:5800:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.112@tcp lock: ffff947430c11000/0xe782b916994fd3a3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0xe782b916994fd3aa expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964972.472514:0:5800:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.112@tcp lock: ffff947430c11000/0xe782b916994fd3a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0xe782b916994fd3aa expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783964972.472520:0:5800:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.112@tcp lock: ffff947430c11000/0xe782b916994fd3a3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0xe782b916994fd3aa expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783964972.472525:0:5800:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783964972.472537:0:5800:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.112@tcp lock: ffff947430c11000/0xe782b916994fd3a3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe782b916994fd3aa expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964972.472541:0:5800:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783964972.472545:0:5800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.112@tcp lock: ffff947430c11000/0xe782b916994fd3a3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe782b916994fd3aa expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964972.472552:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.112@tcp lock: ffff947430c11000/0xe782b916994fd3a3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe782b916994fd3aa expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964972.472562:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783964972.472564:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783964972.472566:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783964972.472573:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783964972.472597:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947429f98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ae0997f7-3a15-4fc6-865a-35b2f101956e:3325:1870622732871040:0@lo:103: 00000100:00100000:0.0:1783964972.472639:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783964972.472688:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947429f98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ae0997f7-3a15-4fc6-865a-35b2f101956e:3322:1870622732871168:0@lo:103: 00000100:00100000:0.0:1783964972.472714:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783964972.472745:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783964972.472751:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947429f99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ae0997f7-3a15-4fc6-865a-35b2f101956e:3322:1870622732871296:0@lo:103: 00000100:00100000:0.0:1783964972.472783:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783964972.472823:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732871040 00000100:00100000:0.0:1783964972.472828:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732871040 00010000:00010000:0.0:1783964972.472857:0:5798:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9474420fee00/0xe782b916994fd3d4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe782b916994fd3c6 expref: 19 pid: 5805 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783964972.472875:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732871168 00000100:00100000:0.0:1783964972.472878:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732871168 00010000:00010000:0.0:1783964972.472890:0:5798:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff947401482a00/0xe782b916994fd38e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe782b916994fd387 expref: 20 pid: 5806 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783964972.472900:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732871296 00000100:00100000:0.0:1783964972.472902:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732871296 00010000:00010000:0.0:1783964972.472913:0:5798:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff947425975600/0xe782b916994fd3aa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe782b916994fd3a3 expref: 21 pid: 5806 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783964972.472927:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1783964972.472934:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947429f98380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ae0997f7-3a15-4fc6-865a-35b2f101956e+21:3325:x1870622732871040:12345-0@lo:103: 00010000:00010000:0.0:1783964972.472946:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783964972.472950:0:5798:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9474420fee00/0xe782b916994fd3d4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe782b916994fd3c6 expref: 21 pid: 5805 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964972.472961:0:5798:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9474420fee00/0xe782b916994fd3d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe782b916994fd3c6 expref: 21 pid: 5805 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964972.472974:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9474420fee00/0xe782b916994fd3d4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe782b916994fd3c6 expref: 21 pid: 5805 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964972.472986:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783964972.473020:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947429f98380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ae0997f7-3a15-4fc6-865a-35b2f101956e+20:3325:x1870622732871040:12345-0@lo:103: Request processed in 85us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1783964972.473027:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1783964972.473054:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1783964972.473075:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947429f9a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ae0997f7-3a15-4fc6-865a-35b2f101956e+19:3322:x1870622732871168:12345-0@lo:103: 00010000:00010000:0.0:1783964972.473084:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783964972.473088:0:5798:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff947401482a00/0xe782b916994fd38e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe782b916994fd387 expref: 19 pid: 5806 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964972.473097:0:5798:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff947401482a00/0xe782b916994fd38e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe782b916994fd387 expref: 19 pid: 5806 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964972.473109:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff947401482a00/0xe782b916994fd38e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe782b916994fd387 expref: 19 pid: 5806 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964972.473119:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783964972.473147:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947429f9a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ae0997f7-3a15-4fc6-865a-35b2f101956e+18:3322:x1870622732871168:12345-0@lo:103: Request processed in 87us (433us total) trans 0 rc 0/0 00000100:00100000:0.0:1783964972.473153:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1783964972.473166:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1783964972.473172:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947429f98e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ae0997f7-3a15-4fc6-865a-35b2f101956e+17:3322:x1870622732871296:12345-0@lo:103: 00010000:00010000:0.0:1783964972.473180:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783964972.473184:0:5798:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff947425975600/0xe782b916994fd3aa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe782b916994fd3a3 expref: 17 pid: 5806 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964972.473193:0:5798:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff947425975600/0xe782b916994fd3aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe782b916994fd3a3 expref: 17 pid: 5806 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964972.473246:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff947425975600/0xe782b916994fd3aa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe782b916994fd3a3 expref: 17 pid: 5806 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964972.473257:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783964972.473280:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947429f98e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ae0997f7-3a15-4fc6-865a-35b2f101956e+16:3322:x1870622732871296:12345-0@lo:103: Request processed in 109us (497us total) trans 0 rc 0/0 00000100:00100000:0.0:1783964972.473294:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1783964972.473339:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947429f98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ae0997f7-3a15-4fc6-865a-35b2f101956e:3325:1870622732871040:0@lo:103: 00000100:00100000:0.0:1783964972.473370:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947429f99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ae0997f7-3a15-4fc6-865a-35b2f101956e:3322:1870622732871296:0@lo:103: 00000100:00100000:0.0:1783964972.473378:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947429f98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ae0997f7-3a15-4fc6-865a-35b2f101956e:3322:1870622732871168:0@lo:103: 00000100:00100000:2.0:1783964972.473766:0:8328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743fb2f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ae0997f7-3a15-4fc6-865a-35b2f101956e+5:8323:x1870622732870272:12345-0@lo:104: Request processed in 2777us (6155us total) trans 0 rc 0/0 00000100:00100000:2.0:1783964972.473788:0:8328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1783964972.473847:0:8328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732870784 00000100:00100000:2.0:1783964972.473853:0:8328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732870784 00000100:00100000:2.0:1783964972.473878:0:8328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732870912 00000100:00100000:2.0:1783964972.473882:0:8328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732870912 00000100:00100000:2.0:1783964972.473899:0:8328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1783964972.473906:0:8328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e43b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ae0997f7-3a15-4fc6-865a-35b2f101956e+6:8323:x1870622732870656:12345-0@lo:104: 00010000:00010000:2.0:1783964972.473920:0:8328:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.112@tcp lock: ffff947401482c00/0xe782b916994fd36b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xe782b916994fd372 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783964972.474043:0:8328:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1783964972.474049:0:8328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e43b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ae0997f7-3a15-4fc6-865a-35b2f101956e+6:8323:x1870622732870656:12345-0@lo:104: Request processed in 144us (3440us total) trans 0 rc 0/0 00000100:00100000:2.0:1783964972.474055:0:8328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1783964972.474067:0:8328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1783964972.474072:0:8328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e438700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ae0997f7-3a15-4fc6-865a-35b2f101956e+5:8323:x1870622732870784:12345-0@lo:104: 00010000:00010000:2.0:1783964972.474080:0:8328:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.112@tcp lock: ffff9474420fe800/0xe782b916994fd341 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xe782b916994fd348 expref: -99 pid: 7506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783964972.474112:0:8328:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1783964972.474117:0:8328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e438700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ae0997f7-3a15-4fc6-865a-35b2f101956e+5:8323:x1870622732870784:12345-0@lo:104: Request processed in 46us (2307us total) trans 0 rc 0/0 00000100:00100000:2.0:1783964972.474123:0:8328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1783964972.474136:0:8328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1783964972.474141:0:8328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e439c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ae0997f7-3a15-4fc6-865a-35b2f101956e+4:8323:x1870622732870912:12345-0@lo:104: 00010000:00010000:2.0:1783964972.474150:0:8328:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.112@tcp lock: ffff947400030a00/0xe782b916994fd317 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xe782b916994fd31e expref: -99 pid: 7506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783964972.474192:0:8328:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1783964972.474198:0:8328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e439c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ae0997f7-3a15-4fc6-865a-35b2f101956e+4:8323:x1870622732870912:12345-0@lo:104: Request processed in 56us (2313us total) trans 0 rc 0/0 00000100:00100000:2.0:1783964972.474248:0:8328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1783964972.474383:0:8323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e439180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8323:1870622732870656:0@lo:104: 00000100:00100000:3.0:1783964972.474392:0:8323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e439880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8323:1870622732870784:0@lo:104: 00000100:00100000:3.0:1783964972.474398:0:8323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e43bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8323:1870622732870912:0@lo:104: 00010000:00010000:1.0:1783964972.474508:0:5796:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1783964972.474516:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e439500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ae0997f7-3a15-4fc6-865a-35b2f101956e+3:8323:x1870622732870528:12345-0@lo:104: Request processed in 3360us (8857us total) trans 0 rc 0/0 00000100:00100000:1.0:1783964972.474525:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00010000:0.0:1783964972.474628:0:5801:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1783964972.474636:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.112@tcp lock: ffff947401482c00/0xe782b916994fd36b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0xe782b916994fd372 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964972.474645:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947401482c00 already unused, calling callback (ffffffffc1ca8c20) 10000000:00010000:0.0:1783964972.474649:0:5801:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.112@tcp lock: ffff947401482c00/0xe782b916994fd36b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0xe782b916994fd372 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964972.474658:0:5801:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.112@tcp lock: ffff947401482c00/0xe782b916994fd36b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0xe782b916994fd372 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783964972.474666:0:5801:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.112@tcp lock: ffff947401482c00/0xe782b916994fd36b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0xe782b916994fd372 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783964972.474672:0:5801:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783964972.474723:0:5801:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.112@tcp lock: ffff947401482c00/0xe782b916994fd36b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe782b916994fd372 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783964972.474867:0:8323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e43b480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8323:1870622732870528:0@lo:104: 00010000:00010000:3.0:1783964972.474925:0:8323:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff947436f27400/0xe782b916994fd421 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964972.474969:0:5801:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783964972.475000:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.112@tcp lock: ffff947401482c00/0xe782b916994fd36b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe782b916994fd372 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964972.475008:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.112@tcp lock: ffff947401482c00/0xe782b916994fd36b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe782b916994fd372 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964972.475039:0:5801:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1783964972.475043:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.112@tcp lock: ffff9474420fe800/0xe782b916994fd341 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe782b916994fd348 expref: -99 pid: 7506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964972.475049:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9474420fe800 already unused, calling callback (ffffffffc1ca8c20) 10000000:00010000:0.0:1783964972.475052:0:5801:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.112@tcp lock: ffff9474420fe800/0xe782b916994fd341 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xe782b916994fd348 expref: -99 pid: 7506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964972.475059:0:5801:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.112@tcp lock: ffff9474420fe800/0xe782b916994fd341 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xe782b916994fd348 expref: -99 pid: 7506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783964972.475065:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947429f98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ae0997f7-3a15-4fc6-865a-35b2f101956e:3324:1870622732871424:0@lo:103: 10000000:00010000:0.0:1783964972.475068:0:5801:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.112@tcp lock: ffff9474420fe800/0xe782b916994fd341 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xe782b916994fd348 expref: -99 pid: 7506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783964972.475077:0:5801:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783964972.475096:0:5801:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.112@tcp lock: ffff9474420fe800/0xe782b916994fd341 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe782b916994fd348 expref: -99 pid: 7506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964972.475103:0:5801:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783964972.475110:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.112@tcp lock: ffff9474420fe800/0xe782b916994fd341 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe782b916994fd348 expref: -99 pid: 7506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964972.475116:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.112@tcp lock: ffff9474420fe800/0xe782b916994fd341 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe782b916994fd348 expref: -99 pid: 7506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783964972.475126:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783964972.475128:0:5801:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783964972.475133:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.112@tcp lock: ffff947400030a00/0xe782b916994fd317 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe782b916994fd31e expref: -99 pid: 7506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964972.475152:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947400030a00 already unused, calling callback (ffffffffc1ca8c20) 10000000:00010000:0.0:1783964972.475155:0:5801:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.112@tcp lock: ffff947400030a00/0xe782b916994fd317 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xe782b916994fd31e expref: -99 pid: 7506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964972.475162:0:5801:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.112@tcp lock: ffff947400030a00/0xe782b916994fd317 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xe782b916994fd31e expref: -99 pid: 7506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783964972.475169:0:5801:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.112@tcp lock: ffff947400030a00/0xe782b916994fd317 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xe782b916994fd31e expref: -99 pid: 7506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783964972.475174:0:3324:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 10000000:01000000:0.0:1783964972.475174:0:5801:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1783964972.475185:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947429f99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ae0997f7-3a15-4fc6-865a-35b2f101956e:3324:1870622732871552:0@lo:103: 00010000:00010000:0.0:1783964972.475195:0:5801:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.112@tcp lock: ffff947400030a00/0xe782b916994fd317 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe782b916994fd31e expref: -99 pid: 7506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964972.475245:0:5801:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1783964972.475251:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783964972.475265:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.112@tcp lock: ffff947400030a00/0xe782b916994fd317 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe782b916994fd31e expref: -99 pid: 7506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964972.475274:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.112@tcp lock: ffff947400030a00/0xe782b916994fd317 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe782b916994fd31e expref: -99 pid: 7506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964972.475286:0:5801:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783964972.475290:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.112@tcp lock: ffff947430c11400/0xe782b916994fd379 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe782b916994fd380 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783964972.475293:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732871424 00000100:00100000:2.0:1783964972.475300:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732871424 00010000:00010000:0.0:1783964972.475300:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947430c11400 already unused, calling callback (ffffffffc1ca8c20) 10000000:00010000:0.0:1783964972.475304:0:5801:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.112@tcp lock: ffff947430c11400/0xe782b916994fd379 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe782b916994fd380 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964972.475323:0:5801:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.112@tcp lock: ffff947430c11400/0xe782b916994fd379 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe782b916994fd380 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783964972.475329:0:5801:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.112@tcp lock: ffff947430c11400/0xe782b916994fd379 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe782b916994fd380 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783964972.475347:0:5801:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1783964972.475362:0:5801:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.112@tcp lock: ffff947430c11400/0xe782b916994fd379 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe782b916994fd380 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964972.475368:0:5801:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783964972.475374:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.112@tcp lock: ffff947430c11400/0xe782b916994fd379 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe782b916994fd380 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964972.475380:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.112@tcp lock: ffff947430c11400/0xe782b916994fd379 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe782b916994fd380 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964972.475398:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783964972.475400:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783964972.475401:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783964972.475413:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947429f9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ae0997f7-3a15-4fc6-865a-35b2f101956e:3323:1870622732871808:0@lo:103: 00000100:00100000:0.0:1783964972.475725:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783964972.475754:0:3323:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783964972.475760:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947429f98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ae0997f7-3a15-4fc6-865a-35b2f101956e:3323:1870622732871680:0@lo:103: 00010000:00010000:2.0:1783964972.475790:0:5799:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff947430c10a00/0xe782b916994fd372 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe782b916994fd36b expref: 16 pid: 5807 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783964972.475800:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783964972.475828:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732871552 00000100:00100000:2.0:1783964972.475833:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732871552 00010000:00010000:2.0:1783964972.475851:0:5799:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff947430c10e00/0xe782b916994fd348 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe782b916994fd341 expref: 17 pid: 5805 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783964972.475865:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732871808 00010000:00010000:0.0:1783964972.475867:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783964972.475868:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732871808 00010000:00010000:2.0:1783964972.475881:0:5799:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff947400031600/0xe782b916994fd380 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe782b916994fd379 expref: 18 pid: 5807 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783964972.475882:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732871680 00000100:00100000:0.0:1783964972.475889:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732871680 00000100:00100000:2.0:1783964972.475901:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1783964972.475910:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9474072a9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ae0997f7-3a15-4fc6-865a-35b2f101956e+19:3324:x1870622732871424:12345-0@lo:103: 00010000:00010000:0.0:1783964972.475914:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9474420fea00/0xe782b916994fd31e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe782b916994fd317 expref: 19 pid: 5806 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783964972.475928:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783964972.475938:0:5799:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff947430c10a00/0xe782b916994fd372 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe782b916994fd36b expref: 19 pid: 5807 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783964972.475947:0:5797:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:2.0:1783964972.475962:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff947430c10a00/0xe782b916994fd372 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe782b916994fd36b expref: 19 pid: 5807 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783964972.475962:0:5797:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:2.0:1783964972.476173:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff947430c10a00/0xe782b916994fd372 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe782b916994fd36b expref: 19 pid: 5807 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783964972.476192:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783964972.476497:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9474072a9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ae0997f7-3a15-4fc6-865a-35b2f101956e+18:3324:x1870622732871424:12345-0@lo:103: Request processed in 586us (1370us total) trans 0 rc 0/0 00000100:00100000:2.0:1783964972.476505:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1783964972.476527:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1783964972.476534:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94741843ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ae0997f7-3a15-4fc6-865a-35b2f101956e+17:3324:x1870622732871552:12345-0@lo:103: 00010000:00010000:2.0:1783964972.476542:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783964972.476547:0:5799:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff947430c10e00/0xe782b916994fd348 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe782b916994fd341 expref: 17 pid: 5805 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783964972.476557:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff947430c10e00/0xe782b916994fd348 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe782b916994fd341 expref: 17 pid: 5805 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783964972.476568:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff947430c10e00/0xe782b916994fd348 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe782b916994fd341 expref: 17 pid: 5805 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783964972.476741:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1783964972.476743:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947429f98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ae0997f7-3a15-4fc6-865a-35b2f101956e:3324:1870622732871424:0@lo:103: 00000100:00100000:0.0:1783964972.476754:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947429f9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ae0997f7-3a15-4fc6-865a-35b2f101956e+17:3323:x1870622732871808:12345-0@lo:103: 00010000:00010000:0.0:1783964972.476764:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783964972.476779:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff947400031600/0xe782b916994fd380 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe782b916994fd379 expref: 17 pid: 5807 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964972.476790:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff947400031600/0xe782b916994fd380 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe782b916994fd379 expref: 17 pid: 5807 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964972.476802:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff947400031600/0xe782b916994fd380 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe782b916994fd379 expref: 17 pid: 5807 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783964972.476812:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783964972.476817:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783964972.476861:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947429f9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ae0997f7-3a15-4fc6-865a-35b2f101956e+15:3323:x1870622732871808:12345-0@lo:103: Request processed in 111us (1135us total) trans 0 rc 0/0 00000100:00100000:0.0:1783964972.476869:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1783964972.476886:0:5797:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1783964972.476897:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94741843ec50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ae0997f7-3a15-4fc6-865a-35b2f101956e+14:3324:x1870622732871552:12345-0@lo:103: Request processed in 362us (1645us total) trans 0 rc 0/0 00000100:00100000:0.0:1783964972.476899:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1783964972.476910:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1783964972.476912:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947429f9a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ae0997f7-3a15-4fc6-865a-35b2f101956e+14:3323:x1870622732871680:12345-0@lo:103: 00010000:00010000:0.0:1783964972.476922:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783964972.476927:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9474420fea00/0xe782b916994fd31e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe782b916994fd317 expref: 13 pid: 5806 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964972.476937:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9474420fea00/0xe782b916994fd31e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe782b916994fd317 expref: 13 pid: 5806 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964972.476965:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9474420fea00/0xe782b916994fd31e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe782b916994fd317 expref: 13 pid: 5806 timeout: 356 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964972.476980:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff947436f27400/0xe782b916994fd421 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964972.476990:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff947436f27400/0xe782b916994fd421 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964972.477005:0:5797:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff947436f27400/0xe782b916994fd421 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964972.477013:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff947436f27400/0xe782b916994fd421 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964972.477020:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff947436f27400/0xe782b916994fd421 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964972.477026:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff947436f27400/0xe782b916994fd421 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964972.477033:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947436f27400 already unused, calling callback (ffffffffc168d230) 00010000:00010000:0.0:1783964972.477038:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff947436f27400/0xe782b916994fd421 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964972.477046:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff947436f27400/0xe782b916994fd421 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783964972.477061:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947429f99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ae0997f7-3a15-4fc6-865a-35b2f101956e:3324:1870622732871552:0@lo:103: 00010000:00010000:0.0:1783964972.477069:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff947436f27400/0xe782b916994fd421 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964972.477094:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783964972.477123:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947429f9a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ae0997f7-3a15-4fc6-865a-35b2f101956e+12:3323:x1870622732871680:12345-0@lo:103: Request processed in 212us (1325us total) trans 0 rc 0/0 00010000:00010000:2.0:1783964972.477124:0:8323:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff947436f27400/0xe782b916994fd421 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783964972.477135:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:2.0:1783964972.477150:0:8323:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff947436f27400/0xe782b916994fd421 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783964972.477158:0:8323:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff947436f27400/0xe782b916994fd421 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8323 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783964972.477171:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947429f98a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ae0997f7-3a15-4fc6-865a-35b2f101956e:3323:1870622732871680:0@lo:103: 00000100:00100000:0.0:1783964972.477183:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947429f9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ae0997f7-3a15-4fc6-865a-35b2f101956e:3323:1870622732871808:0@lo:103: 00010000:00010000:0.0:1783964972.717701:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783964973.432679:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783964973.432861:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715023744 00000100:00100000:0.0:1783964973.432873:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715023744 00000100:00100000:0.0:1783964973.432956:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 21 00000100:00100000:0.0:1783964973.432967:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e29a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9923189b-eb4a-470c-ab45-969435371000+6:2360:x1870622715023744:12345-192.168.204.12@tcp:400: 00000100:00100000:0.0:1783964973.433055:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e29a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9923189b-eb4a-470c-ab45-969435371000+6:2360:x1870622715023744:12345-192.168.204.12@tcp:400: Request processed in 90us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1783964973.433062:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 21 00000100:00100000:3.0:1783964973.433294:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783964973.433429:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783964973.433449:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783964973.433583:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715024000 00000100:00100000:2.0:1783964973.433588:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715024000 00000100:00100000:2.0:1783964973.433624:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715023872 00000100:00100000:2.0:1783964973.433627:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715023872 00000100:00100000:2.0:1783964973.433644:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 9 00000100:00100000:2.0:1783964973.433651:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e43b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9923189b-eb4a-470c-ab45-969435371000+5:2360:x1870622715024000:12345-192.168.204.12@tcp:400: 00000100:00100000:2.0:1783964973.433688:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e43b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9923189b-eb4a-470c-ab45-969435371000+5:2360:x1870622715024000:12345-192.168.204.12@tcp:400: Request processed in 38us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1783964973.433695:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 9 00000100:00100000:2.0:1783964973.433707:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 10 00000100:00100000:2.0:1783964973.433713:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e43bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9923189b-eb4a-470c-ab45-969435371000+5:2360:x1870622715023872:12345-192.168.204.12@tcp:400: 00000100:00100000:2.0:1783964973.433738:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e43bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9923189b-eb4a-470c-ab45-969435371000+5:2360:x1870622715023872:12345-192.168.204.12@tcp:400: Request processed in 24us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1783964973.433744:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 10 00000100:00080000:1.0:1783964973.434115:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783964973.434128:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783964973.434146:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783964973.434158:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715023616 00000100:00100000:1.0:1783964973.434162:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715023616 00000100:00100000:1.0:1783964973.434246:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 129 00000100:00100000:1.0:1783964973.434254:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94740951e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+8:2360:x1870622715023616:12345-192.168.204.12@tcp:400: 00000100:00100000:1.0:1783964973.434291:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94740951e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+8:2360:x1870622715023616:12345-192.168.204.12@tcp:400: Request processed in 39us (862us total) trans 0 rc 0/0 00000100:00100000:1.0:1783964973.434297:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 129 00000100:00100000:0.0:1783964973.611668:0:3325:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783964973.611697:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e29b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3325:1870622732871936:0@lo:13: 00000100:00100000:0.0:1783964973.611778:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783964973.612000:0:6610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732871936 00000100:00100000:1.0:1783964973.612013:0:6610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732871936 00000100:00100000:1.0:1783964973.612097:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1783964973.612107:0:6610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947429f9b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3325:x1870622732871936:12345-0@lo:13: 00002000:00000024:1.0:1783964973.612151:0:6610:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783964973.612257:0:6610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947429f9b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3325:x1870622732871936:12345-0@lo:13: Request processed in 151us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1783964973.612265:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:1.0:1783964973.612307:0:3325:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94743e29b480 x1870622732871936/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783964989 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783964973.612328:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e29b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3325:1870622732871936:0@lo:13: 00000100:00080000:0.0:1783964973.612440:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783964973.612821:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947436305500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3324:1870622732872448:0@lo:400: 00000100:00100000:3.0:1783964973.612860:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783964973.612893:0:3324:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1783964973.612899:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9474072a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ae0997f7-3a15-4fc6-865a-35b2f101956e:3324:1870622732872064:0@lo:400: 00000100:00100000:3.0:1783964973.612928:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783964973.612953:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947436306d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3324:1870622732872576:0@lo:400: 00000100:00100000:3.0:1783964973.612978:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783964973.613005:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732872064 00000100:00100000:3.0:1783964973.613010:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732872064 00000100:00100000:3.0:1783964973.613041:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1783964973.613048:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94740951c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae0997f7-3a15-4fc6-865a-35b2f101956e+12:3324:x1870622732872064:12345-0@lo:400: 00000100:00100000:3.0:1783964973.613088:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94740951c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae0997f7-3a15-4fc6-865a-35b2f101956e+12:3324:x1870622732872064:12345-0@lo:400: Request processed in 41us (159us total) trans 0 rc 0/0 00000100:00100000:3.0:1783964973.613110:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1783964973.613147:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9474072a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ae0997f7-3a15-4fc6-865a-35b2f101956e:3324:1870622732872064:0@lo:400: 00000100:00100000:0.0:1783964973.613415:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9474368d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3322:1870622732872192:0@lo:400: 00000100:00100000:0.0:1783964973.613446:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783964973.613483:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783964973.613489:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947436307100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3322:1870622732872320:0@lo:400: 00000100:00100000:0.0:1783964973.613511:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783964973.613544:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732872576 00000100:00100000:0.0:1783964973.613547:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732872576 00000100:00100000:0.0:1783964973.613596:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732872192 00000100:00100000:0.0:1783964973.613600:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732872192 00000100:00100000:0.0:1783964973.613611:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732872320 00000100:00100000:0.0:1783964973.613614:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732872320 00000100:00100000:0.0:1783964973.613628:0:6632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1783964973.613634:0:6632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e439180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3324:x1870622732872576:12345-0@lo:400: 00000100:00100000:0.0:1783964973.613671:0:6632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e439180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3324:x1870622732872576:12345-0@lo:400: Request processed in 37us (692us total) trans 0 rc 0/0 00000100:00100000:0.0:1783964973.613677:0:6632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1783964973.613690:0:6632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1783964973.613696:0:6632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947429f98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3322:x1870622732872192:12345-0@lo:400: 00000100:00100000:0.0:1783964973.613727:0:6632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947429f98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3322:x1870622732872192:12345-0@lo:400: Request processed in 31us (280us total) trans 0 rc 0/0 00000100:00100000:0.0:1783964973.613732:0:6632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1783964973.613742:0:6632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1783964973.613748:0:6632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947429f9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3322:x1870622732872320:12345-0@lo:400: 00000100:00100000:0.0:1783964973.613774:0:6632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947429f9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3322:x1870622732872320:12345-0@lo:400: Request processed in 26us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1783964973.613779:0:6632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:0.0:1783964973.613793:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783964973.613811:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947436307100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3322:1870622732872320:0@lo:400: 00000100:00100000:0.0:1783964973.613821:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9474368d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3322:1870622732872192:0@lo:400: 00000100:00100000:3.0:1783964973.614071:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947436306d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3324:1870622732872576:0@lo:400: 00000100:00100000:2.0:1783964973.614178:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732872448 00000100:00100000:2.0:1783964973.614183:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732872448 00000100:00100000:2.0:1783964973.614263:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1783964973.614271:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e439880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3324:x1870622732872448:12345-0@lo:400: 00000100:00100000:2.0:1783964973.614312:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e439880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3324:x1870622732872448:12345-0@lo:400: Request processed in 42us (1451us total) trans 0 rc 0/0 00000100:00100000:2.0:1783964973.614327:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:3.0:1783964973.614404:0:3324:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff947436305500 x1870622732872448/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783964989 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783964973.614415:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947436305500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3324:1870622732872448:0@lo:400: 00000100:00080000:0.0:1783964973.614729:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1783964973.739544:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783964973.756990:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783964973.757107:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715024128 00000100:00100000:2.0:1783964973.757118:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715024128 00000100:00100000:2.0:1783964973.757234:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 131 00000100:00100000:2.0:1783964973.757245:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94740951c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+8:5573:x1870622715024128:12345-192.168.204.12@tcp:101: 00010000:00010000:2.0:1783964973.757266:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783964973.757292:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff947425974800/0xe782b916994fd428 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5efe7c expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783964973.757327:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff947425974800/0xe782b916994fd428 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5efe7c expref: 9 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783964973.757734:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff947425974800/0xe782b916994fd428 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5efe7c expref: 9 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783964973.757745:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff947425974800, rc 0) 00000100:00100000:2.0:1783964973.758458:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94740951c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+9:5573:x1870622715024128:12345-192.168.204.12@tcp:101: Request processed in 1211us (1474us total) trans 0 rc 0/0 00000100:00100000:2.0:1783964973.758467:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 131 00000100:00100000:1.0:1783964973.760562:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783964973.760750:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715024256 00000100:00100000:3.0:1783964973.760761:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715024256 00000100:00100000:3.0:1783964973.760829:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 132 00000100:00100000:3.0:1783964973.760839:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94740951ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+9:5573:x1870622715024256:12345-192.168.204.12@tcp:501: 00000100:00100000:3.0:1783964973.761140:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94740951ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+9:5573:x1870622715024256:12345-192.168.204.12@tcp:501: Request processed in 301us (597us total) trans 0 rc 0/0 00000100:00100000:3.0:1783964973.761148:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 132 00000100:00100000:3.0:1783964973.764045:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783964973.764242:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715024384 00000100:00100000:2.0:1783964973.764255:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715024384 00000100:00100000:2.0:1783964973.764319:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 133 00000100:00100000:2.0:1783964973.764330:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94740951dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+9:5573:x1870622715024384:12345-192.168.204.12@tcp:503: 00000100:00100000:2.0:1783964973.764596:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94740951dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+9:5573:x1870622715024384:12345-192.168.204.12@tcp:503: Request processed in 266us (558us total) trans 0 rc 0/0 00000100:00100000:2.0:1783964973.764613:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 133 00000100:00100000:1.0:1783964973.771660:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783964973.771994:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715024512 00000100:00100000:0.0:1783964973.772006:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715024512 00000100:00100000:0.0:1783964973.772079:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 134 00000100:00100000:0.0:1783964973.772088:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94740951fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+9:6046:x1870622715024512:12345-192.168.204.12@tcp:502: 00000100:00100000:0.0:1783964973.772645:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94740951fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+9:6046:x1870622715024512:12345-192.168.204.12@tcp:502: Request processed in 556us (993us total) trans 0 rc 0/0 00000100:00100000:0.0:1783964973.772654:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 134 00000100:00100000:1.0:1783964973.775648:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783964973.775804:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715024640 00000100:00100000:3.0:1783964973.775891:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715024640 00000100:00100000:3.0:1783964973.775953:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 135 00000100:00100000:3.0:1783964973.775964:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94741cee0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+9:6046:x1870622715024640:12345-192.168.204.12@tcp:502:llog_process_th.0 00000100:00100000:3.0:1783964973.776299:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94741cee0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+9:6046:x1870622715024640:12345-192.168.204.12@tcp:502:llog_process_th.0 Request processed in 335us (659us total) trans 0 rc 0/0 00000100:00100000:3.0:1783964973.776307:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 135 00000100:00100000:3.0:1783964973.782480:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783964973.782706:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715024768 00000100:00100000:2.0:1783964973.782739:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715024768 00000100:00100000:2.0:1783964973.782806:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 136 00000100:00100000:2.0:1783964973.782892:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94741cee1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+9:5573:x1870622715024768:12345-192.168.204.12@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783964973.782912:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783964973.782932:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff947425975000/0xe782b916994fd42f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5efe83 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783964973.782963:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff947425975000/0xe782b916994fd42f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5efe83 expref: 10 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783964973.782974:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff947425975000/0xe782b916994fd42f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5efe83 expref: 10 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783964973.782984:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff947425975000, rc 0) 00000100:00100000:2.0:1783964973.783061:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94741cee1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+10:5573:x1870622715024768:12345-192.168.204.12@tcp:101:ll_cfg_requeue.0 Request processed in 246us (598us total) trans 0 rc 0/0 00000100:00100000:2.0:1783964973.783069:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 136 00000100:00100000:1.0:1783964973.790020:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783964973.790145:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715024896 00000100:00100000:0.0:1783964973.790171:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715024896 00000100:00100000:0.0:1783964973.790296:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 137 00000100:00100000:0.0:1783964973.790308:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94741cee2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+10:5573:x1870622715024896:12345-192.168.204.12@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783964973.791051:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94741cee2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+10:5573:x1870622715024896:12345-192.168.204.12@tcp:501:ll_cfg_requeue.0 Request processed in 742us (1044us total) trans 0 rc -2/-2 00000100:00100000:0.0:1783964973.791063:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 137 10000000:01000000:0.0:1783964973.867406:0:5809:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1783964973.867418:0:5809:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff9474369fb000 from 39 10000000:01000000:0.0:1783964973.867426:0:5809:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1783964973.867500:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.112@tcp lock: ffff947400030a00/0xe782b916994fd436 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964973.867517:0:5809:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.112@tcp lock: ffff947400030a00/0xe782b916994fd436 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964973.867532:0:5809:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.112@tcp lock: ffff947400030a00/0xe782b916994fd436 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783964973.867566:0:5809:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947429f99500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae0997f7-3a15-4fc6-865a-35b2f101956e:5809:1870622732872704:0@lo:101: 00000100:00100000:0.0:1783964973.867805:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783964973.867958:0:5809:0:(client.c:2702:ptlrpc_set_wait()) set ffff94743709ed80 going to sleep for 11 seconds 00000100:00100000:3.0:1783964973.868167:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732872704 00000100:00100000:3.0:1783964973.868177:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732872704 00000100:00100000:3.0:1783964973.871842:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1783964973.871874:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94741cee0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+12:5809:x1870622732872704:12345-0@lo:101: 00010000:00010000:3.0:1783964973.871903:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783964973.871932:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff947436f27e00/0xe782b916994fd43d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe782b916994fd436 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964973.872007:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff947436f27e00/0xe782b916994fd43d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe782b916994fd436 expref: 13 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964973.872021:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff947436f27e00/0xe782b916994fd43d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe782b916994fd436 expref: 13 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964973.872032:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff947436f27e00, rc 0) 00000100:00100000:3.0:1783964973.872156:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94741cee0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+13:5809:x1870622732872704:12345-0@lo:101: Request processed in 290us (4342us total) trans 0 rc 0/0 00000100:00100000:3.0:1783964973.872166:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:0.0:1783964973.872341:0:5809:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947429f99500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae0997f7-3a15-4fc6-865a-35b2f101956e:5809:1870622732872704:0@lo:101: 00010000:00010000:0.0:1783964973.872374:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.112@tcp lock: ffff947400030a00/0xe782b916994fd436 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fd43d expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964973.872386:0:5809:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.112@tcp lock: ffff947400030a00/0xe782b916994fd436 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe782b916994fd43d expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783964973.872484:0:5809:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947429f99500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae0997f7-3a15-4fc6-865a-35b2f101956e:5809:1870622732872832:0@lo:501: 00000100:00100000:0.0:1783964973.872529:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783964973.883378:0:5809:0:(client.c:2702:ptlrpc_set_wait()) set ffff94743709ed80 going to sleep for 11 seconds 00000100:00100000:2.0:1783964973.884477:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732872832 00000100:00100000:2.0:1783964973.884495:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732872832 00000100:00100000:2.0:1783964973.884582:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1783964973.884595:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94741cee0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae0997f7-3a15-4fc6-865a-35b2f101956e+13:5809:x1870622732872832:12345-0@lo:501: 00000100:00100000:2.0:1783964973.885043:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94741cee0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae0997f7-3a15-4fc6-865a-35b2f101956e+13:5809:x1870622732872832:12345-0@lo:501: Request processed in 448us (12511us total) trans 0 rc 0/0 00000100:00100000:2.0:1783964973.885053:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:0.0:1783964973.885415:0:5809:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947429f99500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae0997f7-3a15-4fc6-865a-35b2f101956e:5809:1870622732872832:0@lo:501: 00000100:00100000:0.0:1783964973.885484:0:5809:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947429f99500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae0997f7-3a15-4fc6-865a-35b2f101956e:5809:1870622732872960:0@lo:503: 00000100:00100000:0.0:1783964973.885539:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783964973.885577:0:5809:0:(client.c:2702:ptlrpc_set_wait()) set ffff94743709ed80 going to sleep for 11 seconds 00000100:00100000:3.0:1783964973.885695:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732872960 00000100:00100000:3.0:1783964973.885702:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732872960 00000100:00100000:3.0:1783964973.885735:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:3.0:1783964973.885743:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94741cee2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+13:5809:x1870622732872960:12345-0@lo:503: 00000100:00100000:3.0:1783964973.885925:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94741cee2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+13:5809:x1870622732872960:12345-0@lo:503: Request processed in 182us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1783964973.885932:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1783964973.891996:0:5809:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947429f99500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae0997f7-3a15-4fc6-865a-35b2f101956e:5809:1870622732872960:0@lo:503: 00000100:00100000:2.0:1783964973.892816:0:8344:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947436306300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae0997f7-3a15-4fc6-865a-35b2f101956e:8344:1870622732873088:0@lo:502: 00000100:00100000:2.0:1783964973.892938:0:8344:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783964973.892992:0:8344:0:(client.c:2702:ptlrpc_set_wait()) set ffff94740954c180 going to sleep for 11 seconds 00000100:00100000:3.0:1783964973.893051:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732873088 00000100:00100000:3.0:1783964973.893059:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732873088 00000100:00100000:3.0:1783964973.893117:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1783964973.893129:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94741cee1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+13:8344:x1870622732873088:12345-0@lo:502: 00000100:00100000:3.0:1783964973.893801:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94741cee1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+13:8344:x1870622732873088:12345-0@lo:502: Request processed in 669us (860us total) trans 0 rc 0/0 00000100:00100000:3.0:1783964973.893814:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1783964973.893984:0:8344:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947436306300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae0997f7-3a15-4fc6-865a-35b2f101956e:8344:1870622732873088:0@lo:502: 00000100:00100000:2.0:1783964973.894055:0:8344:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947436306300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae0997f7-3a15-4fc6-865a-35b2f101956e:8344:1870622732873216:0@lo:502: 00000100:00100000:2.0:1783964973.894095:0:8344:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783964973.894132:0:8344:0:(client.c:2702:ptlrpc_set_wait()) set ffff94740954c180 going to sleep for 11 seconds 00000100:00100000:3.0:1783964973.895382:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732873216 00000100:00100000:3.0:1783964973.895398:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732873216 00000100:00100000:3.0:1783964973.895463:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1783964973.895482:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94741cee3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae0997f7-3a15-4fc6-865a-35b2f101956e+13:8344:x1870622732873216:12345-0@lo:502: 00000100:00100000:3.0:1783964973.895884:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94741cee3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae0997f7-3a15-4fc6-865a-35b2f101956e+13:8344:x1870622732873216:12345-0@lo:502: Request processed in 402us (1787us total) trans 0 rc 0/0 00000100:00100000:3.0:1783964973.895892:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1783964973.896002:0:8344:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947436306300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae0997f7-3a15-4fc6-865a-35b2f101956e:8344:1870622732873216:0@lo:502: 00000040:00080000:2.0:1783964973.896041:0:8344:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1783964973.897370:0:5809:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1783964973.897403:0:5809:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.112@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1783964973.897418:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.112@tcp lock: ffff947400030a00/0xe782b916994fd436 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fd43d expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964973.897433:0:5809:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.112@tcp lock: ffff947400030a00/0xe782b916994fd436 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fd43d expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783964973.897445:0:5809:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:0.0:1783964973.897448:0:5809:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:0.0:1783964973.897451:0:5809:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1783964973.897499:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.112@tcp lock: ffff947400030e00/0xe782b916994fd444 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964973.897526:0:5809:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.112@tcp lock: ffff947400030e00/0xe782b916994fd444 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964973.897538:0:5809:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.112@tcp lock: ffff947400030e00/0xe782b916994fd444 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783964973.897566:0:5809:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947429f99500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae0997f7-3a15-4fc6-865a-35b2f101956e:5809:1870622732873344:0@lo:101: 00000100:00100000:0.0:1783964973.897642:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783964973.897693:0:5809:0:(client.c:2702:ptlrpc_set_wait()) set ffff94743709ed80 going to sleep for 11 seconds 00000100:00100000:2.0:1783964973.897810:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732873344 00000100:00100000:2.0:1783964973.897818:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732873344 00000100:00100000:2.0:1783964973.897872:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1783964973.897883:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94741cee1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+13:5809:x1870622732873344:12345-0@lo:101: 00010000:00010000:2.0:1783964973.897897:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783964973.897914:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff947425975400/0xe782b916994fd44b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe782b916994fd444 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783964973.897946:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff947425975400/0xe782b916994fd44b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe782b916994fd444 expref: 14 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783964973.897959:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff947425975400/0xe782b916994fd44b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe782b916994fd444 expref: 14 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783964973.897969:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff947425975400, rc 0) 00000100:00100000:2.0:1783964973.898023:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94741cee1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+14:5809:x1870622732873344:12345-0@lo:101: Request processed in 142us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1783964973.898030:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1783964973.898195:0:5809:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947429f99500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae0997f7-3a15-4fc6-865a-35b2f101956e:5809:1870622732873344:0@lo:101: 00010000:00010000:1.0:1783964973.898241:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.112@tcp lock: ffff947400030e00/0xe782b916994fd444 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fd44b expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964973.898438:0:5809:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.112@tcp lock: ffff947400030e00/0xe782b916994fd444 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe782b916994fd44b expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783964973.898513:0:5809:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e29b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae0997f7-3a15-4fc6-865a-35b2f101956e:5809:1870622732873472:0@lo:501: 00000100:00100000:1.0:1783964973.898552:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783964973.898588:0:5809:0:(client.c:2702:ptlrpc_set_wait()) set ffff94743e2e3180 going to sleep for 11 seconds 00000100:00100000:2.0:1783964973.898684:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732873472 00000100:00100000:2.0:1783964973.898689:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732873472 00000100:00100000:2.0:1783964973.898727:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1783964973.898736:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94741cee3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae0997f7-3a15-4fc6-865a-35b2f101956e+14:5809:x1870622732873472:12345-0@lo:501: 00000100:00100000:2.0:1783964973.899105:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94741cee3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae0997f7-3a15-4fc6-865a-35b2f101956e+14:5809:x1870622732873472:12345-0@lo:501: Request processed in 368us (551us total) trans 0 rc 0/0 00000100:00100000:2.0:1783964973.899120:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1783964973.899371:0:5809:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e29b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae0997f7-3a15-4fc6-865a-35b2f101956e:5809:1870622732873472:0@lo:501: 00000100:00100000:2.0:1783964973.899417:0:5809:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947436306300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae0997f7-3a15-4fc6-865a-35b2f101956e:5809:1870622732873600:0@lo:503: 00000100:00100000:2.0:1783964973.899463:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783964973.899486:0:5809:0:(client.c:2702:ptlrpc_set_wait()) set ffff94740954c780 going to sleep for 11 seconds 00000100:00100000:2.0:1783964973.899501:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732873600 00000100:00100000:2.0:1783964973.899506:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732873600 00000100:00100000:2.0:1783964973.899527:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1783964973.899534:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94741cee3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae0997f7-3a15-4fc6-865a-35b2f101956e+14:5809:x1870622732873600:12345-0@lo:503: 00000100:00100000:2.0:1783964973.900718:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94741cee3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae0997f7-3a15-4fc6-865a-35b2f101956e+14:5809:x1870622732873600:12345-0@lo:503: Request processed in 1174us (1245us total) trans 0 rc 0/0 00000100:00100000:2.0:1783964973.900730:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1783964973.909121:0:5809:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947436306300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae0997f7-3a15-4fc6-865a-35b2f101956e:5809:1870622732873600:0@lo:503: 00000100:00100000:1.0:1783964973.911528:0:8345:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e299500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae0997f7-3a15-4fc6-865a-35b2f101956e:8345:1870622732873728:0@lo:502: 00000100:00100000:1.0:1783964973.911702:0:8345:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783964973.911763:0:8345:0:(client.c:2702:ptlrpc_set_wait()) set ffff94743e2e3540 going to sleep for 11 seconds 00000100:00100000:3.0:1783964973.911843:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732873728 00000100:00100000:3.0:1783964973.911852:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732873728 00000100:00100000:3.0:1783964973.911915:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1783964973.911928:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94741cee3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+14:8345:x1870622732873728:12345-0@lo:502: 00000100:00100000:3.0:1783964973.912273:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94741cee3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+14:8345:x1870622732873728:12345-0@lo:502: Request processed in 347us (571us total) trans 0 rc 0/0 00000100:00100000:3.0:1783964973.912282:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1783964973.912556:0:8345:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e299500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae0997f7-3a15-4fc6-865a-35b2f101956e:8345:1870622732873728:0@lo:502: 00000020:01000000:1.0:1783964973.912591:0:8345:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783964973.912666:0:8345:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783964973.912670:0:8345:0:(obd_config.c:1561:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1783964973.912678:0:8345:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1783964973.912710:0:8345:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e299500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae0997f7-3a15-4fc6-865a-35b2f101956e:8345:1870622732873856:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783964973.912752:0:8345:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783964973.912818:0:8345:0:(client.c:2702:ptlrpc_set_wait()) set ffff94743e2e3540 going to sleep for 11 seconds 00000100:00100000:2.0:1783964973.916464:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732873856 00000100:00100000:2.0:1783964973.916485:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732873856 00000100:00100000:3.0:1783964973.920008:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1783964973.920028:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94741cee0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae0997f7-3a15-4fc6-865a-35b2f101956e+14:8345:x1870622732873856:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783964973.920481:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94741cee0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae0997f7-3a15-4fc6-865a-35b2f101956e+14:8345:x1870622732873856:12345-0@lo:502:llog_process_th.0 Request processed in 457us (7727us total) trans 0 rc 0/0 00000100:00100000:3.0:1783964973.920492:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1783964973.920644:0:8345:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e299500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae0997f7-3a15-4fc6-865a-35b2f101956e:8345:1870622732873856:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783964973.920695:0:8345:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783964973.920705:0:8345:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783964973.920708:0:8345:0:(obd_config.c:1561:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1783964973.920715:0:8345:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:0.0:1783964973.921243:0:5809:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:0.0:1783964973.921272:0:5809:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.112@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1783964973.921287:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.112@tcp lock: ffff947400030e00/0xe782b916994fd444 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fd44b expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964973.921301:0:5809:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.112@tcp lock: ffff947400030e00/0xe782b916994fd444 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fd44b expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783964973.921313:0:5809:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1783964973.921316:0:5809:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff94743e519000 from 39 10000000:01000000:0.0:1783964973.921320:0:5809:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1783964973.921364:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.112@tcp lock: ffff947400031600/0xe782b916994fd452 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964973.921373:0:5809:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.112@tcp lock: ffff947400031600/0xe782b916994fd452 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964973.921383:0:5809:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.112@tcp lock: ffff947400031600/0xe782b916994fd452 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783964973.921422:0:5809:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947429f99180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae0997f7-3a15-4fc6-865a-35b2f101956e:5809:1870622732873984:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783964973.921476:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783964973.922006:0:5809:0:(client.c:2702:ptlrpc_set_wait()) set ffff94743709e600 going to sleep for 11 seconds 00000100:00100000:2.0:1783964973.922052:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732873984 00000100:00100000:2.0:1783964973.922061:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732873984 00000100:00100000:2.0:1783964973.922102:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1783964973.922112:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94741cee1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+14:5809:x1870622732873984:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783964973.922125:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783964973.922259:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff947425975e00/0xe782b916994fd459 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xe782b916994fd452 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783964973.922294:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff947425975e00/0xe782b916994fd459 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe782b916994fd452 expref: 15 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783964973.922308:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff947425975e00/0xe782b916994fd459 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe782b916994fd452 expref: 15 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783964973.922332:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff947425975e00, rc 0) 00000100:00100000:2.0:1783964973.922383:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94741cee1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+15:5809:x1870622732873984:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 272us (906us total) trans 0 rc 0/0 00000100:00100000:2.0:1783964973.922390:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1783964973.922722:0:5809:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947429f99180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae0997f7-3a15-4fc6-865a-35b2f101956e:5809:1870622732873984:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783964973.922740:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.112@tcp lock: ffff947400031600/0xe782b916994fd452 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fd459 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964973.922750:0:5809:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.112@tcp lock: ffff947400031600/0xe782b916994fd452 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe782b916994fd459 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783964973.922818:0:5809:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947429f99180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae0997f7-3a15-4fc6-865a-35b2f101956e:5809:1870622732874112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783964973.922851:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783964973.922883:0:5809:0:(client.c:2702:ptlrpc_set_wait()) set ffff94743709e600 going to sleep for 11 seconds 00000100:00100000:1.0:1783964973.922957:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732874112 00000100:00100000:1.0:1783964973.922962:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732874112 00000100:00100000:1.0:1783964973.922985:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:1.0:1783964973.922998:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94741cee2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae0997f7-3a15-4fc6-865a-35b2f101956e+15:5809:x1870622732874112:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783964973.923479:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94741cee2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae0997f7-3a15-4fc6-865a-35b2f101956e+15:5809:x1870622732874112:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 479us (624us total) trans 0 rc 0/0 00000100:00100000:1.0:1783964973.923486:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1783964973.923665:0:5809:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947429f99180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae0997f7-3a15-4fc6-865a-35b2f101956e:5809:1870622732874112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783964973.923703:0:5809:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947429f99180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae0997f7-3a15-4fc6-865a-35b2f101956e:5809:1870622732874240:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783964973.923747:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783964973.924502:0:5809:0:(client.c:2702:ptlrpc_set_wait()) set ffff94743709e600 going to sleep for 11 seconds 00000100:00100000:3.0:1783964973.924562:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732874240 00000100:00100000:3.0:1783964973.924569:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732874240 00000100:00100000:1.0:1783964973.924712:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1783964973.924722:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94741cee2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae0997f7-3a15-4fc6-865a-35b2f101956e+15:5809:x1870622732874240:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783964973.925027:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94741cee2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae0997f7-3a15-4fc6-865a-35b2f101956e+15:5809:x1870622732874240:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 306us (1279us total) trans 0 rc 0/0 00000100:00100000:1.0:1783964973.925034:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1783964973.934997:0:5809:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947429f99180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae0997f7-3a15-4fc6-865a-35b2f101956e:5809:1870622732874240:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783964973.935956:0:8346:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947429f99180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae0997f7-3a15-4fc6-865a-35b2f101956e:8346:1870622732874368:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783964973.936059:0:8346:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783964973.936113:0:8346:0:(client.c:2702:ptlrpc_set_wait()) set ffff94743709e000 going to sleep for 11 seconds 00000100:00100000:1.0:1783964973.936256:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732874368 00000100:00100000:1.0:1783964973.936265:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732874368 00000100:00100000:1.0:1783964973.936338:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1783964973.936350:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947408ec8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae0997f7-3a15-4fc6-865a-35b2f101956e+15:8346:x1870622732874368:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783964973.936866:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947408ec8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae0997f7-3a15-4fc6-865a-35b2f101956e+15:8346:x1870622732874368:12345-0@lo:502:llog_process_th.0 Request processed in 516us (805us total) trans 0 rc 0/0 00000100:00100000:1.0:1783964973.936876:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1783964973.936912:0:8346:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947429f99180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae0997f7-3a15-4fc6-865a-35b2f101956e:8346:1870622732874368:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783964973.936981:0:8346:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947429f99180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae0997f7-3a15-4fc6-865a-35b2f101956e:8346:1870622732874496:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783964973.937028:0:8346:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783964973.937106:0:8346:0:(client.c:2702:ptlrpc_set_wait()) set ffff94743709e000 going to sleep for 11 seconds 00000100:00100000:2.0:1783964973.940334:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732874496 00000100:00100000:2.0:1783964973.940356:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732874496 00000100:00100000:3.0:1783964973.940975:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1783964973.940990:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947408ec9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+15:8346:x1870622732874496:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783964973.941442:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947408ec9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+15:8346:x1870622732874496:12345-0@lo:502:llog_process_th.0 Request processed in 452us (4411us total) trans 0 rc 0/0 00000100:00100000:3.0:1783964973.941451:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1783964973.941580:0:8346:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947429f99180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae0997f7-3a15-4fc6-865a-35b2f101956e:8346:1870622732874496:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1783964973.941626:0:8346:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1783964973.944025:0:5809:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1783964973.944070:0:5809:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.112@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1783964973.944086:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.112@tcp lock: ffff947400031600/0xe782b916994fd452 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fd459 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964973.944101:0:5809:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.112@tcp lock: ffff947400031600/0xe782b916994fd452 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fd459 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783964973.944113:0:5809:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:1.0:1783964973.944116:0:5809:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:1.0:1783964973.944119:0:5809:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1783964973.944219:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.112@tcp lock: ffff947401483000/0xe782b916994fd460 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964973.944228:0:5809:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.112@tcp lock: ffff947401483000/0xe782b916994fd460 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964973.944241:0:5809:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.112@tcp lock: ffff947401483000/0xe782b916994fd460 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783964973.944273:0:5809:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e299500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae0997f7-3a15-4fc6-865a-35b2f101956e:5809:1870622732874624:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783964973.944356:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783964973.944410:0:5809:0:(client.c:2702:ptlrpc_set_wait()) set ffff94743e2e3000 going to sleep for 11 seconds 00000100:00100000:0.0:1783964973.944418:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732874624 00000100:00100000:0.0:1783964973.944429:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732874624 00000100:00100000:0.0:1783964973.944486:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1783964973.944497:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947408eca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae0997f7-3a15-4fc6-865a-35b2f101956e+15:5809:x1870622732874624:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783964973.944511:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783964973.944528:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff947400031a00/0xe782b916994fd467 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xe782b916994fd460 expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964973.944567:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff947400031a00/0xe782b916994fd467 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe782b916994fd460 expref: 16 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964973.944579:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff947400031a00/0xe782b916994fd467 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe782b916994fd460 expref: 16 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964973.944588:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff947400031a00, rc 0) 00000100:00100000:0.0:1783964973.944684:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947408eca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae0997f7-3a15-4fc6-865a-35b2f101956e+16:5809:x1870622732874624:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 188us (328us total) trans 0 rc 0/0 00000100:00100000:0.0:1783964973.944692:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1783964973.946742:0:5809:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e299500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae0997f7-3a15-4fc6-865a-35b2f101956e:5809:1870622732874624:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783964973.946782:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.112@tcp lock: ffff947401483000/0xe782b916994fd460 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fd467 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964973.946797:0:5809:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.112@tcp lock: ffff947401483000/0xe782b916994fd460 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xe782b916994fd467 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783964973.946903:0:5809:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e299500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae0997f7-3a15-4fc6-865a-35b2f101956e:5809:1870622732874752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783964973.946970:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783964973.947057:0:5809:0:(client.c:2702:ptlrpc_set_wait()) set ffff94743e2e3000 going to sleep for 11 seconds 00000100:00100000:0.0:1783964973.950712:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732874752 00000100:00100000:0.0:1783964973.950732:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732874752 00000100:00100000:0.0:1783964973.951889:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1783964973.951913:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947408eca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae0997f7-3a15-4fc6-865a-35b2f101956e+16:5809:x1870622732874752:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783964973.952384:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947408eca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae0997f7-3a15-4fc6-865a-35b2f101956e+16:5809:x1870622732874752:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 480us (5410us total) trans 0 rc 0/0 00000100:00100000:0.0:1783964973.952403:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1783964973.953228:0:5809:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e299500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae0997f7-3a15-4fc6-865a-35b2f101956e:5809:1870622732874752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783964973.953297:0:5809:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947436306680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae0997f7-3a15-4fc6-865a-35b2f101956e:5809:1870622732874880:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783964973.953367:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783964973.953927:0:5809:0:(client.c:2702:ptlrpc_set_wait()) set ffff94740954ce40 going to sleep for 11 seconds 00000100:00100000:3.0:1783964973.954026:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732874880 00000100:00100000:3.0:1783964973.954034:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732874880 00000100:00100000:3.0:1783964973.954132:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1783964973.954234:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947408ec8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae0997f7-3a15-4fc6-865a-35b2f101956e+16:5809:x1870622732874880:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783964973.954488:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947408ec8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae0997f7-3a15-4fc6-865a-35b2f101956e+16:5809:x1870622732874880:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 258us (1120us total) trans 0 rc 0/0 00000100:00100000:3.0:1783964973.954496:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1783964973.954715:0:5809:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947436306680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae0997f7-3a15-4fc6-865a-35b2f101956e:5809:1870622732874880:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783964973.955617:0:8347:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947429f99180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae0997f7-3a15-4fc6-865a-35b2f101956e:8347:1870622732875008:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783964973.955693:0:8347:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783964973.955773:0:8347:0:(client.c:2702:ptlrpc_set_wait()) set ffff94743709ed80 going to sleep for 11 seconds 00000100:00100000:2.0:1783964973.955809:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732875008 00000100:00100000:2.0:1783964973.955817:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732875008 00000100:00100000:2.0:1783964973.955890:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1783964973.955900:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947408ec9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+16:8347:x1870622732875008:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783964973.956142:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947408ec9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+16:8347:x1870622732875008:12345-0@lo:502:llog_process_th.0 Request processed in 243us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1783964973.956317:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:3.0:1783964973.956412:0:8347:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947429f99180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae0997f7-3a15-4fc6-865a-35b2f101956e:8347:1870622732875008:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783964973.956444:0:8347:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783964973.956455:0:8347:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783964973.956458:0:8347:0:(obd_config.c:1561:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1783964973.956468:0:8347:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1783964973.956498:0:8347:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e43aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae0997f7-3a15-4fc6-865a-35b2f101956e:8347:1870622732875136:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783964973.956551:0:8347:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783964973.956809:0:8347:0:(client.c:2702:ptlrpc_set_wait()) set ffff947429f84540 going to sleep for 11 seconds 00000100:00100000:0.0:1783964973.956881:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732875136 00000100:00100000:0.0:1783964973.956887:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732875136 00000100:00100000:0.0:1783964973.956918:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1783964973.956926:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947408eca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae0997f7-3a15-4fc6-865a-35b2f101956e+16:8347:x1870622732875136:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783964973.957167:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947408eca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae0997f7-3a15-4fc6-865a-35b2f101956e+16:8347:x1870622732875136:12345-0@lo:502:llog_process_th.0 Request processed in 240us (627us total) trans 0 rc 0/0 00000100:00100000:0.0:1783964973.957174:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1783964973.957737:0:8347:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e43aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae0997f7-3a15-4fc6-865a-35b2f101956e:8347:1870622732875136:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783964973.957773:0:8347:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783964973.957780:0:8347:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783964973.957783:0:8347:0:(obd_config.c:1561:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1783964973.957789:0:8347:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:2.0:1783964973.958053:0:5809:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:2.0:1783964973.958107:0:5809:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.112@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1783964973.958121:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.112@tcp lock: ffff947401483000/0xe782b916994fd460 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fd467 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783964973.958134:0:5809:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.112@tcp lock: ffff947401483000/0xe782b916994fd460 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fd467 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783964973.958526:0:5809:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1783964973.958617:0:5809:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff947403dc3000 from 39 10000000:01000000:2.0:1783964973.958622:0:5809:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1783964973.958664:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.112@tcp lock: ffff947425975c00/0xe782b916994fd46e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783964973.958674:0:5809:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.112@tcp lock: ffff947425975c00/0xe782b916994fd46e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783964973.958686:0:5809:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.112@tcp lock: ffff947425975c00/0xe782b916994fd46e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783964973.958712:0:5809:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947436304e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae0997f7-3a15-4fc6-865a-35b2f101956e:5809:1870622732875264:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783964973.958777:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783964973.958824:0:5809:0:(client.c:2702:ptlrpc_set_wait()) set ffff94740954c9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783964973.958882:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732875264 00000100:00100000:1.0:1783964973.958890:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732875264 00000100:00100000:1.0:1783964973.958939:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1783964973.958950:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947408ec8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae0997f7-3a15-4fc6-865a-35b2f101956e+16:5809:x1870622732875264:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783964973.958963:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783964973.958986:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff947401482e00/0xe782b916994fd475 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xe782b916994fd46e expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964973.959016:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff947401482e00/0xe782b916994fd475 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe782b916994fd46e expref: 17 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964973.959028:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff947401482e00/0xe782b916994fd475 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe782b916994fd46e expref: 17 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964973.959038:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff947401482e00, rc 0) 00000100:00100000:1.0:1783964973.959095:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947408ec8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae0997f7-3a15-4fc6-865a-35b2f101956e+17:5809:x1870622732875264:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 147us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1783964973.959102:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1783964973.959220:0:5809:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947436304e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae0997f7-3a15-4fc6-865a-35b2f101956e:5809:1870622732875264:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783964973.959236:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.112@tcp lock: ffff947425975c00/0xe782b916994fd46e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fd475 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964973.959391:0:5809:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.112@tcp lock: ffff947425975c00/0xe782b916994fd46e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xe782b916994fd475 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783964973.959459:0:5809:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e43aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae0997f7-3a15-4fc6-865a-35b2f101956e:5809:1870622732875392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783964973.959496:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783964973.959528:0:5809:0:(client.c:2702:ptlrpc_set_wait()) set ffff947429f84540 going to sleep for 11 seconds 00000100:00100000:1.0:1783964973.959662:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732875392 00000100:00100000:1.0:1783964973.959667:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732875392 00000100:00100000:1.0:1783964973.959704:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:1.0:1783964973.959711:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947408ec8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae0997f7-3a15-4fc6-865a-35b2f101956e+17:5809:x1870622732875392:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783964973.960020:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947408ec8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae0997f7-3a15-4fc6-865a-35b2f101956e+17:5809:x1870622732875392:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 309us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1783964973.960028:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1783964973.960107:0:5809:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e43aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae0997f7-3a15-4fc6-865a-35b2f101956e:5809:1870622732875392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783964973.960380:0:5809:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e43aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae0997f7-3a15-4fc6-865a-35b2f101956e:5809:1870622732875520:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783964973.960425:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783964973.960456:0:5809:0:(client.c:2702:ptlrpc_set_wait()) set ffff947429f84540 going to sleep for 11 seconds 00000100:00100000:2.0:1783964973.960530:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732875520 00000100:00100000:2.0:1783964973.960607:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732875520 00000100:00100000:2.0:1783964973.960638:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1783964973.960646:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947408ecac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+17:5809:x1870622732875520:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783964973.960833:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947408ecac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+17:5809:x1870622732875520:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 187us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1783964973.960839:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1783964973.960940:0:5809:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e43aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae0997f7-3a15-4fc6-865a-35b2f101956e:5809:1870622732875520:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783964973.961834:0:8348:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e43aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae0997f7-3a15-4fc6-865a-35b2f101956e:8348:1870622732875648:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783964973.961891:0:8348:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783964973.961967:0:8348:0:(client.c:2702:ptlrpc_set_wait()) set ffff947429f84900 going to sleep for 11 seconds 00000100:00100000:2.0:1783964973.962003:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732875648 00000100:00100000:2.0:1783964973.962009:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732875648 00000100:00100000:2.0:1783964973.962073:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1783964973.962083:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947408ec9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+17:8348:x1870622732875648:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783964973.962397:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947408ec9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+17:8348:x1870622732875648:12345-0@lo:502:llog_process_th.0 Request processed in 316us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1783964973.962405:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1783964973.962501:0:8348:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e43aa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae0997f7-3a15-4fc6-865a-35b2f101956e:8348:1870622732875648:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783964973.962566:0:8348:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947429f9b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae0997f7-3a15-4fc6-865a-35b2f101956e:8348:1870622732875776:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783964973.962601:0:8348:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783964973.963451:0:8348:0:(client.c:2702:ptlrpc_set_wait()) set ffff94743709ea80 going to sleep for 11 seconds 00000100:00100000:3.0:1783964973.963498:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732875776 00000100:00100000:3.0:1783964973.963505:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732875776 00000100:00100000:2.0:1783964973.963632:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1783964973.963644:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947408ecbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+17:8348:x1870622732875776:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783964973.963925:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947408ecbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+17:8348:x1870622732875776:12345-0@lo:502:llog_process_th.0 Request processed in 284us (1322us total) trans 0 rc 0/0 00000100:00100000:2.0:1783964973.963933:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:0.0:1783964973.964727:0:8348:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947429f9b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae0997f7-3a15-4fc6-865a-35b2f101956e:8348:1870622732875776:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1783964973.964794:0:8348:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:1.0:1783964973.965121:0:5809:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1783964973.965155:0:5809:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.112@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1783964973.965168:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.112@tcp lock: ffff947425975c00/0xe782b916994fd46e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fd475 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964973.965180:0:5809:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.112@tcp lock: ffff947425975c00/0xe782b916994fd46e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fd475 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783964973.965236:0:5809:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1783964973.965252:0:5809:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:1.0:1783964973.965255:0:5809:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1783964973.965301:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.112@tcp lock: ffff947401483600/0xe782b916994fd47c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964973.965310:0:5809:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.112@tcp lock: ffff947401483600/0xe782b916994fd47c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964973.965321:0:5809:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.112@tcp lock: ffff947401483600/0xe782b916994fd47c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783964973.965348:0:5809:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e299180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae0997f7-3a15-4fc6-865a-35b2f101956e:5809:1870622732875904:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783964973.965413:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783964973.965451:0:5809:0:(client.c:2702:ptlrpc_set_wait()) set ffff94743e2e3f00 going to sleep for 11 seconds 00000100:00100000:1.0:1783964973.965472:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732875904 00000100:00100000:1.0:1783964973.965478:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732875904 00000100:00100000:1.0:1783964973.965512:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1783964973.965521:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947408ec9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae0997f7-3a15-4fc6-865a-35b2f101956e+17:5809:x1870622732875904:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783964973.965534:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783964973.965753:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff947401483400/0xe782b916994fd483 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xe782b916994fd47c expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964973.965783:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff947401483400/0xe782b916994fd483 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe782b916994fd47c expref: 18 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964973.965796:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff947401483400/0xe782b916994fd483 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe782b916994fd47c expref: 18 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964973.965805:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff947401483400, rc 0) 00000100:00100000:1.0:1783964973.965850:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947408ec9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae0997f7-3a15-4fc6-865a-35b2f101956e+18:5809:x1870622732875904:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 330us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1783964973.965864:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1783964973.965943:0:5809:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e299180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae0997f7-3a15-4fc6-865a-35b2f101956e:5809:1870622732875904:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783964973.965961:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.112@tcp lock: ffff947401483600/0xe782b916994fd47c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fd483 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964973.965972:0:5809:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.112@tcp lock: ffff947401483600/0xe782b916994fd47c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xe782b916994fd483 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783964973.966043:0:5809:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947429f9b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae0997f7-3a15-4fc6-865a-35b2f101956e:5809:1870622732876032:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783964973.966076:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783964973.966100:0:5809:0:(client.c:2702:ptlrpc_set_wait()) set ffff94743709ea80 going to sleep for 11 seconds 00000100:00100000:1.0:1783964973.966160:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732876032 00000100:00100000:1.0:1783964973.966165:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732876032 00000100:00100000:1.0:1783964973.966195:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1783964973.966229:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947408ecb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae0997f7-3a15-4fc6-865a-35b2f101956e+18:5809:x1870622732876032:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783964973.966531:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947408ecb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae0997f7-3a15-4fc6-865a-35b2f101956e+18:5809:x1870622732876032:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 328us (453us total) trans 0 rc 0/0 00000100:00100000:0.0:1783964973.966727:0:5809:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947429f9b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae0997f7-3a15-4fc6-865a-35b2f101956e:5809:1870622732876032:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783964973.966761:0:5809:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947429f9b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae0997f7-3a15-4fc6-865a-35b2f101956e:5809:1870622732876160:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783964973.966801:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783964973.966819:0:5809:0:(client.c:2702:ptlrpc_set_wait()) set ffff94743709ea80 going to sleep for 11 seconds 00000100:00100000:1.0:1783964973.966851:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1783964973.966874:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732876160 00000100:00100000:1.0:1783964973.966877:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732876160 00000100:00100000:1.0:1783964973.966894:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1783964973.966899:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947408ecb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae0997f7-3a15-4fc6-865a-35b2f101956e+18:5809:x1870622732876160:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783964973.967161:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947408ecb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae0997f7-3a15-4fc6-865a-35b2f101956e+18:5809:x1870622732876160:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 260us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1783964973.967169:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1783964973.967522:0:5809:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947429f9b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae0997f7-3a15-4fc6-865a-35b2f101956e:5809:1870622732876160:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783964973.967973:0:8349:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e43ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae0997f7-3a15-4fc6-865a-35b2f101956e:8349:1870622732876288:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783964973.968031:0:8349:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783964973.968099:0:8349:0:(client.c:2702:ptlrpc_set_wait()) set ffff947429f84600 going to sleep for 11 seconds 00000100:00100000:0.0:1783964973.968132:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732876288 00000100:00100000:0.0:1783964973.968138:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732876288 00000100:00100000:0.0:1783964973.969438:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1783964973.969452:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947408ecb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae0997f7-3a15-4fc6-865a-35b2f101956e+18:8349:x1870622732876288:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783964973.969924:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947408ecb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae0997f7-3a15-4fc6-865a-35b2f101956e+18:8349:x1870622732876288:12345-0@lo:502:llog_process_th.0 Request processed in 473us (1891us total) trans 0 rc 0/0 00000100:00100000:0.0:1783964973.969932:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:3.0:1783964973.970135:0:8349:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e43ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae0997f7-3a15-4fc6-865a-35b2f101956e:8349:1870622732876288:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783964973.970525:0:8349:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783964973.970633:0:8349:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783964973.970636:0:8349:0:(obd_config.c:1561:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1783964973.970649:0:8349:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1783964973.970697:0:8349:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e43ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae0997f7-3a15-4fc6-865a-35b2f101956e:8349:1870622732876416:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783964973.970760:0:8349:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783964973.970803:0:8349:0:(client.c:2702:ptlrpc_set_wait()) set ffff947429f84600 going to sleep for 11 seconds 00000100:00100000:2.0:1783964973.970858:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732876416 00000100:00100000:2.0:1783964973.970866:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732876416 00000100:00100000:2.0:1783964973.970915:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1783964973.970924:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947405adfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+18:8349:x1870622732876416:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783964973.971327:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947405adfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+18:8349:x1870622732876416:12345-0@lo:502:llog_process_th.0 Request processed in 402us (565us total) trans 0 rc 0/0 00000100:00100000:2.0:1783964973.971335:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1783964973.971497:0:8349:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e43ad80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae0997f7-3a15-4fc6-865a-35b2f101956e:8349:1870622732876416:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783964973.971522:0:8349:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783964973.971527:0:8349:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783964973.971529:0:8349:0:(obd_config.c:1561:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1783964973.971534:0:8349:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:2.0:1783964973.974737:0:5809:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:2.0:1783964973.974807:0:5809:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.112@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1783964973.974845:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.112@tcp lock: ffff947401483600/0xe782b916994fd47c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fd483 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783964973.974872:0:5809:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.112@tcp lock: ffff947401483600/0xe782b916994fd47c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fd483 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783964973.974924:0:5809:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1783964973.974928:0:5809:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff947407224d40 from 1 10000000:01000000:2.0:1783964973.974947:0:5809:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1783964973.975038:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.112@tcp lock: ffff947425975200/0xe782b916994fd48a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783964973.975056:0:5809:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.112@tcp lock: ffff947425975200/0xe782b916994fd48a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783964973.975104:0:5809:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.112@tcp lock: ffff947425975200/0xe782b916994fd48a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783964973.975137:0:5809:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947436307800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae0997f7-3a15-4fc6-865a-35b2f101956e:5809:1870622732876544:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783964973.975494:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783964973.975683:0:5809:0:(client.c:2702:ptlrpc_set_wait()) set ffff94740b1f43c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783964973.975738:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732876544 00000100:00100000:1.0:1783964973.975748:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732876544 00000100:00100000:1.0:1783964973.975863:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1783964973.975889:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947405add850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae0997f7-3a15-4fc6-865a-35b2f101956e+18:5809:x1870622732876544:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783964973.975916:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783964973.975947:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff947401482a00/0xe782b916994fd491 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xe782b916994fd48a expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964973.976029:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff947401482a00/0xe782b916994fd491 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe782b916994fd48a expref: 19 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964973.976049:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff947401482a00/0xe782b916994fd491 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe782b916994fd48a expref: 19 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964973.976059:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff947401482a00, rc 0) 00000100:00100000:0.0:1783964973.976398:0:5809:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947436307800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae0997f7-3a15-4fc6-865a-35b2f101956e:5809:1870622732876544:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783964973.976419:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.112@tcp lock: ffff947425975200/0xe782b916994fd48a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fd491 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964973.976429:0:5809:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.112@tcp lock: ffff947425975200/0xe782b916994fd48a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xe782b916994fd491 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783964973.976506:0:5809:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947429f9b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae0997f7-3a15-4fc6-865a-35b2f101956e:5809:1870622732876672:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783964973.976653:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947405add850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae0997f7-3a15-4fc6-865a-35b2f101956e+19:5809:x1870622732876544:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 779us (1158us total) trans 0 rc 0/0 00000100:00100000:1.0:1783964973.976662:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1783964973.976804:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783964973.976870:0:5809:0:(client.c:2702:ptlrpc_set_wait()) set ffff94743709e0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783964973.976907:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732876672 00000100:00100000:1.0:1783964973.976913:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732876672 00000100:00100000:1.0:1783964973.976984:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:1.0:1783964973.976992:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947405adf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae0997f7-3a15-4fc6-865a-35b2f101956e+19:5809:x1870622732876672:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783964973.977354:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947405adf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae0997f7-3a15-4fc6-865a-35b2f101956e+19:5809:x1870622732876672:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 361us (549us total) trans 0 rc -2/-2 00000100:00100000:1.0:1783964973.977363:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:0.0:1783964973.977448:0:5809:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947429f9b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae0997f7-3a15-4fc6-865a-35b2f101956e:5809:1870622732876672:0@lo:501:ll_cfg_requeue.0 10000000:01000000:0.0:1783964973.977492:0:5809:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.112@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1783964973.977501:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.112@tcp lock: ffff947425975200/0xe782b916994fd48a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fd491 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964973.977512:0:5809:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.112@tcp lock: ffff947425975200/0xe782b916994fd48a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fd491 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964974.764030:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783964975.661424:0:3323:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783964975.661452:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947436306a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3323:1870622732876800:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783964975.661526:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783964975.662447:0:6610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732876800 00000100:00100000:2.0:1783964975.662459:0:6610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732876800 00000100:00100000:2.0:1783964975.662554:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1783964975.662564:0:6610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e299180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3323:x1870622732876800:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783964975.662613:0:6610:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783964975.662678:0:6610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e299180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3323:x1870622732876800:12345-0@lo:13:osp-pre-0-0.0 Request processed in 116us (1152us total) trans 0 rc 0/0 00000100:00100000:2.0:1783964975.662685:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:2.0:1783964975.662729:0:3323:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff947436306a00 x1870622732876800/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783964991 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783964975.662756:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947436306a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3323:1870622732876800:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1783964975.662977:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:2.0:1783964975.747631:0:8386:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffd25b63370 20000000:00000080:2.0:1783964975.747649:0:8386:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff947440062c00 uarg=0000000000000000 20000000:01000000:2.0:1783964975.747687:0:8386:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1783964975.747693:0:8386:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1783964975.747698:0:8386:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1783964975.748682:0:8387:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:2.0:1783964975.748923:0:8386:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:3.0:1783964975.761368:0:8386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:3.0:1783964975.761426:0:8386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:3.0:1783964975.761485:0:8386:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:3.0:1783964975.761507:0:8386:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1783964975.761537:0:8386:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff947436f27000/0xe782b916994fd498 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964975.761556:0:8386:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff947400030600/0xe782b916994fd261 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe782b916994fd25a expref: 18 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964975.761564:0:8386:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff947401483a00/0xe782b916994fd2ca lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe782b916994fd2c3 expref: 18 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964975.761571:0:8386:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff947400030c00/0xe782b916994fd33a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe782b916994fd333 expref: 18 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964975.761581:0:8386:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff947425974c00/0xe782b916994fd3f7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5efe4b expref: 9 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964975.761589:0:8386:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff947436f27000/0xe782b916994fd498 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964975.761634:0:8386:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff947425974c00/0xe782b916994fd3f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5efe4b expref: 9 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964975.761651:0:8386:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff947425974c00/0xe782b916994fd3f7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5efe4b expref: 9 pid: 5806 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783964975.761667:0:8386:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e438a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8386:1870622732876928:192.168.204.12@tcp:104: 00010000:00010000:3.0:1783964975.761789:0:8386:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff947400030c00/0xe782b916994fd33a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe782b916994fd333 expref: 18 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964975.761797:0:8386:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff947400030c00/0xe782b916994fd33a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe782b916994fd333 expref: 18 pid: 5807 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783964975.761818:0:8386:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e438000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8386:1870622732877056:0@lo:104: 00000100:00100000:3.0:1783964975.761860:0:8386:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783964975.761909:0:8386:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff947401483a00/0xe782b916994fd2ca lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe782b916994fd2c3 expref: 18 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964975.761917:0:8386:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff947401483a00/0xe782b916994fd2ca lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe782b916994fd2c3 expref: 18 pid: 5806 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783964975.761924:0:8386:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e438380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8386:1870622732877184:0@lo:104: 00000100:00100000:3.0:1783964975.761949:0:8386:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783964975.761971:0:8386:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff947400030600/0xe782b916994fd261 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe782b916994fd25a expref: 18 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964975.761980:0:8386:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff947400030600/0xe782b916994fd261 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe782b916994fd25a expref: 18 pid: 5806 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783964975.761988:0:8386:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e43a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8386:1870622732877312:0@lo:104: 00000100:00100000:3.0:1783964975.762008:0:8386:0:(client.c:2702:ptlrpc_set_wait()) set ffff947429f84cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783964975.762496:0:5796:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1783964975.762517:0:5796:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783964975.762540:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732877056 00000100:00100000:1.0:1783964975.762546:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732877056 00000100:00100000:1.0:1783964975.762593:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732877184 00000100:00100000:1.0:1783964975.762596:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732877184 00000100:00100000:1.0:1783964975.762618:0:5796:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732877312 00000100:00100000:1.0:1783964975.762621:0:5796:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732877312 00000100:00100000:1.0:1783964975.762634:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1783964975.762644:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e439f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ae0997f7-3a15-4fc6-865a-35b2f101956e+5:8386:x1870622732877056:12345-0@lo:104: 00010000:00010000:1.0:1783964975.762658:0:5796:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.112@tcp lock: ffff947430c10200/0xe782b916994fd333 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe782b916994fd33a expref: -99 pid: 7506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964975.762715:0:5796:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1783964975.762721:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e439f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ae0997f7-3a15-4fc6-865a-35b2f101956e+5:8386:x1870622732877056:12345-0@lo:104: Request processed in 80us (862us total) trans 0 rc 0/0 00000100:00100000:1.0:1783964975.762728:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1783964975.762761:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1783964975.762767:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947305c11450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ae0997f7-3a15-4fc6-865a-35b2f101956e+4:8386:x1870622732877184:12345-0@lo:104: 00010000:00010000:1.0:1783964975.762776:0:5796:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.112@tcp lock: ffff9474420ff200/0xe782b916994fd2c3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe782b916994fd2ca expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964975.762811:0:5796:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1783964975.762815:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947305c11450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ae0997f7-3a15-4fc6-865a-35b2f101956e+4:8386:x1870622732877184:12345-0@lo:104: Request processed in 50us (866us total) trans 0 rc 0/0 00000100:00100000:1.0:1783964975.762821:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1783964975.762855:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1783964975.762861:0:5796:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e299500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ae0997f7-3a15-4fc6-865a-35b2f101956e+3:8386:x1870622732877312:12345-0@lo:104: 00010000:00010000:1.0:1783964975.762869:0:5796:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.112@tcp lock: ffff9474420ffe00/0xe782b916994fd25a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe782b916994fd261 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964975.762895:0:5796:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1783964975.762900:0:5796:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e299500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:ae0997f7-3a15-4fc6-865a-35b2f101956e+3:8386:x1870622732877312:12345-0@lo:104: Request processed in 39us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1783964975.762915:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:1.0:1783964975.762940:0:5800:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1783964975.762946:0:5800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.112@tcp lock: ffff947430c10200/0xe782b916994fd333 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe782b916994fd33a expref: -99 pid: 7506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964975.762953:0:5800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947430c10200 already unused, calling callback (ffffffffc1ca8c20) 10000000:00010000:1.0:1783964975.762958:0:5800:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.112@tcp lock: ffff947430c10200/0xe782b916994fd333 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xe782b916994fd33a expref: -99 pid: 7506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964975.762966:0:5800:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.112@tcp lock: ffff947430c10200/0xe782b916994fd333 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xe782b916994fd33a expref: -99 pid: 7506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783964975.762973:0:5800:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.112@tcp lock: ffff947430c10200/0xe782b916994fd333 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xe782b916994fd33a expref: -99 pid: 7506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783964975.762978:0:5800:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1783964975.763028:0:5800:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.112@tcp lock: ffff947430c10200/0xe782b916994fd333 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe782b916994fd33a expref: -99 pid: 7506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964975.763035:0:5800:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783964975.763058:0:5800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.112@tcp lock: ffff947430c10200/0xe782b916994fd333 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe782b916994fd33a expref: -99 pid: 7506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964975.763064:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.112@tcp lock: ffff947430c10200/0xe782b916994fd333 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe782b916994fd33a expref: -99 pid: 7506 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964975.763078:0:5800:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783964975.763081:0:5800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.112@tcp lock: ffff9474420ff200/0xe782b916994fd2c3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe782b916994fd2ca expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964975.763096:0:5800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9474420ff200 already unused, calling callback (ffffffffc1ca8c20) 10000000:00010000:1.0:1783964975.763099:0:5800:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.112@tcp lock: ffff9474420ff200/0xe782b916994fd2c3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xe782b916994fd2ca expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964975.763105:0:5800:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.112@tcp lock: ffff9474420ff200/0xe782b916994fd2c3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xe782b916994fd2ca expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783964975.763110:0:5800:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.112@tcp lock: ffff9474420ff200/0xe782b916994fd2c3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xe782b916994fd2ca expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783964975.763115:0:5800:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1783964975.763127:0:5800:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.112@tcp lock: ffff9474420ff200/0xe782b916994fd2c3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe782b916994fd2ca expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964975.763132:0:5800:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783964975.763146:0:5800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.112@tcp lock: ffff9474420ff200/0xe782b916994fd2c3 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe782b916994fd2ca expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964975.763164:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.112@tcp lock: ffff9474420ff200/0xe782b916994fd2c3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe782b916994fd2ca expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964975.763174:0:5800:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783964975.763177:0:5800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.112@tcp lock: ffff9474420ffe00/0xe782b916994fd25a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe782b916994fd261 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964975.763182:0:5800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9474420ffe00 already unused, calling callback (ffffffffc1ca8c20) 10000000:00010000:1.0:1783964975.763185:0:5800:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.112@tcp lock: ffff9474420ffe00/0xe782b916994fd25a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe782b916994fd261 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964975.763231:0:5800:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.112@tcp lock: ffff9474420ffe00/0xe782b916994fd25a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe782b916994fd261 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783964975.763238:0:5800:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.112@tcp lock: ffff9474420ffe00/0xe782b916994fd25a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe782b916994fd261 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783964975.763243:0:5800:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1783964975.763263:0:5800:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.112@tcp lock: ffff9474420ffe00/0xe782b916994fd25a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe782b916994fd261 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964975.763268:0:5800:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783964975.763274:0:5800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.112@tcp lock: ffff9474420ffe00/0xe782b916994fd25a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe782b916994fd261 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964975.763281:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.112@tcp lock: ffff9474420ffe00/0xe782b916994fd25a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe782b916994fd261 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964975.763295:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783964975.763297:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783964975.763299:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783964975.763306:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783964975.763319:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e29b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ae0997f7-3a15-4fc6-865a-35b2f101956e:3323:1870622732877440:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783964975.763352:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783964975.763404:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e29aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ae0997f7-3a15-4fc6-865a-35b2f101956e:3324:1870622732877568:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783964975.763426:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783964975.763444:0:3324:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783964975.763449:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e298000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ae0997f7-3a15-4fc6-865a-35b2f101956e:3324:1870622732877696:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783964975.763467:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783964975.763504:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732877440 00000100:00100000:1.0:1783964975.763509:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732877440 00010000:00010000:1.0:1783964975.763531:0:5799:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff947400030c00/0xe782b916994fd33a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe782b916994fd333 expref: 19 pid: 5807 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783964975.763551:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732877568 00000100:00100000:1.0:1783964975.763553:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732877568 00010000:00010000:1.0:1783964975.763563:0:5799:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff947401483a00/0xe782b916994fd2ca lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe782b916994fd2c3 expref: 20 pid: 5806 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783964975.763573:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732877696 00000100:00100000:1.0:1783964975.763575:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732877696 00010000:00010000:1.0:1783964975.763585:0:5799:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff947400030600/0xe782b916994fd261 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe782b916994fd25a expref: 21 pid: 5806 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783964975.763596:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1783964975.763602:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e298e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ae0997f7-3a15-4fc6-865a-35b2f101956e+21:3323:x1870622732877440:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783964975.763611:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783964975.763616:0:5799:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff947400030c00/0xe782b916994fd33a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe782b916994fd333 expref: 21 pid: 5807 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964975.763625:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff947400030c00/0xe782b916994fd33a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe782b916994fd333 expref: 21 pid: 5807 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964975.763641:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783964975.763669:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e298e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ae0997f7-3a15-4fc6-865a-35b2f101956e+21:3323:x1870622732877440:12345-0@lo:103:ldlm_bl.0 Request processed in 67us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1783964975.763676:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1783964975.763688:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1783964975.763695:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e29a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ae0997f7-3a15-4fc6-865a-35b2f101956e+20:3324:x1870622732877568:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783964975.763710:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783964975.763715:0:5799:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff947401483a00/0xe782b916994fd2ca lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe782b916994fd2c3 expref: 20 pid: 5806 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964975.763723:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff947401483a00/0xe782b916994fd2ca lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe782b916994fd2c3 expref: 20 pid: 5806 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964975.763732:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783964975.763758:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e29a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ae0997f7-3a15-4fc6-865a-35b2f101956e+20:3324:x1870622732877568:12345-0@lo:103:ldlm_bl.0 Request processed in 64us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1783964975.763764:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1783964975.763776:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1783964975.763782:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e298380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ae0997f7-3a15-4fc6-865a-35b2f101956e+19:3324:x1870622732877696:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783964975.763789:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783964975.763793:0:5799:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff947400030600/0xe782b916994fd261 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe782b916994fd25a expref: 19 pid: 5806 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964975.763801:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff947400030600/0xe782b916994fd261 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe782b916994fd25a expref: 19 pid: 5806 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964975.763809:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783964975.763829:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e298380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ae0997f7-3a15-4fc6-865a-35b2f101956e+19:3324:x1870622732877696:12345-0@lo:103:ldlm_bl.0 Request processed in 47us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1783964975.763835:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1783964975.763871:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e29b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ae0997f7-3a15-4fc6-865a-35b2f101956e:3323:1870622732877440:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783964975.763896:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e298000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ae0997f7-3a15-4fc6-865a-35b2f101956e:3324:1870622732877696:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783964975.763902:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e29aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ae0997f7-3a15-4fc6-865a-35b2f101956e:3324:1870622732877568:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783964975.764707:0:8386:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff947400030c00/0xe782b916994fd33a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe782b916994fd333 expref: 18 pid: 5807 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783964975.764722:0:8386:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e438000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8386:1870622732877056:0@lo:104: 00010000:00010000:3.0:1783964975.764733:0:8386:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff947401483a00/0xe782b916994fd2ca lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe782b916994fd2c3 expref: 17 pid: 5806 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783964975.765101:0:8386:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e438380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8386:1870622732877184:0@lo:104: 00010000:00010000:3.0:1783964975.765119:0:8386:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff947400030600/0xe782b916994fd261 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe782b916994fd25a expref: 16 pid: 5806 timeout: 359 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783964975.765144:0:8386:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e43a680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8386:1870622732877312:0@lo:104: 00000100:00100000:3.0:1783964975.767072:0:8386:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e438a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8386:1870622732876928:192.168.204.12@tcp:104: 00010000:00010000:3.0:1783964975.767122:0:8386:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff947436f27000/0xe782b916994fd498 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783964975.773696:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783964975.773795:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715025024 00000100:00100000:1.0:1783964975.773806:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715025024 00010000:00010000:1.0:1783964975.773848:0:5799:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff947425974c00/0xe782b916994fd3f7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5efe4b expref: 10 pid: 5806 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783964975.773903:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 24 00000100:00100000:1.0:1783964975.773913:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436306a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+10:2359:x1870622715025024:12345-192.168.204.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783964975.773930:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783964975.773936:0:5799:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: MGS lock: ffff947425974c00/0xe782b916994fd3f7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5efe4b expref: 10 pid: 5806 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964975.773950:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff947425974c00/0xe782b916994fd3f7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5efe4b expref: 10 pid: 5806 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964975.773970:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff947425974c00/0xe782b916994fd3f7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5efe4b expref: 10 pid: 5806 timeout: 309 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964975.773986:0:5799:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff947436f27000/0xe782b916994fd498 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964975.773995:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff947436f27000/0xe782b916994fd498 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964975.774013:0:5799:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff947436f27000/0xe782b916994fd498 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964975.774022:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff947436f27000/0xe782b916994fd498 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964975.774029:0:5799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff947436f27000/0xe782b916994fd498 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964975.774050:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff947436f27000/0xe782b916994fd498 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964975.774056:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947436f27000 already unused, calling callback (ffffffffc168d230) 00010000:00010000:1.0:1783964975.774060:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff947436f27000/0xe782b916994fd498 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964975.774068:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff947436f27000/0xe782b916994fd498 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964975.774092:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff947436f27000/0xe782b916994fd498 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964975.774104:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783964975.774177:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436306a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+9:2359:x1870622715025024:12345-192.168.204.12@tcp:103:ldlm_bl.0 Request processed in 265us (493us total) trans 0 rc 0/0 00000100:00100000:1.0:1783964975.774185:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 24 00010000:00010000:3.0:1783964975.774428:0:8386:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff947436f27000/0xe782b916994fd498 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964975.774438:0:8386:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff947436f27000/0xe782b916994fd498 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964975.774444:0:8386:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff947436f27000/0xe782b916994fd498 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8386 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964975.798529:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783964976.811597:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1783964977.581407:0:5809:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1783964977.581415:0:5809:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9474369fb000 from 4 10000000:01000000:1.0:1783964977.581419:0:5809:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783964977.581467:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.112@tcp lock: ffff947401482600/0xe782b916994fd49f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964977.581490:0:5809:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.112@tcp lock: ffff947401482600/0xe782b916994fd49f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964977.581502:0:5809:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.112@tcp lock: ffff947401482600/0xe782b916994fd49f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783964977.581539:0:5809:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e29aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae0997f7-3a15-4fc6-865a-35b2f101956e:5809:1870622732877824:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783964977.581604:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783964977.581660:0:5809:0:(client.c:2702:ptlrpc_set_wait()) set ffff94741cca0600 going to sleep for 11 seconds 00000100:00100000:3.0:1783964977.581795:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732877824 00000100:00100000:3.0:1783964977.581803:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732877824 00000100:00100000:3.0:1783964977.581859:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1783964977.581868:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947405adf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+16:5809:x1870622732877824:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783964977.581882:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783964977.581895:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff947436f26800/0xe782b916994fd4a6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe782b916994fd49f expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964977.581918:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff947436f26800/0xe782b916994fd4a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe782b916994fd49f expref: 17 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964977.581930:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff947436f26800/0xe782b916994fd4a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe782b916994fd49f expref: 17 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964977.581950:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff947436f26800, rc 0) 00000100:00100000:3.0:1783964977.582002:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947405adf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+17:5809:x1870622732877824:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 136us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1783964977.582009:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1783964977.582165:0:5809:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e29aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae0997f7-3a15-4fc6-865a-35b2f101956e:5809:1870622732877824:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783964977.582180:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.112@tcp lock: ffff947401482600/0xe782b916994fd49f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fd4a6 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964977.582191:0:5809:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.112@tcp lock: ffff947401482600/0xe782b916994fd49f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe782b916994fd4a6 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783964977.582278:0:5809:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e29aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae0997f7-3a15-4fc6-865a-35b2f101956e:5809:1870622732877952:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783964977.582307:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783964977.582321:0:5809:0:(client.c:2702:ptlrpc_set_wait()) set ffff94741cca0600 going to sleep for 11 seconds 00000100:00100000:3.0:1783964977.582383:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732877952 00000100:00100000:3.0:1783964977.582388:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732877952 00000100:00100000:3.0:1783964977.582419:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1783964977.582426:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947405adf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae0997f7-3a15-4fc6-865a-35b2f101956e+17:5809:x1870622732877952:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783964977.582893:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947405adf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae0997f7-3a15-4fc6-865a-35b2f101956e+17:5809:x1870622732877952:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 465us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1783964977.582901:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1783964977.582914:0:5809:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e29aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae0997f7-3a15-4fc6-865a-35b2f101956e:5809:1870622732877952:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783964977.582948:0:5809:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e29aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae0997f7-3a15-4fc6-865a-35b2f101956e:5809:1870622732878080:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783964977.582984:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783964977.583010:0:5809:0:(client.c:2702:ptlrpc_set_wait()) set ffff94741cca0600 going to sleep for 11 seconds 00000100:00100000:3.0:1783964977.584862:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732878080 00000100:00100000:3.0:1783964977.584875:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732878080 00000100:00100000:3.0:1783964977.584924:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:3.0:1783964977.584934:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947405adcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+17:5809:x1870622732878080:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783964977.585175:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947405adcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+17:5809:x1870622732878080:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 241us (2188us total) trans 0 rc 0/0 00000100:00100000:3.0:1783964977.585183:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1783964977.588246:0:5809:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e29aa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae0997f7-3a15-4fc6-865a-35b2f101956e:5809:1870622732878080:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783964977.590001:0:8465:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e298000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae0997f7-3a15-4fc6-865a-35b2f101956e:8465:1870622732878208:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783964977.590728:0:8465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783964977.590765:0:8465:0:(client.c:2702:ptlrpc_set_wait()) set ffff94741cca0300 going to sleep for 11 seconds 00000100:00100000:3.0:1783964977.592275:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732878208 00000100:00100000:3.0:1783964977.592289:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732878208 00000100:00100000:3.0:1783964977.592347:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1783964977.592356:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947405add450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae0997f7-3a15-4fc6-865a-35b2f101956e+17:8465:x1870622732878208:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783964977.592742:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947405add450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae0997f7-3a15-4fc6-865a-35b2f101956e+17:8465:x1870622732878208:12345-0@lo:502:llog_process_th.0 Request processed in 385us (2014us total) trans 0 rc 0/0 00000100:00100000:3.0:1783964977.592751:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1783964977.594668:0:8465:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e298000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae0997f7-3a15-4fc6-865a-35b2f101956e:8465:1870622732878208:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783964977.594719:0:8465:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783964977.594730:0:8465:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783964977.594733:0:8465:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1783964977.594740:0:8465:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff9474369fb000 00000020:00000080:0.0:1783964977.594744:0:8465:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1783964977.594844:0:8465:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947429f9b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae0997f7-3a15-4fc6-865a-35b2f101956e:8465:1870622732878336:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783964977.594911:0:8465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783964977.597215:0:8465:0:(client.c:2702:ptlrpc_set_wait()) set ffff94743709e240 going to sleep for 11 seconds 00000100:00100000:3.0:1783964977.597339:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732878336 00000100:00100000:3.0:1783964977.597347:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732878336 00000100:00100000:3.0:1783964977.597396:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1783964977.597405:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947405ade050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae0997f7-3a15-4fc6-865a-35b2f101956e+17:8465:x1870622732878336:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783964977.597827:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947405ade050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae0997f7-3a15-4fc6-865a-35b2f101956e+17:8465:x1870622732878336:12345-0@lo:502:llog_process_th.0 Request processed in 422us (2915us total) trans 0 rc 0/0 00000100:00100000:3.0:1783964977.597835:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1783964977.597978:0:8465:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947429f9b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae0997f7-3a15-4fc6-865a-35b2f101956e:8465:1870622732878336:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1783964977.598012:0:8465:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783964977.598019:0:8465:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783964977.598027:0:8465:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1783964977.598031:0:8465:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1783964977.598317:0:5809:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1783964977.598344:0:5809:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783964977.598354:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.112@tcp lock: ffff947401482600/0xe782b916994fd49f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fd4a6 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964977.598365:0:5809:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.112@tcp lock: ffff947401482600/0xe782b916994fd49f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fd4a6 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783964977.598376:0:5809:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1783964977.598378:0:5809:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff94743e519000 from 4 10000000:01000000:3.0:1783964977.598382:0:5809:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783964977.598414:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.112@tcp lock: ffff947436f27000/0xe782b916994fd4ad lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964977.598422:0:5809:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.112@tcp lock: ffff947436f27000/0xe782b916994fd4ad lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783964977.598503:0:5809:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.112@tcp lock: ffff947436f27000/0xe782b916994fd4ad lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783964977.598527:0:5809:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e438a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae0997f7-3a15-4fc6-865a-35b2f101956e:5809:1870622732878464:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783964977.598564:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783964977.598640:0:5809:0:(client.c:2702:ptlrpc_set_wait()) set ffff947429e5d540 going to sleep for 11 seconds 00000100:00100000:0.0:1783964977.598683:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732878464 00000100:00100000:0.0:1783964977.598689:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732878464 00000100:00100000:0.0:1783964977.598762:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1783964977.598769:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947405ade850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+17:5809:x1870622732878464:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783964977.598836:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783964977.598851:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff947400030000/0xe782b916994fd4b4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe782b916994fd4ad expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964977.598874:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff947400030000/0xe782b916994fd4b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe782b916994fd4ad expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964977.598884:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff947400030000/0xe782b916994fd4b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe782b916994fd4ad expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964977.598894:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff947400030000, rc 0) 00000100:00100000:0.0:1783964977.598938:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947405ade850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+18:5809:x1870622732878464:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 169us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1783964977.598944:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1783964977.598996:0:5809:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e438a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae0997f7-3a15-4fc6-865a-35b2f101956e:5809:1870622732878464:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783964977.599011:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.112@tcp lock: ffff947436f27000/0xe782b916994fd4ad lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fd4b4 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964977.599033:0:5809:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.112@tcp lock: ffff947436f27000/0xe782b916994fd4ad lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe782b916994fd4b4 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783964977.599096:0:5809:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e29b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae0997f7-3a15-4fc6-865a-35b2f101956e:5809:1870622732878592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783964977.599133:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783964977.599221:0:5809:0:(client.c:2702:ptlrpc_set_wait()) set ffff94741cca0cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1783964977.599380:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732878592 00000100:00100000:3.0:1783964977.599384:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732878592 00000100:00100000:3.0:1783964977.599443:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1783964977.599450:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947405adc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae0997f7-3a15-4fc6-865a-35b2f101956e+18:5809:x1870622732878592:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783964977.599700:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947405adc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae0997f7-3a15-4fc6-865a-35b2f101956e+18:5809:x1870622732878592:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 249us (565us total) trans 0 rc 0/0 00000100:00100000:3.0:1783964977.599708:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1783964977.600184:0:5809:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e29b480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae0997f7-3a15-4fc6-865a-35b2f101956e:5809:1870622732878592:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783964977.600257:0:5809:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947429f9b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae0997f7-3a15-4fc6-865a-35b2f101956e:5809:1870622732878720:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783964977.600298:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783964977.600332:0:5809:0:(client.c:2702:ptlrpc_set_wait()) set ffff94743709ef00 going to sleep for 11 seconds 00000100:00100000:1.0:1783964977.600685:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732878720 00000100:00100000:1.0:1783964977.600690:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732878720 00000100:00100000:1.0:1783964977.600736:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1783964977.600744:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947405add050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+18:5809:x1870622732878720:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783964977.600911:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947405add050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+18:5809:x1870622732878720:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 168us (612us total) trans 0 rc 0/0 00000100:00100000:1.0:1783964977.600918:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1783964977.602809:0:5809:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947429f9b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae0997f7-3a15-4fc6-865a-35b2f101956e:5809:1870622732878720:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783964977.606937:0:8468:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947429f9b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae0997f7-3a15-4fc6-865a-35b2f101956e:8468:1870622732878848:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783964977.607022:0:8468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783964977.607125:0:8468:0:(client.c:2702:ptlrpc_set_wait()) set ffff94743709e3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783964977.609457:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732878848 00000100:00100000:3.0:1783964977.609472:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732878848 00000100:00100000:3.0:1783964977.609538:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1783964977.609550:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947405ade450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae0997f7-3a15-4fc6-865a-35b2f101956e+18:8468:x1870622732878848:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783964977.609831:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947405ade450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae0997f7-3a15-4fc6-865a-35b2f101956e+18:8468:x1870622732878848:12345-0@lo:502:llog_process_th.0 Request processed in 284us (2809us total) trans 0 rc 0/0 00000100:00100000:3.0:1783964977.609839:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:2.0:1783964977.611318:0:8468:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947429f9b100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae0997f7-3a15-4fc6-865a-35b2f101956e:8468:1870622732878848:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783964977.611366:0:8468:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783964977.611384:0:8468:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783964977.611386:0:8468:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1783964977.611392:0:8468:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff94743e519000 00000020:00000080:2.0:1783964977.611394:0:8468:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1783964977.611493:0:8468:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947436305180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae0997f7-3a15-4fc6-865a-35b2f101956e:8468:1870622732878976:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783964977.611554:0:8468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783964977.611588:0:8468:0:(client.c:2702:ptlrpc_set_wait()) set ffff94743fac6900 going to sleep for 11 seconds 00000100:00100000:3.0:1783964977.611687:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732878976 00000100:00100000:3.0:1783964977.611693:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732878976 00000100:00100000:3.0:1783964977.611741:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1783964977.611749:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947405adc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae0997f7-3a15-4fc6-865a-35b2f101956e+18:8468:x1870622732878976:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783964977.611939:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947405adc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae0997f7-3a15-4fc6-865a-35b2f101956e+18:8468:x1870622732878976:12345-0@lo:502:llog_process_th.0 Request processed in 190us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1783964977.611946:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:2.0:1783964977.612405:0:8468:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947436305180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae0997f7-3a15-4fc6-865a-35b2f101956e:8468:1870622732878976:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783964977.612428:0:8468:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783964977.612434:0:8468:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783964977.612436:0:8468:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:2.0:1783964977.612439:0:8468:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1783964977.612508:0:5809:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1783964977.612528:0:5809:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1783964977.612538:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.112@tcp lock: ffff947436f27000/0xe782b916994fd4ad lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fd4b4 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783964977.612549:0:5809:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.112@tcp lock: ffff947436f27000/0xe782b916994fd4ad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fd4b4 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783964977.612560:0:5809:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1783964977.612563:0:5809:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff947403dc3000 from 4 10000000:01000000:2.0:1783964977.612566:0:5809:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783964977.612592:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.112@tcp lock: ffff947425974a00/0xe782b916994fd4bb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783964977.612600:0:5809:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.112@tcp lock: ffff947425974a00/0xe782b916994fd4bb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783964977.612619:0:5809:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.112@tcp lock: ffff947425974a00/0xe782b916994fd4bb lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783964977.612636:0:5809:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947436305180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae0997f7-3a15-4fc6-865a-35b2f101956e:5809:1870622732879104:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783964977.612667:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783964977.612698:0:5809:0:(client.c:2702:ptlrpc_set_wait()) set ffff94743fac6900 going to sleep for 11 seconds 00000100:00100000:1.0:1783964977.612801:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732879104 00000100:00100000:1.0:1783964977.612807:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732879104 00000100:00100000:1.0:1783964977.612848:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1783964977.612856:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947405adc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+18:5809:x1870622732879104:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783964977.612866:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783964977.612891:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94743d9ef800/0xe782b916994fd4c2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe782b916994fd4bb expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964977.612916:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94743d9ef800/0xe782b916994fd4c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe782b916994fd4bb expref: 19 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964977.612927:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94743d9ef800/0xe782b916994fd4c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe782b916994fd4bb expref: 19 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964977.612945:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94743d9ef800, rc 0) 00000100:00100000:1.0:1783964977.612984:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947405adc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+19:5809:x1870622732879104:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 130us (317us total) trans 0 rc 0/0 00000100:00100000:1.0:1783964977.612989:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1783964977.613020:0:5809:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947436305180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae0997f7-3a15-4fc6-865a-35b2f101956e:5809:1870622732879104:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783964977.613034:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.112@tcp lock: ffff947425974a00/0xe782b916994fd4bb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fd4c2 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783964977.613041:0:5809:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.112@tcp lock: ffff947425974a00/0xe782b916994fd4bb lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe782b916994fd4c2 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783964977.613082:0:5809:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e29b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae0997f7-3a15-4fc6-865a-35b2f101956e:5809:1870622732879232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783964977.613100:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783964977.613127:0:5809:0:(client.c:2702:ptlrpc_set_wait()) set ffff94741cca0e40 going to sleep for 11 seconds 00000100:00100000:0.0:1783964977.613143:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732879232 00000100:00100000:0.0:1783964977.613148:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732879232 00000100:00100000:0.0:1783964977.613181:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1783964977.613188:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947405addc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae0997f7-3a15-4fc6-865a-35b2f101956e+19:5809:x1870622732879232:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783964977.613690:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947405addc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae0997f7-3a15-4fc6-865a-35b2f101956e+19:5809:x1870622732879232:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 502us (586us total) trans 0 rc 0/0 00000100:00100000:0.0:1783964977.613697:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1783964977.613889:0:5809:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e29b800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae0997f7-3a15-4fc6-865a-35b2f101956e:5809:1870622732879232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783964977.613921:0:5809:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e43a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae0997f7-3a15-4fc6-865a-35b2f101956e:5809:1870622732879360:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783964977.613956:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783964977.617424:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732879360 00000100:00100000:2.0:1783964977.617440:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732879360 00000100:00100000:3.0:1783964977.617472:0:5809:0:(client.c:2702:ptlrpc_set_wait()) set ffff947429e5dc00 going to sleep for 11 seconds 00000100:00100000:2.0:1783964977.617505:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:2.0:1783964977.617516:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947405a4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae0997f7-3a15-4fc6-865a-35b2f101956e+19:5809:x1870622732879360:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783964977.617992:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947405a4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae0997f7-3a15-4fc6-865a-35b2f101956e+19:5809:x1870622732879360:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 478us (4033us total) trans 0 rc 0/0 00000100:00100000:2.0:1783964977.618001:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1783964977.618070:0:5809:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e43a680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae0997f7-3a15-4fc6-865a-35b2f101956e:5809:1870622732879360:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783964977.619957:0:8469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e299f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae0997f7-3a15-4fc6-865a-35b2f101956e:8469:1870622732879488:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783964977.620024:0:8469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783964977.620104:0:8469:0:(client.c:2702:ptlrpc_set_wait()) set ffff94741cca0a80 going to sleep for 11 seconds 00000100:00100000:2.0:1783964977.620152:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732879488 00000100:00100000:2.0:1783964977.620159:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732879488 00000100:00100000:2.0:1783964977.620773:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1783964977.620786:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947405a4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+19:8469:x1870622732879488:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783964977.620998:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947405a4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+19:8469:x1870622732879488:12345-0@lo:502:llog_process_th.0 Request processed in 215us (974us total) trans 0 rc 0/0 00000100:00100000:2.0:1783964977.621005:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1783964977.621106:0:8469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e299f80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae0997f7-3a15-4fc6-865a-35b2f101956e:8469:1870622732879488:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783964977.621146:0:8469:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783964977.621156:0:8469:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783964977.621158:0:8469:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1783964977.621168:0:8469:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff947403dc3000 00000020:00000080:3.0:1783964977.621170:0:8469:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1783964977.621265:0:8469:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e438380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae0997f7-3a15-4fc6-865a-35b2f101956e:8469:1870622732879616:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783964977.621316:0:8469:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783964977.621341:0:8469:0:(client.c:2702:ptlrpc_set_wait()) set ffff9474059fff00 going to sleep for 11 seconds 00000100:00100000:1.0:1783964977.621383:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732879616 00000100:00100000:1.0:1783964977.621388:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732879616 00000100:00100000:1.0:1783964977.621414:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:1.0:1783964977.621420:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947405a4e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae0997f7-3a15-4fc6-865a-35b2f101956e+19:8469:x1870622732879616:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783964977.621620:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947405a4e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae0997f7-3a15-4fc6-865a-35b2f101956e+19:8469:x1870622732879616:12345-0@lo:502:llog_process_th.0 Request processed in 199us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1783964977.621634:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1783964977.622164:0:8469:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e438380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae0997f7-3a15-4fc6-865a-35b2f101956e:8469:1870622732879616:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783964977.622187:0:8469:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783964977.622192:0:8469:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783964977.622193:0:8469:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1783964977.622261:0:8469:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1783964977.622634:0:5809:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1783964977.622657:0:5809:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1783964977.622667:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.112@tcp lock: ffff947425974a00/0xe782b916994fd4bb lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fd4c2 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783964977.622678:0:5809:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.112@tcp lock: ffff947425974a00/0xe782b916994fd4bb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fd4c2 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783964977.789682:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783964977.789816:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715025152 00000100:00100000:0.0:1783964977.789828:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715025152 00000100:00100000:0.0:1783964977.789888:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 185 00000100:00100000:0.0:1783964977.789899:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947405a4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+9:5573:x1870622715025152:12345-192.168.204.12@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783964977.789917:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783964977.789938:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff947400030200/0xe782b916994fd4c9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5efe8a expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964977.789968:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff947400030200/0xe782b916994fd4c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5efe8a expref: 10 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964977.789980:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff947400030200/0xe782b916994fd4c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5efe8a expref: 10 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783964977.789989:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff947400030200, rc 0) 00000100:00100000:0.0:1783964977.790053:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947405a4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+10:5573:x1870622715025152:12345-192.168.204.12@tcp:101:ll_cfg_requeue.0 Request processed in 155us (382us total) trans 0 rc 0/0 00000100:00100000:0.0:1783964977.790061:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 185 00000100:00100000:3.0:1783964977.794757:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783964977.794945:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715025280 00000100:00100000:0.0:1783964977.794957:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715025280 00000100:00100000:0.0:1783964977.795028:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 186 00000100:00100000:0.0:1783964977.795039:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947405a4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+10:5573:x1870622715025280:12345-192.168.204.12@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783964977.795374:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947405a4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+10:5573:x1870622715025280:12345-192.168.204.12@tcp:501:ll_cfg_requeue.0 Request processed in 336us (626us total) trans 0 rc 0/0 00000100:00100000:0.0:1783964977.795382:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 186 00000100:00100000:3.0:1783964977.797630:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783964977.797807:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715025408 00000100:00100000:1.0:1783964977.797816:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715025408 00000100:00100000:1.0:1783964977.797876:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 187 00000100:00100000:1.0:1783964977.797886:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947405a4e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+10:5573:x1870622715025408:12345-192.168.204.12@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783964977.798101:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947405a4e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+10:5573:x1870622715025408:12345-192.168.204.12@tcp:503:ll_cfg_requeue.0 Request processed in 216us (478us total) trans 0 rc 0/0 00000100:00100000:1.0:1783964977.798122:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 187 00000100:00100000:0.0:1783964977.807786:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783964977.808789:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715025536 00000100:00100000:3.0:1783964977.808800:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715025536 00000100:00100000:3.0:1783964977.810671:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 188 00000100:00100000:3.0:1783964977.810691:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947405a4c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+10:6110:x1870622715025536:12345-192.168.204.12@tcp:502:llog_process_th.0 00000100:00100000:3.0:1783964977.810977:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947405a4c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+10:6110:x1870622715025536:12345-192.168.204.12@tcp:502:llog_process_th.0 Request processed in 293us (3201us total) trans 0 rc 0/0 00000100:00100000:3.0:1783964977.810986:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 188 00000100:00100000:1.0:1783964977.823246:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783964977.823297:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715025664 00000100:00100000:1.0:1783964977.823309:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715025664 00000100:00100000:1.0:1783964977.823370:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 189 00000100:00100000:1.0:1783964977.823382:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947405adec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+10:6110:x1870622715025664:12345-192.168.204.12@tcp:502:llog_process_th.0 00000100:00100000:1.0:1783964977.823686:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947405adec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+10:6110:x1870622715025664:12345-192.168.204.12@tcp:502:llog_process_th.0 Request processed in 305us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1783964977.823695:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 189 00010000:00010000:1.0:1783964977.836770:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783964978.569479:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783964978.569528:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783964978.569569:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783964978.569700:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715026048 00000100:00100000:1.0:1783964978.569712:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715026048 00000100:00100000:1.0:1783964978.569781:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715025920 00000100:00100000:1.0:1783964978.569785:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715025920 00000100:00100000:1.0:1783964978.569806:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 12 00000100:00100000:1.0:1783964978.569815:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947429f99180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9923189b-eb4a-470c-ab45-969435371000+5:2360:x1870622715026048:12345-192.168.204.12@tcp:400:kworker.0 00000100:00100000:1.0:1783964978.569900:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947429f99180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9923189b-eb4a-470c-ab45-969435371000+5:2360:x1870622715026048:12345-192.168.204.12@tcp:400:kworker.0 Request processed in 86us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1783964978.569927:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 12 00000100:00100000:1.0:1783964978.569945:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 13 00000100:00100000:1.0:1783964978.569952:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947429f99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9923189b-eb4a-470c-ab45-969435371000+5:2360:x1870622715025920:12345-192.168.204.12@tcp:400:kworker.0 00000100:00100000:1.0:1783964978.569980:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947429f99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9923189b-eb4a-470c-ab45-969435371000+5:2360:x1870622715025920:12345-192.168.204.12@tcp:400:kworker.0 Request processed in 29us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1783964978.569987:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 13 00000100:00080000:0.0:1783964978.570225:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783964978.570229:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783964978.570432:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715025792 00000100:00100000:2.0:1783964978.570438:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715025792 00000100:00100000:2.0:1783964978.570488:0:6632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 25 00000100:00100000:2.0:1783964978.570496:0:6632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947429f9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9923189b-eb4a-470c-ab45-969435371000+6:2360:x1870622715025792:12345-192.168.204.12@tcp:400:kworker.0 00000100:00100000:2.0:1783964978.570539:0:6632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947429f9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9923189b-eb4a-470c-ab45-969435371000+6:2360:x1870622715025792:12345-192.168.204.12@tcp:400:kworker.0 Request processed in 43us (1071us total) trans 0 rc 0/0 00000100:00100000:2.0:1783964978.570546:0:6632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 25 00000100:00080000:1.0:1783964978.570870:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783964978.734158:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e438e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3324:1870622732880000:0@lo:400:kworker.0 00000100:00100000:3.0:1783964978.734254:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783964978.734326:0:3324:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783964978.734332:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e43b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3324:1870622732880128:0@lo:400:kworker.0 00000100:00100000:3.0:1783964978.734361:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783964978.734401:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732880000 00000100:00100000:3.0:1783964978.734409:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732880000 00000100:00100000:3.0:1783964978.734465:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1783964978.734475:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e43a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3324:x1870622732880000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783964978.734526:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e43a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3324:x1870622732880000:12345-0@lo:400:kworker.0 Request processed in 54us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1783964978.734533:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1783964978.734556:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732880128 00000100:00100000:3.0:1783964978.734559:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732880128 00000100:00100000:3.0:1783964978.734585:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1783964978.734592:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e43b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3324:x1870622732880128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783964978.734625:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e43b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3324:x1870622732880128:12345-0@lo:400:kworker.0 Request processed in 33us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1783964978.734631:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1783964978.734766:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e438000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3323:1870622732879872:0@lo:400:kworker.0 00000100:00100000:2.0:1783964978.734800:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783964978.734839:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e438a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3323:1870622732880384:0@lo:400:kworker.0 00000100:00100000:2.0:1783964978.734862:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783964978.734892:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783964978.734898:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783964978.734955:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e438380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ae0997f7-3a15-4fc6-865a-35b2f101956e:3322:1870622732879744:0@lo:400:kworker.0 00000100:00100000:0.0:1783964978.734991:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783964978.740333:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732879872 00000100:00100000:2.0:1783964978.740348:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732879872 00000100:00100000:2.0:1783964978.740417:0:6632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1783964978.740427:0:6632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436305180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3323:x1870622732879872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783964978.740508:0:6632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436305180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3323:x1870622732879872:12345-0@lo:400:kworker.0 Request processed in 82us (5706us total) trans 0 rc 0/0 00000100:00100000:2.0:1783964978.740517:0:6632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1783964978.740566:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e438000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3323:1870622732879872:0@lo:400:kworker.0 00000100:00100000:2.0:1783964978.740624:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e29b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3324:1870622732880512:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783964978.740663:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1783964978.742353:0:3324:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94743e43b800 x1870622732880128/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783964994 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783964978.742396:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e43b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3324:1870622732880128:0@lo:400:kworker.0 00000100:00100000:2.0:1783964978.742417:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e438e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3324:1870622732880000:0@lo:400:kworker.0 00000100:00100000:2.0:1783964978.742472:0:6610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732880512 00000100:00100000:2.0:1783964978.742478:0:6610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732880512 00000100:00100000:2.0:1783964978.742533:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1783964978.742542:0:6610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436304e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3324:x1870622732880512:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783964978.742579:0:6610:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783964978.742648:0:6610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436304e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3324:x1870622732880512:12345-0@lo:13:osp-pre-1-0.0 Request processed in 107us (1984us total) trans 0 rc 0/0 00000100:00100000:2.0:1783964978.742655:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:2.0:1783964978.742709:0:3324:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94743e29b100 x1870622732880512/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783964994 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783964978.742724:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e29b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3324:1870622732880512:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783964978.742764:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732880384 00000100:00100000:2.0:1783964978.742768:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732880384 00000100:00100000:2.0:1783964978.742795:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1783964978.742803:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436307800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3323:x1870622732880384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783964978.742845:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436307800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3323:x1870622732880384:12345-0@lo:400:kworker.0 Request processed in 43us (7982us total) trans 0 rc 0/0 00000100:00100000:2.0:1783964978.742851:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:2.0:1783964978.742880:0:3323:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94743e438a80 x1870622732880384/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783964994 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783964978.742890:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e438a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3323:1870622732880384:0@lo:400:kworker.0 00000100:00080000:3.0:1783964978.747268:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783964978.747458:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e43a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3322:1870622732880256:0@lo:400:kworker.0 00000100:00100000:3.0:1783964978.748053:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732879744 00000100:00100000:3.0:1783964978.748062:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732879744 00000100:00100000:3.0:1783964978.748137:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1783964978.748147:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947405a4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae0997f7-3a15-4fc6-865a-35b2f101956e+19:3322:x1870622732879744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783964978.748253:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947405a4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae0997f7-3a15-4fc6-865a-35b2f101956e+19:3322:x1870622732879744:12345-0@lo:400:kworker.0 Request processed in 107us (13260us total) trans 0 rc 0/0 00000100:00100000:3.0:1783964978.748261:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:0.0:1783964978.748483:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783964978.748972:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e438380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ae0997f7-3a15-4fc6-865a-35b2f101956e:3322:1870622732879744:0@lo:400:kworker.0 00000100:00100000:3.0:1783964978.750040:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732880256 00000100:00100000:3.0:1783964978.750066:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732880256 00000100:00100000:3.0:1783964978.750148:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1783964978.750158:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947429f99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3322:x1870622732880256:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783964978.750258:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947429f99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3322:x1870622732880256:12345-0@lo:400:kworker.0 Request processed in 101us (1775us total) trans 0 rc 0/0 00000100:00100000:3.0:1783964978.750266:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1783964978.750314:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e43a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3322:1870622732880256:0@lo:400:kworker.0 00000100:00080000:0.0:1783964978.750494:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1783964978.860117:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783964979.891969:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783964980.779739:0:3324:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783964980.779765:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947429f99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3324:1870622732880640:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783964980.779840:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783964980.780091:0:6610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732880640 00000100:00100000:0.0:1783964980.780101:0:6610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732880640 00000100:00100000:0.0:1783964980.780165:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1783964980.780175:0:6610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e299880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3324:x1870622732880640:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783964980.780226:0:6610:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1783964980.780232:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783964980.780293:0:6610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e299880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3324:x1870622732880640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 119us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1783964980.780300:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:1.0:1783964980.780316:0:3324:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff947429f99c00 x1870622732880640/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783964996 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783964980.780337:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947429f99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3324:1870622732880640:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1783964980.907367:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783964981.931472:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1783964982.632487:0:8685:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg412-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:3.0:1783964982.955389:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783964983.675850:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783964983.675925:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783964983.675969:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783964983.676026:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715026304 00000100:00100000:3.0:1783964983.676038:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715026304 00000100:00100000:3.0:1783964983.676108:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 29 00000100:00100000:3.0:1783964983.676121:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e43a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9923189b-eb4a-470c-ab45-969435371000+6:2360:x1870622715026304:12345-192.168.204.12@tcp:400:kworker.0 00000100:00100000:3.0:1783964983.676229:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e43a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9923189b-eb4a-470c-ab45-969435371000+6:2360:x1870622715026304:12345-192.168.204.12@tcp:400:kworker.0 Request processed in 110us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1783964983.676238:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 29 00000100:00080000:3.0:1783964983.676263:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783964983.676449:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715026560 00000100:00100000:3.0:1783964983.676454:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715026560 00000100:00100000:3.0:1783964983.676488:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 16 00000100:00100000:3.0:1783964983.676494:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e438700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9923189b-eb4a-470c-ab45-969435371000+5:2360:x1870622715026560:12345-192.168.204.12@tcp:400:kworker.0 00000100:00100000:3.0:1783964983.676530:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e438700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9923189b-eb4a-470c-ab45-969435371000+5:2360:x1870622715026560:12345-192.168.204.12@tcp:400:kworker.0 Request processed in 36us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1783964983.676560:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 16 00000100:00080000:3.0:1783964983.676602:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783964983.683848:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715026176 00000100:00100000:1.0:1783964983.683863:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715026176 00000100:00100000:1.0:1783964983.683937:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 191 00000100:00100000:1.0:1783964983.683948:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947405a4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+10:2359:x1870622715026176:12345-192.168.204.12@tcp:400:kworker.0 00000100:00100000:1.0:1783964983.684039:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947405a4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+10:2359:x1870622715026176:12345-192.168.204.12@tcp:400:kworker.0 Request processed in 94us (8114us total) trans 0 rc 0/0 00000100:00100000:1.0:1783964983.684046:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 191 00000100:00100000:3.0:1783964983.691382:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783964983.692285:0:6609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715026432 00000100:00100000:2.0:1783964983.692303:0:6609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715026432 00000100:00100000:2.0:1783964983.692407:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 17 00000100:00100000:2.0:1783964983.692433:0:6609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e439c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9923189b-eb4a-470c-ab45-969435371000+5:2359:x1870622715026432:12345-192.168.204.12@tcp:400:kworker.0 00000100:00100000:2.0:1783964983.692825:0:6609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e439c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9923189b-eb4a-470c-ab45-969435371000+5:2359:x1870622715026432:12345-192.168.204.12@tcp:400:kworker.0 Request processed in 394us (1452us total) trans 0 rc 0/0 00000100:00100000:2.0:1783964983.692835:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 17 00000100:00080000:3.0:1783964983.694118:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783964983.851830:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e43ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3324:1870622732881024:0@lo:400:kworker.0 00000100:00100000:3.0:1783964983.851901:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783964983.851954:0:3324:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783964983.851960:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e43aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3324:1870622732881152:0@lo:400:kworker.0 00000100:00100000:3.0:1783964983.851984:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783964983.852034:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732881024 00000100:00100000:2.0:1783964983.852038:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e439f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3323:1870622732880896:0@lo:400:kworker.0 00000100:00100000:3.0:1783964983.852041:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732881024 00000100:00100000:2.0:1783964983.852069:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783964983.852089:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732880896 00000100:00100000:3.0:1783964983.852092:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732880896 00000100:00100000:2.0:1783964983.852092:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e438a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3323:1870622732881408:0@lo:400:kworker.0 00000100:00100000:2.0:1783964983.852112:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783964983.852127:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1783964983.852135:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e438e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3324:x1870622732881024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783964983.852135:0:3323:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1783964983.852140:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e439500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ae0997f7-3a15-4fc6-865a-35b2f101956e:3323:1870622732880768:0@lo:400:kworker.0 00000100:00100000:2.0:1783964983.852164:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783964983.852179:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e438e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3324:x1870622732881024:12345-0@lo:400:kworker.0 Request processed in 45us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1783964983.852184:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e438380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3323:1870622732881280:0@lo:400:kworker.0 00000100:00100000:3.0:1783964983.852187:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1783964983.852223:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1783964983.852229:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436306680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3323:x1870622732880896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783964983.852242:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783964983.852256:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436306680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3323:x1870622732880896:12345-0@lo:400:kworker.0 Request processed in 27us (186us total) trans 0 rc 0/0 00000100:00100000:3.0:1783964983.852261:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1783964983.852271:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e439f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3323:1870622732880896:0@lo:400:kworker.0 00000100:00100000:3.0:1783964983.852276:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732881280 00000100:00100000:3.0:1783964983.852278:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732881280 00000100:00100000:3.0:1783964983.852297:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1783964983.852303:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436305500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3323:x1870622732881280:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783964983.852311:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732881152 00000100:00100000:2.0:1783964983.852313:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732881152 00000100:00100000:2.0:1783964983.852341:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732881408 00000100:00100000:2.0:1783964983.852345:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732881408 00000100:00100000:3.0:1783964983.852348:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436305500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3323:x1870622732881280:12345-0@lo:400:kworker.0 Request processed in 46us (106us total) trans 0 rc 0/0 00000100:00100000:3.0:1783964983.852354:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1783964983.852359:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1783964983.852364:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e43b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3324:x1870622732881152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783964983.852371:0:6608:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1783964983.852378:0:6608:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00080000:3.0:1783964983.852392:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783964983.852396:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783964983.852399:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783964983.852402:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e43b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3324:x1870622732881152:12345-0@lo:400:kworker.0 Request processed in 38us (418us total) trans 0 rc 0/0 00000100:00100000:2.0:1783964983.852409:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1783964983.852414:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732880768 00000100:00100000:3.0:1783964983.852417:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732880768 00000100:00100000:2.0:1783964983.852419:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1783964983.852423:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436306300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3323:x1870622732881408:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783964983.852440:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1783964983.852445:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94740951d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae0997f7-3a15-4fc6-865a-35b2f101956e+19:3323:x1870622732880768:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783964983.852448:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436306300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3323:x1870622732881408:12345-0@lo:400:kworker.0 Request processed in 25us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1783964983.852453:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1783964983.852473:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94740951d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae0997f7-3a15-4fc6-865a-35b2f101956e+19:3323:x1870622732880768:12345-0@lo:400:kworker.0 Request processed in 28us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1783964983.852479:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1783964983.852479:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e439500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ae0997f7-3a15-4fc6-865a-35b2f101956e:3323:1870622732880768:0@lo:400:kworker.0 00000100:00100000:2.0:1783964983.852488:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e438380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3323:1870622732881280:0@lo:400:kworker.0 00010000:00080000:2.0:1783964983.852499:0:3323:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94743e438a80 x1870622732881408/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783964999 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783964983.852509:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e438a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3323:1870622732881408:0@lo:400:kworker.0 00010000:00080000:2.0:1783964983.852553:0:3324:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94743e43aa00 x1870622732881152/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783964999 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783964983.852562:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e43aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3324:1870622732881152:0@lo:400:kworker.0 00000100:00100000:2.0:1783964983.852571:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e43ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3324:1870622732881024:0@lo:400:kworker.0 00000100:00100000:1.0:1783964983.852890:0:3325:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783964983.852901:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e29b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3325:1870622732881536:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783964983.852942:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783964983.852974:0:6610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732881536 00000100:00100000:1.0:1783964983.852978:0:6610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732881536 00000100:00100000:1.0:1783964983.853018:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1783964983.853035:0:6610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e299f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3325:x1870622732881536:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783964983.853063:0:6610:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783964983.853098:0:6610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e299f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3325:x1870622732881536:12345-0@lo:13:osp-pre-1-0.0 Request processed in 64us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1783964983.853104:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:1.0:1783964983.853134:0:3325:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94743e29b100 x1870622732881536/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783964999 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783964983.853148:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e29b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3325:1870622732881536:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1783964983.989125:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783964985.003400:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783964985.900669:0:3324:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783964985.900693:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947429f9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3324:1870622732881664:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783964985.900764:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783964985.900883:0:6610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732881664 00000100:00100000:0.0:1783964985.900906:0:6610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732881664 00000100:00100000:0.0:1783964985.901057:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1783964985.901068:0:6610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e438000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3324:x1870622732881664:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783964985.901144:0:6610:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783964985.901193:0:6610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e438000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3324:x1870622732881664:12345-0@lo:13:osp-pre-0-0.0 Request processed in 127us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1783964985.901745:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:3.0:1783964985.901832:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1783964985.901866:0:3324:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff947429f9ad80 x1870622732881664/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783965001 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783964985.901886:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947429f9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3324:1870622732881664:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1783964986.029051:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1783964986.957326:0:8931:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg412-server.virtnet: executing yml_node 00010000:00010000:1.0:1783964987.051443:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783964988.077018:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783964988.798312:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783964988.798389:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783964988.798557:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715026688 00000100:00100000:0.0:1783964988.798570:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715026688 00000100:00100000:0.0:1783964988.798656:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 193 00000100:00100000:0.0:1783964988.798668:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94740951e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+10:2358:x1870622715026688:12345-192.168.204.12@tcp:400:kworker.0 00000100:00100000:0.0:1783964988.798765:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94740951e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+10:2358:x1870622715026688:12345-192.168.204.12@tcp:400:kworker.0 Request processed in 99us (374us total) trans 0 rc 0/0 00000100:00100000:0.0:1783964988.798774:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 193 00000100:00100000:2.0:1783964988.799079:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715026816 00000100:00100000:2.0:1783964988.799086:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715026816 00000100:00100000:2.0:1783964988.799168:0:6632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 33 00000100:00100000:2.0:1783964988.799185:0:6632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e43ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9923189b-eb4a-470c-ab45-969435371000+6:2358:x1870622715026816:12345-192.168.204.12@tcp:400:kworker.0 00000100:00100000:2.0:1783964988.799285:0:6632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e43ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9923189b-eb4a-470c-ab45-969435371000+6:2358:x1870622715026816:12345-192.168.204.12@tcp:400:kworker.0 Request processed in 109us (989us total) trans 0 rc 0/0 00000100:00100000:2.0:1783964988.799302:0:6632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 33 00000100:00080000:3.0:1783964988.799743:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783964988.806669:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783964988.806721:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783964988.806946:0:6609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715026944 00000100:00100000:0.0:1783964988.806961:0:6609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715026944 00000100:00100000:0.0:1783964988.807057:0:6609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715027072 00000100:00100000:0.0:1783964988.807061:0:6609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715027072 00000100:00100000:0.0:1783964988.807091:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 11 00000100:00100000:0.0:1783964988.807104:0:6609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e43aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9923189b-eb4a-470c-ab45-969435371000+5:2356:x1870622715026944:12345-192.168.204.12@tcp:9:kworker.0 00000020:00000080:0.0:1783964988.807167:0:6609:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe782b916994fd405 00000100:00080000:0.0:1783964988.807180:0:6609:0:(import.c:65:import_set_state_nolock()) ffff94743e55c000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1783964988.807283:0:6609:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1783964988.807958:0:6609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e43aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9923189b-eb4a-470c-ab45-969435371000+2:2356:x1870622715026944:12345-192.168.204.12@tcp:9:kworker.0 Request processed in 854us (1303us total) trans 0 rc 0/0 00000100:00100000:1.0:1783964988.807980:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 12 00000100:00100000:1.0:1783964988.808017:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e438a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9923189b-eb4a-470c-ab45-969435371000+5:2356:x1870622715027072:12345-192.168.204.12@tcp:9:kworker.0 00000100:00080000:3.0:1783964988.808032:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783964988.808038:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:1.0:1783964988.808069:0:6608:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe782b916994fd40c 00010000:00010000:3.0:1783964988.808073:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1783964988.808087:0:6608:0:(import.c:65:import_set_state_nolock()) ffff9474059b0000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1783964988.808157:0:6608:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1783964988.808562:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e438a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9923189b-eb4a-470c-ab45-969435371000+2:2356:x1870622715027072:12345-192.168.204.12@tcp:9:kworker.0 Request processed in 565us (1838us total) trans 0 rc 0/0 00000100:00100000:0.0:1783964988.809026:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 11 00010000:00010000:0.0:1783964988.809142:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783964988.811026:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 12 00000100:00100000:0.0:1783964988.971576:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e29b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3322:1870622732881792:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783964988.971672:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783964988.971865:0:6610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732881792 00000100:00100000:1.0:1783964988.971873:0:6610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732881792 00000100:00100000:1.0:1783964988.971970:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1783964988.971982:0:6610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947429f98380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1870622732881792:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783964988.972026:0:6610:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783964988.972158:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e438380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ae0997f7-3a15-4fc6-865a-35b2f101956e:3323:1870622732881920:0@lo:400:kworker.0 00000100:00100000:2.0:1783964988.972226:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783964988.972288:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732881920 00000100:00100000:2.0:1783964988.972292:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732881920 00000100:00100000:2.0:1783964988.972322:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1783964988.972328:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94740951c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+19:3323:x1870622732881920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783964988.972364:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94740951c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+19:3323:x1870622732881920:12345-0@lo:400:kworker.0 Request processed in 36us (137us total) trans 0 rc 0/0 00000100:00100000:2.0:1783964988.972371:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1783964988.972417:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e438380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ae0997f7-3a15-4fc6-865a-35b2f101956e:3323:1870622732881920:0@lo:400:kworker.0 00000100:00080000:2.0:1783964988.972455:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783964988.974151:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e439500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3324:1870622732882048:0@lo:400:kworker.0 00000100:00100000:2.0:1783964988.974287:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783964988.974429:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732882048 00000100:00100000:3.0:1783964988.974438:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732882048 00000100:00100000:3.0:1783964988.974502:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1783964988.974512:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436306d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3324:x1870622732882048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783964988.974974:0:3324:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783964988.974983:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e439f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3324:1870622732882176:0@lo:400:kworker.0 00000100:00100000:3.0:1783964988.975067:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436306d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3324:x1870622732882048:12345-0@lo:400:kworker.0 Request processed in 556us (780us total) trans 0 rc 0/0 00000100:00100000:3.0:1783964988.975076:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1783964988.975111:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9474072a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3323:1870622732882432:0@lo:400:kworker.0 00000100:00100000:3.0:1783964988.975188:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783964988.975236:0:3323:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783964988.975242:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e438380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3323:1870622732882304:0@lo:400:kworker.0 00000100:00100000:3.0:1783964988.975280:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783964988.975310:0:8738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732882304 00000100:00100000:3.0:1783964988.975320:0:8738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732882304 00000100:00100000:3.0:1783964988.975360:0:8738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1783964988.975366:0:8738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94741cc31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3323:x1870622732882304:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783964988.975401:0:8738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94741cc31500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3323:x1870622732882304:12345-0@lo:400:kworker.0 Request processed in 35us (120us total) trans 0 rc 0/0 00000100:00100000:3.0:1783964988.975420:0:8738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:3.0:1783964988.975437:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1783964988.975467:0:3323:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94743e438380 x1870622732882304/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783965004 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783964988.975496:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e438380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3323:1870622732882304:0@lo:400:kworker.0 00000100:00100000:3.0:1783964988.975528:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732882432 00000100:00100000:3.0:1783964988.975531:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732882432 00000100:00100000:3.0:1783964988.975558:0:6632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1783964988.975564:0:6632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94741cc33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3323:x1870622732882432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783964988.975612:0:6632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94741cc33480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3323:x1870622732882432:12345-0@lo:400:kworker.0 Request processed in 48us (424us total) trans 0 rc 0/0 00000100:00100000:3.0:1783964988.975619:0:6632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00080000:3.0:1783964988.975634:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783964988.975648:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9474072a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3323:1870622732882432:0@lo:400:kworker.0 00000100:00100000:2.0:1783964988.975766:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783964988.975802:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e439500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3324:1870622732882048:0@lo:400:kworker.0 00000100:00100000:3.0:1783964988.975983:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732882176 00000100:00100000:3.0:1783964988.975988:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732882176 00000100:00100000:3.0:1783964988.976031:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1783964988.976037:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436307100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3324:x1870622732882176:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783964988.976075:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436307100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3324:x1870622732882176:12345-0@lo:400:kworker.0 Request processed in 38us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1783964988.976081:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:2.0:1783964988.976146:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783964988.976169:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e439f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3324:1870622732882176:0@lo:400:kworker.0 00000100:00100000:1.0:1783964988.976692:0:6610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947429f98380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1870622732881792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 4689us (4996us total) trans 0 rc 0/0 00000100:00100000:1.0:1783964988.976709:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:0.0:1783964988.981067:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94743e29b100 x1870622732881792/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783965004 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783964988.981104:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e29b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3322:1870622732881792:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1783964989.099705:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783964990.124228:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783964991.019847:0:3325:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783964991.019882:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947429f9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3325:1870622732882560:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783964991.020030:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783964991.020194:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732882560 00000100:00100000:0.0:1783964991.020220:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732882560 00000100:00100000:0.0:1783964991.020426:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1783964991.020438:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94741cc31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3325:x1870622732882560:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783964991.020475:0:6611:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783964991.020700:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94741cc31180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3325:x1870622732882560:12345-0@lo:13:osp-pre-0-0.0 Request processed in 263us (668us total) trans 0 rc 0/0 00000100:00100000:0.0:1783964991.020707:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:1.0:1783964991.020794:0:3325:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff947429f9a680 x1870622732882560/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783965007 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783964991.020813:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947429f9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3325:1870622732882560:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1783964991.021833:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1783964991.158619:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1783964991.659931:0:6637:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 9923189b-eb4a-470c-ab45-969435371000 00000020:00000080:2.0:1783964991.659942:0:6637:0:(genops.c:906:class_export_put()) final put ffff94743e558000/9923189b-eb4a-470c-ab45-969435371000 00000020:00000080:3.0:1783964991.660712:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff94743e558000/9923189b-eb4a-470c-ab45-969435371000 for lustre-OST0000 00000020:00000080:3.0:1783964991.660782:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff94743e55c000 for lustre-OST0000 00000001:02000400:0.0:1783964992.039804:0:9125:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.54.162 00010000:00010000:0.0:1783964992.176147:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1783964993.159067:0:7523:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 9923189b-eb4a-470c-ab45-969435371000 00000020:00000080:2.0:1783964993.159081:0:7523:0:(genops.c:906:class_export_put()) final put ffff9474059b4800/9923189b-eb4a-470c-ab45-969435371000 00000020:00000080:3.0:1783964993.159243:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff9474059b4800/9923189b-eb4a-470c-ab45-969435371000 for lustre-OST0001 00000020:00000080:3.0:1783964993.159316:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9474059b0000 for lustre-OST0001 00010000:00010000:3.0:1783964993.200267:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783964993.912484:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783964993.912556:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783964993.912847:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715027200 00000100:00100000:0.0:1783964993.912859:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715027200 00000100:00100000:0.0:1783964993.912922:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 195 00000100:00100000:0.0:1783964993.912933:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94740951c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+10:2360:x1870622715027200:12345-192.168.204.12@tcp:400:kworker.0 00000100:00100000:0.0:1783964993.913018:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94740951c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+10:2360:x1870622715027200:12345-192.168.204.12@tcp:400:kworker.0 Request processed in 87us (475us total) trans 0 rc 0/0 00000100:00100000:0.0:1783964993.913025:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 195 00000100:00100000:2.0:1783964993.913113:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715027328 00000100:00100000:2.0:1783964993.913118:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715027328 00000100:00100000:2.0:1783964993.913180:0:6632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 37 00000100:00100000:2.0:1783964993.913189:0:6632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94741cc33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9923189b-eb4a-470c-ab45-969435371000+6:2360:x1870622715027328:12345-192.168.204.12@tcp:400:kworker.0 00000100:00100000:2.0:1783964993.913255:0:6632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94741cc33100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9923189b-eb4a-470c-ab45-969435371000+6:2360:x1870622715027328:12345-192.168.204.12@tcp:400:kworker.0 Request processed in 68us (782us total) trans 0 rc 0/0 00000100:00100000:2.0:1783964993.913274:0:6632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 37 00000100:00080000:0.0:1783964993.913503:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783964994.092758:0:3324:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783964994.092784:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e29b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3324:1870622732882688:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783964994.092877:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783964994.093151:0:6610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732882688 00000100:00100000:1.0:1783964994.093160:0:6610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732882688 00000100:00100000:1.0:1783964994.093409:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1783964994.093423:0:6610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947429f98e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3324:x1870622732882688:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783964994.093460:0:6610:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783964994.093512:0:6610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947429f98e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3324:x1870622732882688:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (635us total) trans 0 rc 0/0 00000100:00080000:0.0:1783964994.093584:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1783964994.093635:0:3324:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94743e29b800 x1870622732882688/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783965010 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783964994.093654:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e29b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3324:1870622732882688:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783964994.097924:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947407296d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ae0997f7-3a15-4fc6-865a-35b2f101956e:3322:1870622732882816:0@lo:400:kworker.0 00000100:00100000:2.0:1783964994.098003:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783964994.098038:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947407294380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3322:1870622732883328:0@lo:400:kworker.0 00000100:00100000:2.0:1783964994.098080:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783964994.098108:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783964994.098115:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947407294a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3322:1870622732882944:0@lo:400:kworker.0 00000100:00100000:2.0:1783964994.098137:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783964994.099579:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732882816 00000100:00100000:2.0:1783964994.099592:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732882816 00000100:00100000:2.0:1783964994.100368:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1783964994.100385:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94740951ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae0997f7-3a15-4fc6-865a-35b2f101956e+19:3322:x1870622732882816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783964994.100471:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94740951ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae0997f7-3a15-4fc6-865a-35b2f101956e+19:3322:x1870622732882816:12345-0@lo:400:kworker.0 Request processed in 93us (2467us total) trans 0 rc 0/0 00000100:00100000:2.0:1783964994.100479:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1783964994.100518:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732883328 00000100:00100000:2.0:1783964994.100523:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732883328 00000100:00100000:2.0:1783964994.100553:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732882944 00000100:00100000:2.0:1783964994.100555:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732882944 00000100:00100000:2.0:1783964994.100572:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1783964994.100578:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947407296680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3322:x1870622732883328:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783964994.100637:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947407296680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3322:x1870622732883328:12345-0@lo:400:kworker.0 Request processed in 58us (2555us total) trans 0 rc 0/0 00000100:00100000:2.0:1783964994.100644:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1783964994.100656:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1783964994.100662:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947407294e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3322:x1870622732882944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783964994.100692:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947407294e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3322:x1870622732882944:12345-0@lo:400:kworker.0 Request processed in 30us (2554us total) trans 0 rc 0/0 00000100:00100000:2.0:1783964994.100698:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:2.0:1783964994.100720:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783964994.100752:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947407295f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3325:1870622732883200:0@lo:400:kworker.0 00000100:00100000:2.0:1783964994.100807:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783964994.100834:0:3325:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783964994.100841:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947407294000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3325:1870622732883072:0@lo:400:kworker.0 00000100:00100000:2.0:1783964994.100863:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783964994.100885:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732883200 00000100:00100000:2.0:1783964994.100888:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732883200 00000100:00100000:2.0:1783964994.100928:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1783964994.100935:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947407297800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3325:x1870622732883200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783964994.100967:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947407297800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3325:x1870622732883200:12345-0@lo:400:kworker.0 Request processed in 32us (168us total) trans 0 rc 0/0 00000100:00100000:2.0:1783964994.100974:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:2.0:1783964994.100986:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1783964994.101010:0:3325:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff947407295f80 x1870622732883200/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783965010 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783964994.101023:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947407295f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3325:1870622732883200:0@lo:400:kworker.0 00000100:00100000:2.0:1783964994.101045:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732883072 00000100:00100000:2.0:1783964994.101054:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732883072 00000100:00100000:2.0:1783964994.101094:0:6632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1783964994.101099:0:6632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947407296a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3325:x1870622732883072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783964994.101136:0:6632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947407296a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3325:x1870622732883072:12345-0@lo:400:kworker.0 Request processed in 37us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1783964994.101143:0:6632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:2.0:1783964994.101158:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783964994.101185:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947407294000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3325:1870622732883072:0@lo:400:kworker.0 00000100:00100000:2.0:1783964994.101229:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947407294a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3322:1870622732882944:0@lo:400:kworker.0 00000100:00100000:2.0:1783964994.101240:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947407296d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ae0997f7-3a15-4fc6-865a-35b2f101956e:3322:1870622732882816:0@lo:400:kworker.0 00000100:00100000:2.0:1783964994.101250:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947407294380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3322:1870622732883328:0@lo:400:kworker.0 00000100:00100000:1.0:1783964994.105578:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00010000:0.0:1783964994.219523:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1783964995.210649:0:9224:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.54.162 00010000:00010000:1.0:1783964995.246306:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783964996.146395:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e29b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3323:1870622732883456:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783964996.146470:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783964996.146585:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732883456 00000100:00100000:3.0:1783964996.146594:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732883456 00000100:00100000:3.0:1783964996.146661:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00080000:1.0:1783964996.146663:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783964996.146674:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e298000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3323:x1870622732883456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783964996.146721:0:6611:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783964996.146792:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e298000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3323:x1870622732883456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 122us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1783964996.146800:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:1.0:1783964996.149493:0:3323:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94743e29b480 x1870622732883456/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783965012 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783964996.149520:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e29b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3323:1870622732883456:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1783964996.269675:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783964997.293160:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1783964997.814354:0:9321:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.54.162 00010000:00010000:0.0:1783964998.315777:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783964999.036553:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783964999.036620:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783964999.037836:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715027584 00000100:00100000:0.0:1783964999.037853:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715027584 00000100:00100000:0.0:1783964999.037967:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 41 00000100:00100000:0.0:1783964999.037979:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94741cc31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9923189b-eb4a-470c-ab45-969435371000+6:2357:x1870622715027584:12345-192.168.204.12@tcp:400:kworker.0 00000100:00100000:0.0:1783964999.038088:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94741cc31880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9923189b-eb4a-470c-ab45-969435371000+6:2357:x1870622715027584:12345-192.168.204.12@tcp:400:kworker.0 Request processed in 112us (1468us total) trans 0 rc 0/0 00000100:00100000:0.0:1783964999.038095:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 41 00000100:00080000:1.0:1783964999.038183:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783964999.038262:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715027456 00000100:00100000:2.0:1783964999.038268:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715027456 00000100:00100000:2.0:1783964999.038310:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 197 00000100:00100000:2.0:1783964999.038319:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94740951dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+10:2357:x1870622715027456:12345-192.168.204.12@tcp:400:kworker.0 00000100:00100000:2.0:1783964999.038351:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94740951dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+10:2357:x1870622715027456:12345-192.168.204.12@tcp:400:kworker.0 Request processed in 34us (1815us total) trans 0 rc 0/0 00000100:00100000:2.0:1783964999.038357:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 197 00000100:00100000:2.0:1783964999.211795:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94741cc33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3325:1870622732883712:0@lo:400:kworker.0 00000100:00100000:3.0:1783964999.211855:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94741cc31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3322:1870622732883840:0@lo:400:kworker.0 00000100:00100000:0.0:1783964999.211949:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94741cc30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ae0997f7-3a15-4fc6-865a-35b2f101956e:3324:1870622732883584:0@lo:400:kworker.0 00000100:00100000:3.0:1783964999.212187:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783964999.212342:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94741cc32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3323:1870622732883968:0@lo:400:kworker.0 00000100:00100000:2.0:1783964999.212382:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783964999.212470:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732883840 00000100:00100000:1.0:1783964999.212483:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732883840 00000100:00100000:3.0:1783964999.212525:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94741cc30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3322:1870622732884352:0@lo:400:kworker.0 00000100:00100000:2.0:1783964999.212556:0:8738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732883968 00000100:00100000:2.0:1783964999.212563:0:8738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732883968 00000100:00100000:1.0:1783964999.212573:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1783964999.212606:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94741cc31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3322:x1870622732883840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783964999.212608:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783964999.212617:0:8738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1783964999.212642:0:8738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947407294380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3323:x1870622732883968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783964999.212684:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783964999.212728:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94741cc31f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3322:x1870622732883840:12345-0@lo:400:kworker.0 Request processed in 127us (540us total) trans 0 rc 0/0 00000100:00100000:2.0:1783964999.212740:0:8738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947407294380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3323:x1870622732883968:12345-0@lo:400:kworker.0 Request processed in 104us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1783964999.212745:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94741cc31c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3322:1870622732883840:0@lo:400:kworker.0 00000100:00100000:1.0:1783964999.212746:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1783964999.212753:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e29b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3324:1870622732884096:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783964999.212763:0:8738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1783964999.212785:0:8738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732884352 00000100:00080000:1.0:1783964999.212787:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783964999.212789:0:8738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732884352 00000100:00080000:1.0:1783964999.212795:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783964999.212799:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1783964999.212801:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783964999.212824:0:6610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732884096 00000100:00100000:2.0:1783964999.212829:0:8738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1783964999.212830:0:6610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732884096 00000100:00100000:2.0:1783964999.212838:0:8738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94741cc30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3322:x1870622732884352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783964999.212862:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1783964999.212870:0:6610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947429f98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3324:x1870622732884096:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783964999.212905:0:6610:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783964999.212936:0:3324:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783964999.212945:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94741cc30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3324:1870622732884224:0@lo:400:kworker.0 00000100:00100000:2.0:1783964999.213076:0:8738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94741cc30380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3322:x1870622732884352:12345-0@lo:400:kworker.0 Request processed in 239us (475us total) trans 0 rc 0/0 00000100:00100000:2.0:1783964999.213084:0:8738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:2.0:1783964999.213124:0:3323:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94741cc32d80 x1870622732883968/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783965015 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783964999.213140:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94741cc32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3323:1870622732883968:0@lo:400:kworker.0 00010000:00080000:3.0:1783964999.213148:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94741cc30000 x1870622732884352/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783965015 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783964999.213162:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94741cc30000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3322:1870622732884352:0@lo:400:kworker.0 00000100:00100000:2.0:1783964999.213192:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783964999.213265:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732883712 00000100:00100000:2.0:1783964999.213292:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732883584 00000100:00100000:2.0:1783964999.213297:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732883584 00000100:00100000:2.0:1783964999.213331:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:2.0:1783964999.213339:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94740951fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae0997f7-3a15-4fc6-865a-35b2f101956e+19:3324:x1870622732883584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783964999.213376:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94740951fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae0997f7-3a15-4fc6-865a-35b2f101956e+19:3324:x1870622732883584:12345-0@lo:400:kworker.0 Request processed in 38us (704us total) trans 0 rc 0/0 00000100:00100000:2.0:1783964999.213385:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1783964999.213391:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732883712 00000100:00100000:3.0:1783964999.213452:0:6632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1783964999.213463:0:6632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947407296d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3325:x1870622732883712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783964999.213535:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783964999.213549:0:6610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947429f98000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3324:x1870622732884096:12345-0@lo:13:osp-pre-1-0.0 Request processed in 676us (748us total) trans 0 rc 0/0 00000100:00100000:3.0:1783964999.213557:0:6632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947407296d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3325:x1870622732883712:12345-0@lo:400:kworker.0 Request processed in 95us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1783964999.213562:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1783964999.213570:0:6632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1783964999.213678:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94741cc33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3325:1870622732883712:0@lo:400:kworker.0 00000100:00100000:0.0:1783964999.213799:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94741cc30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ae0997f7-3a15-4fc6-865a-35b2f101956e:3324:1870622732883584:0@lo:400:kworker.0 00010000:00080000:0.0:1783964999.213815:0:3324:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94743e29b480 x1870622732884096/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783965015 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783964999.213836:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732884224 00000100:00100000:3.0:1783964999.213843:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732884224 00000100:00080000:2.0:1783964999.213962:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783964999.213975:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e29b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3324:1870622732884096:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783964999.214020:0:6632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1783964999.214033:0:6632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947429f9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3324:x1870622732884224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783964999.214097:0:6632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947429f9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3324:x1870622732884224:12345-0@lo:400:kworker.0 Request processed in 68us (566us total) trans 0 rc 0/0 00000100:00100000:3.0:1783964999.214104:0:6632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1783964999.214149:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94741cc30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3324:1870622732884224:0@lo:400:kworker.0 00010000:00010000:1.0:1783964999.340808:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783965000.363433:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783965001.260301:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947429f9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3323:1870622732884480:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783965001.260372:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783965001.260870:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732884480 00000100:00100000:3.0:1783965001.260879:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732884480 00000100:00100000:3.0:1783965001.260954:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1783965001.260964:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e29aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3323:x1870622732884480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783965001.260997:0:6611:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783965001.261073:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e29aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3323:x1870622732884480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (701us total) trans 0 rc 0/0 00010000:00080000:1.0:1783965001.261187:0:3323:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff947429f9ad80 x1870622732884480/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783965017 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783965001.261225:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947429f9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3323:1870622732884480:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1783965001.261228:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783965001.261355:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:1.0:1783965001.388002:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783965002.411499:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1783965003.405792:0:9371:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Mon Jul 13 13:50:01 EDT 2026 00010000:00010000:2.0:1783965003.435495:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783965004.160516:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965004.160571:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965004.160655:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715027712 00000100:00100000:1.0:1783965004.160668:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715027712 00000100:00100000:1.0:1783965004.160750:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 199 00000100:00100000:1.0:1783965004.160764:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94741cee0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+10:2357:x1870622715027712:12345-192.168.204.12@tcp:400:kworker.0 00000100:00100000:1.0:1783965004.160886:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94741cee0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+10:2357:x1870622715027712:12345-192.168.204.12@tcp:400:kworker.0 Request processed in 125us (384us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965004.160895:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 199 00000100:00100000:2.0:1783965004.161242:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715027840 00000100:00100000:2.0:1783965004.161256:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715027840 00000100:00100000:2.0:1783965004.161312:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 45 00000100:00100000:2.0:1783965004.161320:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94741cc30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9923189b-eb4a-470c-ab45-969435371000+6:2357:x1870622715027840:12345-192.168.204.12@tcp:400:kworker.0 00000100:00100000:2.0:1783965004.161367:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94741cc30000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9923189b-eb4a-470c-ab45-969435371000+6:2357:x1870622715027840:12345-192.168.204.12@tcp:400:kworker.0 Request processed in 48us (795us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965004.161374:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 45 00000100:00080000:1.0:1783965004.161981:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783965004.331660:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947407295f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3322:1870622732884864:0@lo:400:kworker.0 00000100:00100000:2.0:1783965004.331773:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783965004.331851:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783965004.331858:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947407296300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3322:1870622732884992:0@lo:400:kworker.0 00000100:00100000:3.0:1783965004.332190:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947407294000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3325:1870622732884736:0@lo:400:kworker.0 00000100:00100000:0.0:1783965004.333632:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947407294a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ae0997f7-3a15-4fc6-865a-35b2f101956e:3324:1870622732884608:0@lo:400:kworker.0 00000100:00100000:1.0:1783965004.334753:0:3323:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783965004.334785:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e29b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3323:1870622732885376:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783965004.340464:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783965004.340556:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947407295500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3325:1870622732885248:0@lo:400:kworker.0 00000100:00100000:3.0:1783965004.340639:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783965004.343929:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783965004.344058:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732884864 00000100:00100000:2.0:1783965004.344071:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732884864 00000100:00100000:2.0:1783965004.344155:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732884736 00000100:00100000:2.0:1783965004.344160:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732884736 00000100:00100000:2.0:1783965004.344193:0:6632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1783965004.344221:0:6632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947407295180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3322:x1870622732884864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783965004.344332:0:6632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947407295180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3322:x1870622732884864:12345-0@lo:400:kworker.0 Request processed in 129us (12558us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965004.344341:0:6632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1783965004.344365:0:6632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1783965004.344371:0:6632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94741cc31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3325:x1870622732884736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783965004.344414:0:6632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94741cc31c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3325:x1870622732884736:12345-0@lo:400:kworker.0 Request processed in 43us (3964us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965004.344421:0:6632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1783965004.344443:0:6609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732885248 00000100:00100000:2.0:1783965004.344465:0:6609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732885248 00000100:00100000:2.0:1783965004.344499:0:6609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732884992 00000100:00100000:2.0:1783965004.344503:0:6609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732884992 00000100:00100000:2.0:1783965004.344524:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1783965004.344531:0:6609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94741cc32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3325:x1870622732885248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783965004.344568:0:6609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94741cc32680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3325:x1870622732885248:12345-0@lo:400:kworker.0 Request processed in 38us (3929us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965004.344575:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1783965004.344587:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1783965004.344593:0:6609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947407297100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3322:x1870622732884992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783965004.344633:0:6609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947407297100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3322:x1870622732884992:12345-0@lo:400:kworker.0 Request processed in 39us (718us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965004.344640:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:2.0:1783965004.344658:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783965004.344663:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783965004.344666:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1783965004.344720:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff947407296300 x1870622732884992/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783965020 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783965004.344740:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947407296300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3322:1870622732884992:0@lo:400:kworker.0 00000100:00100000:2.0:1783965004.344756:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947407295f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3322:1870622732884864:0@lo:400:kworker.0 00000100:00100000:3.0:1783965004.345565:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947407294000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3325:1870622732884736:0@lo:400:kworker.0 00010000:00080000:3.0:1783965004.345582:0:3325:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff947407295500 x1870622732885248/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783965020 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783965004.345593:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947407295500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3325:1870622732885248:0@lo:400:kworker.0 00000100:00100000:0.0:1783965004.354161:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783965004.354265:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947407297480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3324:1870622732885120:0@lo:400:kworker.0 00000100:00100000:0.0:1783965004.354324:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783965004.355306:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732885120 00000100:00100000:0.0:1783965004.355321:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732885120 00000100:00100000:0.0:1783965004.355410:0:6632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1783965004.355423:0:6632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947429f99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3324:x1870622732885120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783965004.355513:0:6632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947429f99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3324:x1870622732885120:12345-0@lo:400:kworker.0 Request processed in 92us (1187us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965004.355523:0:6632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1783965004.355583:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947407297480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3324:1870622732885120:0@lo:400:kworker.0 00000100:00080000:0.0:1783965004.355625:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783965004.355805:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732884608 00000100:00100000:3.0:1783965004.355811:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732884608 00000100:00100000:3.0:1783965004.355848:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1783965004.355856:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94741cee1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+19:3324:x1870622732884608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783965004.355921:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94741cee1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+19:3324:x1870622732884608:12345-0@lo:400:kworker.0 Request processed in 66us (1773us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965004.355927:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1783965004.356458:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947407294a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ae0997f7-3a15-4fc6-865a-35b2f101956e:3324:1870622732884608:0@lo:400:kworker.0 00000100:00100000:1.0:1783965004.363286:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783965004.363403:0:6610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732885376 00000100:00100000:1.0:1783965004.363415:0:6610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732885376 00000100:00100000:1.0:1783965004.363489:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1783965004.363502:0:6610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e29b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3323:x1870622732885376:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783965004.363560:0:6610:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783965004.363623:0:6610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e29b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3323:x1870622732885376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 124us (349us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965004.363631:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:1.0:1783965004.363691:0:3323:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94743e29b480 x1870622732885376/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783965020 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783965004.363718:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e29b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3323:1870622732885376:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1783965004.459617:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783965005.483847:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783965006.380690:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e29b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3323:1870622732885504:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783965006.380785:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783965006.380880:0:6610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732885504 00000100:00100000:1.0:1783965006.380890:0:6610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732885504 00000100:00100000:1.0:1783965006.380956:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1783965006.380966:0:6610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e29b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3323:x1870622732885504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783965006.381028:0:6610:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783965006.381101:0:6610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e29b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3323:x1870622732885504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 136us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965006.381110:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:1.0:1783965006.381158:0:3323:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94743e29b480 x1870622732885504/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783965022 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783965006.381179:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e29b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3323:1870622732885504:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1783965006.387283:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1783965006.518909:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783965007.535083:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783965008.556313:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783965009.273048:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783965009.273110:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965009.273241:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715028096 00000100:00100000:2.0:1783965009.273254:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715028096 00000100:00080000:0.0:1783965009.273448:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783965009.273517:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 49 00000100:00100000:2.0:1783965009.273534:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947429f9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9923189b-eb4a-470c-ab45-969435371000+6:2360:x1870622715028096:12345-192.168.204.12@tcp:400:kworker.0 00000100:00100000:1.0:1783965009.273835:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715027968 00000100:00100000:1.0:1783965009.273841:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715027968 00000100:00100000:1.0:1783965009.273899:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 201 00000100:00100000:1.0:1783965009.273908:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94741cee2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+10:2359:x1870622715027968:12345-192.168.204.12@tcp:400:kworker.0 00000100:00100000:2.0:1783965009.273962:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947429f9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9923189b-eb4a-470c-ab45-969435371000+6:2360:x1870622715028096:12345-192.168.204.12@tcp:400:kworker.0 Request processed in 431us (925us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965009.273983:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 49 00000100:00100000:1.0:1783965009.274881:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94741cee2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+10:2359:x1870622715027968:12345-192.168.204.12@tcp:400:kworker.0 Request processed in 967us (1762us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965009.274891:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 201 00000100:00100000:0.0:1783965009.453765:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9474368d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ae0997f7-3a15-4fc6-865a-35b2f101956e:3324:1870622732885632:0@lo:400:kworker.0 00000100:00100000:1.0:1783965009.453779:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743715c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3322:1870622732885888:0@lo:400:kworker.0 00000100:00100000:3.0:1783965009.454948:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743715ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3325:1870622732885760:0@lo:400:kworker.0 00000100:00100000:1.0:1783965009.456897:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783965009.457018:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94741cc30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3322:1870622732886400:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783965009.457086:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783965009.457123:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783965009.457132:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743715df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3322:1870622732886016:0@lo:400:kworker.0 00000100:00100000:1.0:1783965009.457163:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783965009.457238:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783965009.457248:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732885888 00000100:00100000:1.0:1783965009.457258:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732885888 00000100:00100000:0.0:1783965009.457281:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743715c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3324:1870622732886144:0@lo:400:kworker.0 00000100:00100000:0.0:1783965009.457317:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783965009.458014:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732885632 00000100:00100000:0.0:1783965009.458022:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732885632 00000100:00100000:0.0:1783965009.458067:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:0.0:1783965009.458077:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94741cee0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae0997f7-3a15-4fc6-865a-35b2f101956e+19:3324:x1870622732885632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783965009.458145:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94741cee0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae0997f7-3a15-4fc6-865a-35b2f101956e+19:3324:x1870622732885632:12345-0@lo:400:kworker.0 Request processed in 69us (908us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965009.458153:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1783965009.458498:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783965009.466075:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743715e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3325:1870622732886272:0@lo:400:kworker.0 00000100:00100000:3.0:1783965009.466157:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783965009.466233:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732886016 00000100:00100000:2.0:1783965009.466244:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732886016 00000100:00100000:2.0:1783965009.466300:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732886272 00000100:00100000:2.0:1783965009.466303:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732886272 00000100:00100000:2.0:1783965009.466326:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1783965009.466337:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947429f47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3322:x1870622732886016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783965009.466413:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947429f47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3322:x1870622732886016:12345-0@lo:400:kworker.0 Request processed in 78us (9249us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965009.466422:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1783965009.466443:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1783965009.466451:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94741cc32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3325:x1870622732886272:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783965009.466458:0:6610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732886400 00000100:00100000:1.0:1783965009.466473:0:6610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732886400 00000100:00100000:2.0:1783965009.466488:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94741cc32a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3325:x1870622732886272:12345-0@lo:400:kworker.0 Request processed in 38us (330us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965009.466495:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1783965009.466524:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1783965009.466535:0:6610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947429f44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1870622732886400:12345-0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1783965009.466570:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94743715df80 x1870622732886016/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783965025 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00002000:00000024:1.0:1783965009.466573:0:6610:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783965009.466593:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743715df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3322:1870622732886016:0@lo:400:kworker.0 00000100:00100000:1.0:1783965009.466625:0:6610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947429f44e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1870622732886400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (9538us total) trans 0 rc 0/0 00010000:00080000:2.0:1783965009.466629:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94741cc30e00 x1870622732886400/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783965025 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783965009.466640:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1783965009.466652:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94741cc30e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3322:1870622732886400:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1783965009.466671:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783965009.466677:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783965009.466680:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783965009.466862:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732886144 00000100:00100000:0.0:1783965009.466869:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732886144 00000100:00100000:0.0:1783965009.466911:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732885760 00000100:00080000:2.0:1783965009.466913:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783965009.466915:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732885760 00000100:00100000:0.0:1783965009.466942:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1783965009.466950:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e29b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3322:x1870622732885888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783965009.466998:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e29b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3322:x1870622732885888:12345-0@lo:400:kworker.0 Request processed in 49us (10113us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965009.467005:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1783965009.467023:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1783965009.467032:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743715c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3322:1870622732885888:0@lo:400:kworker.0 00000100:00100000:0.0:1783965009.467033:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743715ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3324:x1870622732886144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783965009.467071:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743715ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3324:x1870622732886144:12345-0@lo:400:kworker.0 Request processed in 43us (9754us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965009.467077:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1783965009.467092:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1783965009.467097:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94741cc33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3325:x1870622732885760:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783965009.467135:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94741cc33800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3325:x1870622732885760:12345-0@lo:400:kworker.0 Request processed in 38us (8639us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965009.467143:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1783965009.467178:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9474368d4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ae0997f7-3a15-4fc6-865a-35b2f101956e:3324:1870622732885632:0@lo:400:kworker.0 00000100:00100000:0.0:1783965009.467192:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743715c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3324:1870622732886144:0@lo:400:kworker.0 00000100:00100000:2.0:1783965009.467268:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743715ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3325:1870622732885760:0@lo:400:kworker.0 00010000:00080000:2.0:1783965009.467288:0:3325:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94743715e680 x1870622732886272/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783965025 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783965009.467298:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743715e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3325:1870622732886272:0@lo:400:kworker.0 00010000:00010000:3.0:1783965009.582079:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783965010.605577:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783965011.503684:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783965011.503719:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94741cc32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3322:1870622732886528:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783965011.503820:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783965011.505714:0:6610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732886528 00000100:00100000:0.0:1783965011.505734:0:6610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732886528 00000100:00100000:0.0:1783965011.505850:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1783965011.505868:0:6610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94741cc30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1870622732886528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783965011.505919:0:6610:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783965011.506004:0:6610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94741cc30e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1870622732886528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 143us (2184us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965011.506012:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:3.0:1783965011.506080:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1783965011.506306:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94741cc32300 x1870622732886528/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783965027 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783965011.506353:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94741cc32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3322:1870622732886528:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1783965011.629000:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783965012.654566:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783965013.675333:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783965014.396772:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965014.396832:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965014.396876:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715028352 00000100:00100000:2.0:1783965014.396888:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715028352 00000100:00100000:2.0:1783965014.396968:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 53 00000100:00100000:2.0:1783965014.396980:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947407295f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9923189b-eb4a-470c-ab45-969435371000+6:2357:x1870622715028352:12345-192.168.204.12@tcp:400:kworker.0 00000100:00100000:2.0:1783965014.397080:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947407295f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9923189b-eb4a-470c-ab45-969435371000+6:2357:x1870622715028352:12345-192.168.204.12@tcp:400:kworker.0 Request processed in 102us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965014.397089:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 53 00000100:00080000:2.0:1783965014.397117:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783965014.398349:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715028224 00000100:00100000:1.0:1783965014.398362:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715028224 00000100:00100000:1.0:1783965014.398427:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 203 00000100:00100000:1.0:1783965014.398439:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94741cee0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+10:2357:x1870622715028224:12345-192.168.204.12@tcp:400:kworker.0 00000100:00100000:1.0:1783965014.398513:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94741cee0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+10:2357:x1870622715028224:12345-192.168.204.12@tcp:400:kworker.0 Request processed in 76us (1757us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965014.398520:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 203 00000100:00100000:2.0:1783965014.573861:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947407295880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3325:1870622732886784:0@lo:400:kworker.0 00000100:00100000:2.0:1783965014.573964:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783965014.574038:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947407294a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3325:1870622732887296:0@lo:400:kworker.0 00000100:00100000:2.0:1783965014.574071:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783965014.574114:0:3325:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1783965014.574122:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947407296300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ae0997f7-3a15-4fc6-865a-35b2f101956e:3325:1870622732886656:0@lo:400:kworker.0 00000100:00100000:2.0:1783965014.574159:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783965014.574182:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947407295c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3325:1870622732887168:0@lo:400:kworker.0 00000100:00100000:2.0:1783965014.574253:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783965014.574285:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947407297b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3323:1870622732887040:0@lo:400:kworker.0 00000100:00100000:2.0:1783965014.574347:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783965014.574376:0:3323:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783965014.574383:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947407294700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3323:1870622732886912:0@lo:400:kworker.0 00000100:00100000:2.0:1783965014.574418:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783965014.574452:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732886784 00000100:00100000:2.0:1783965014.574461:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732886784 00000100:00100000:2.0:1783965014.574513:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732887168 00000100:00100000:2.0:1783965014.574517:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732887168 00000100:00100000:2.0:1783965014.574542:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732886912 00000100:00100000:2.0:1783965014.574545:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732886912 00000100:00100000:2.0:1783965014.574564:0:6632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1783965014.574573:0:6632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947407297480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3325:x1870622732886784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783965014.574640:0:6632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947407297480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3325:x1870622732886784:12345-0@lo:400:kworker.0 Request processed in 68us (677us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965014.574648:0:6632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1783965014.574667:0:6632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1783965014.574672:0:6632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947407294000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3325:x1870622732887168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783965014.574700:0:6632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947407294000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3325:x1870622732887168:12345-0@lo:400:kworker.0 Request processed in 28us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965014.574706:0:6632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1783965014.574719:0:6632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1783965014.574725:0:6632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947425978a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3323:x1870622732886912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783965014.574755:0:6632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947425978a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3323:x1870622732886912:12345-0@lo:400:kworker.0 Request processed in 31us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965014.574761:0:6632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1783965014.574781:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732887296 00000100:00100000:2.0:1783965014.574784:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732887296 00000100:00100000:2.0:1783965014.574810:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732887040 00000100:00100000:2.0:1783965014.574814:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732887040 00000100:00100000:2.0:1783965014.574849:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1783965014.574855:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947407295500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3325:x1870622732887296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783965014.574888:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947407295500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3325:x1870622732887296:12345-0@lo:400:kworker.0 Request processed in 34us (817us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965014.574893:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1783965014.574904:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1783965014.574910:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94742597ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3323:x1870622732887040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783965014.574932:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94742597ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3323:x1870622732887040:12345-0@lo:400:kworker.0 Request processed in 23us (585us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965014.574937:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1783965014.574956:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732886656 00000100:00100000:2.0:1783965014.574960:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732886656 00000100:00100000:2.0:1783965014.574987:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1783965014.574994:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94741cee2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae0997f7-3a15-4fc6-865a-35b2f101956e+19:3325:x1870622732886656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783965014.575024:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94741cee2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae0997f7-3a15-4fc6-865a-35b2f101956e+19:3325:x1870622732886656:12345-0@lo:400:kworker.0 Request processed in 30us (865us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965014.575030:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00080000:2.0:1783965014.575077:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783965014.575083:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783965014.575086:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783965014.575134:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947407294700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3323:1870622732886912:0@lo:400:kworker.0 00010000:00080000:2.0:1783965014.575154:0:3323:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff947407297b80 x1870622732887040/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783965030 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783965014.575166:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947407297b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3323:1870622732887040:0@lo:400:kworker.0 00000100:00100000:2.0:1783965014.575241:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947407296300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ae0997f7-3a15-4fc6-865a-35b2f101956e:3325:1870622732886656:0@lo:400:kworker.0 00000100:00100000:2.0:1783965014.575267:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947407295c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3325:1870622732887168:0@lo:400:kworker.0 00000100:00100000:2.0:1783965014.575279:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947407295880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3325:1870622732886784:0@lo:400:kworker.0 00010000:00080000:2.0:1783965014.575291:0:3325:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff947407294a80 x1870622732887296/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783965030 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783965014.575302:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947407294a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3325:1870622732887296:0@lo:400:kworker.0 00000100:00100000:0.0:1783965014.576754:0:3323:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783965014.576781:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94741cc32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3323:1870622732887424:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783965014.576855:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783965014.576942:0:6610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732887424 00000100:00100000:3.0:1783965014.576951:0:6610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732887424 00000100:00100000:3.0:1783965014.577012:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1783965014.577024:0:6610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743715c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3323:x1870622732887424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783965014.577084:0:6610:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783965014.577146:0:6610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743715c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3323:x1870622732887424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 123us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965014.577153:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:0.0:1783965014.577271:0:3323:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94741cc32300 x1870622732887424/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783965030 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783965014.577299:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94741cc32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3323:1870622732887424:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1783965014.699661:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783965015.743721:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783965016.634392:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947429f46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3323:1870622732887552:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783965016.634484:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783965016.634611:0:6610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732887552 00000100:00100000:1.0:1783965016.634621:0:6610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732887552 00000100:00100000:1.0:1783965016.634704:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1783965016.634714:0:6610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743715f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3323:x1870622732887552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783965016.634766:0:6610:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1783965016.634991:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783965016.635071:0:6610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743715f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3323:x1870622732887552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 358us (587us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965016.635080:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:0.0:1783965016.635163:0:3323:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff947429f46a00 x1870622732887552/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783965032 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783965016.635233:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947429f46a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3323:1870622732887552:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1783965016.752659:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783965017.779063:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783965018.795673:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783965019.515580:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965019.515644:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965019.517468:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715028608 00000100:00100000:3.0:1783965019.517482:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715028608 00000100:00100000:3.0:1783965019.517576:0:6632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 57 00000100:00100000:3.0:1783965019.517591:0:6632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947425978000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9923189b-eb4a-470c-ab45-969435371000+6:2357:x1870622715028608:12345-192.168.204.12@tcp:400:kworker.0 00000100:00100000:3.0:1783965019.517686:0:6632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947425978000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9923189b-eb4a-470c-ab45-969435371000+6:2357:x1870622715028608:12345-192.168.204.12@tcp:400:kworker.0 Request processed in 100us (2041us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965019.517695:0:6632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 57 00000100:00100000:1.0:1783965019.519072:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715028480 00000100:00100000:1.0:1783965019.519086:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715028480 00000100:00100000:1.0:1783965019.519152:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 205 00000100:00100000:1.0:1783965019.519162:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94741cee1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+10:2357:x1870622715028480:12345-192.168.204.12@tcp:400:kworker.0 00000100:00100000:1.0:1783965019.519286:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94741cee1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+10:2357:x1870622715028480:12345-192.168.204.12@tcp:400:kworker.0 Request processed in 125us (3716us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965019.519294:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 205 00000100:00080000:0.0:1783965019.520245:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783965019.693166:0:3325:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783965019.693191:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947429f46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3325:1870622732887680:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783965019.693281:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783965019.693438:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732887680 00000100:00100000:1.0:1783965019.693447:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732887680 00000100:00100000:1.0:1783965019.693518:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1783965019.693528:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947425979f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3325:x1870622732887680:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783965019.693566:0:6611:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783965019.693615:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947425979f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3325:x1870622732887680:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (334us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965019.693623:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:1.0:1783965019.693668:0:3325:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff947429f46300 x1870622732887680/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783965035 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783965019.693687:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947429f46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3325:1870622732887680:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1783965019.694125:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783965019.695617:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94741cc30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3322:1870622732887936:0@lo:400:kworker.0 00000100:00100000:2.0:1783965019.695679:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783965019.695722:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783965019.695738:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94741cc33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3322:1870622732888064:0@lo:400:kworker.0 00000100:00100000:2.0:1783965019.695759:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783965019.695802:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732887936 00000100:00100000:2.0:1783965019.695808:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732887936 00000100:00100000:2.0:1783965019.695853:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732888064 00000100:00100000:2.0:1783965019.695857:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732888064 00000100:00100000:2.0:1783965019.695896:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1783965019.695905:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947425978380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3322:x1870622732887936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783965019.695952:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947425978380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3322:x1870622732887936:12345-0@lo:400:kworker.0 Request processed in 49us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965019.695972:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1783965019.695990:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1783965019.695996:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94742597a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3322:x1870622732888064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783965019.696023:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94742597a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3322:x1870622732888064:12345-0@lo:400:kworker.0 Request processed in 27us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965019.696029:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:2.0:1783965019.696049:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783965019.696073:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94741cc33b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3322:1870622732888064:0@lo:400:kworker.0 00000100:00100000:2.0:1783965019.696083:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94741cc30700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3322:1870622732887936:0@lo:400:kworker.0 00000100:00100000:0.0:1783965019.696352:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94741cc32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3324:1870622732888192:0@lo:400:kworker.0 00000100:00100000:0.0:1783965019.696387:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783965019.696424:0:3324:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1783965019.696431:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94741cc30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ae0997f7-3a15-4fc6-865a-35b2f101956e:3324:1870622732887808:0@lo:400:kworker.0 00000100:00100000:0.0:1783965019.696458:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783965019.696485:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94741cc32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3324:1870622732888320:0@lo:400:kworker.0 00000100:00100000:0.0:1783965019.696505:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783965019.696532:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732887808 00000100:00100000:0.0:1783965019.696536:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732887808 00000100:00100000:0.0:1783965019.696561:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1783965019.696567:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94741cee3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+19:3324:x1870622732887808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783965019.696600:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94741cee3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+19:3324:x1870622732887808:12345-0@lo:400:kworker.0 Request processed in 33us (141us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965019.696606:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1783965019.696639:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94741cc30a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ae0997f7-3a15-4fc6-865a-35b2f101956e:3324:1870622732887808:0@lo:400:kworker.0 00000100:00100000:0.0:1783965019.696653:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732888320 00000100:00100000:0.0:1783965019.696656:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732888320 00000100:00100000:0.0:1783965019.696682:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1783965019.696688:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743715e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3324:x1870622732888320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783965019.696717:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743715e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3324:x1870622732888320:12345-0@lo:400:kworker.0 Request processed in 29us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965019.696724:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1783965019.696782:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94741cc32300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3324:1870622732888320:0@lo:400:kworker.0 00000100:00080000:0.0:1783965019.696799:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783965019.697429:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732888192 00000100:00100000:2.0:1783965019.697435:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732888192 00000100:00100000:2.0:1783965019.697485:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1783965019.697493:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743715ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3324:x1870622732888192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783965019.697548:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743715ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3324:x1870622732888192:12345-0@lo:400:kworker.0 Request processed in 56us (1160us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965019.697554:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:1.0:1783965019.698150:0:3324:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94741cc32d80 x1870622732888192/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783965035 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783965019.698164:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94741cc32d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3324:1870622732888192:0@lo:400:kworker.0 00000100:00080000:0.0:1783965019.699198:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1783965019.820506:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783965020.847745:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1783965021.103933:0:10000:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 13:50:19 (1783965019) === 00000100:00100000:2.0:1783965021.610709:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965021.610957:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715028736 00000100:00100000:1.0:1783965021.610972:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715028736 00000100:00100000:1.0:1783965021.611090:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 207 00000100:00100000:1.0:1783965021.611103:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94741cee1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+10:8105:x1870622715028736:12345-192.168.204.12@tcp:101:mount.lustre.0 00010000:00010000:1.0:1783965021.611145:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783965021.611176:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94743d9ee600/0xe782b916994fd4d0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5efe91 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965021.611282:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94743d9ee600/0xe782b916994fd4d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5efe91 expref: 11 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965021.611299:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94743d9ee600/0xe782b916994fd4d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5efe91 expref: 11 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965021.611309:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94743d9ee600, rc 0) 00000100:00100000:1.0:1783965021.611386:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94741cee1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+11:8105:x1870622715028736:12345-192.168.204.12@tcp:101:mount.lustre.0 Request processed in 285us (693us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965021.611394:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 207 00000100:00100000:3.0:1783965021.617457:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965021.618031:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715028864 00000100:00100000:1.0:1783965021.618043:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715028864 00000100:00100000:1.0:1783965021.618253:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 208 00000100:00100000:1.0:1783965021.618940:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94741cee3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+11:8105:x1870622715028864:12345-192.168.204.12@tcp:501:mount.lustre.0 00000100:00100000:1.0:1783965021.621013:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94741cee3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+11:8105:x1870622715028864:12345-192.168.204.12@tcp:501:mount.lustre.0 Request processed in 2072us (3558us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965021.621028:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 208 00000100:00100000:3.0:1783965021.625863:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965021.626119:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715028992 00000100:00100000:1.0:1783965021.626191:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715028992 00000100:00100000:1.0:1783965021.626595:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 209 00000100:00100000:1.0:1783965021.626607:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94741cee3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+11:8105:x1870622715028992:12345-192.168.204.12@tcp:503:mount.lustre.0 00000100:00100000:1.0:1783965021.626903:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94741cee3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+11:8105:x1870622715028992:12345-192.168.204.12@tcp:503:mount.lustre.0 Request processed in 298us (1057us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965021.626919:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 209 00000100:00100000:3.0:1783965021.650767:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965021.660596:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715029120 00000100:00100000:1.0:1783965021.660612:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715029120 00000100:00100000:1.0:1783965021.660719:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 210 00000100:00100000:1.0:1783965021.660730:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94741cee3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+11:8109:x1870622715029120:12345-192.168.204.12@tcp:502:llog_process_th.0 00000100:00100000:1.0:1783965021.661168:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94741cee3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+11:8109:x1870622715029120:12345-192.168.204.12@tcp:502:llog_process_th.0 Request processed in 438us (10409us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965021.661177:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 210 00000100:00100000:3.0:1783965021.694917:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965021.696020:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715029248 00000100:00100000:1.0:1783965021.696031:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715029248 00000100:00100000:1.0:1783965021.696148:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 211 00000100:00100000:1.0:1783965021.696160:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94741cee0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+11:8109:x1870622715029248:12345-192.168.204.12@tcp:502:llog_process_th.0 00000100:00100000:1.0:1783965021.696516:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94741cee0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+11:8109:x1870622715029248:12345-192.168.204.12@tcp:502:llog_process_th.0 Request processed in 357us (1608us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965021.696524:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 211 00000100:00100000:3.0:1783965021.698977:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965021.709541:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715029376 00000100:00100000:2.0:1783965021.709559:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715029376 00000100:00100000:1.0:1783965021.710248:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 212 00000100:00100000:2.0:1783965021.710441:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94741cee1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+11:8105:x1870622715029376:12345-192.168.204.12@tcp:101:mount.lustre.0 00010000:00010000:2.0:1783965021.710460:0:5806:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783965021.710480:0:5806:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff947425974200/0xe782b916994fd4d7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5efebb expref: -99 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965021.710534:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff947425974200/0xe782b916994fd4d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5efebb expref: 12 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965021.710545:0:5806:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff947425974200/0xe782b916994fd4d7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5efebb expref: 12 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965021.710555:0:5806:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff947425974200, rc 0) 00000100:00100000:2.0:1783965021.710617:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94741cee1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+12:8105:x1870622715029376:12345-192.168.204.12@tcp:101:mount.lustre.0 Request processed in 359us (11665us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965021.710625:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 212 00000100:00100000:3.0:1783965021.730013:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965021.730421:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715029504 00000100:00100000:2.0:1783965021.730435:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715029504 00000100:00100000:3.0:1783965021.730901:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 213 00000100:00100000:3.0:1783965021.730914:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94741cee2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+12:8105:x1870622715029504:12345-192.168.204.12@tcp:256:mount.lustre.0 20000000:01000000:3.0:1783965021.730955:0:5807:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1783965021.730990:0:5807:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1783965021.730996:0:5807:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1783965021.731000:0:5807:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1783965021.731002:0:5807:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:1.0:1783965021.733875:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94741cee2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+12:8105:x1870622715029504:12345-192.168.204.12@tcp:256:mount.lustre.0 Request processed in 2954us (3870us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965021.733976:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 213 00000100:00100000:2.0:1783965021.739599:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947429f46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3322:1870622732888448:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783965021.739698:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783965021.739816:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732888448 00000100:00100000:1.0:1783965021.739827:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732888448 00000100:00100000:1.0:1783965021.740009:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1783965021.740027:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947425978e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1870622732888448:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1783965021.740030:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:1.0:1783965021.740069:0:6611:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783965021.740183:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947425978e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1870622732888448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 163us (484us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965021.740262:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:2.0:1783965021.740537:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff947429f46300 x1870622732888448/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783965037 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783965021.740564:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947429f46300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3322:1870622732888448:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783965021.753000:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783965021.758372:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715029632 00000100:00100000:0.0:1783965021.758407:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715029632 00000100:00100000:0.0:1783965021.758515:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 214 00000100:00100000:0.0:1783965021.758529:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94741cee2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+12:8105:x1870622715029632:12345-192.168.204.12@tcp:101:mount.lustre.0 00010000:00010000:0.0:1783965021.758559:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783965021.758596:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff947400030c00/0xe782b916994fd4de lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5efec2 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965021.758643:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff947400030c00/0xe782b916994fd4de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5efec2 expref: 13 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965021.758778:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff947400030c00/0xe782b916994fd4de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5efec2 expref: 13 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965021.758790:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff947400030c00, rc 0) 00000100:00100000:0.0:1783965021.758891:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94741cee2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+13:8105:x1870622715029632:12345-192.168.204.12@tcp:101:mount.lustre.0 Request processed in 365us (5908us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965021.758899:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 214 00000100:00100000:3.0:1783965021.763911:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965021.764101:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715029760 00000100:00100000:1.0:1783965021.764115:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715029760 00000100:00100000:1.0:1783965021.764249:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 215 00000100:00100000:1.0:1783965021.764264:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947408ec8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+13:8105:x1870622715029760:12345-192.168.204.12@tcp:501:mount.lustre.0 00000100:00100000:1.0:1783965021.764709:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947408ec8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+13:8105:x1870622715029760:12345-192.168.204.12@tcp:501:mount.lustre.0 Request processed in 446us (810us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965021.764719:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 215 00000100:00100000:3.0:1783965021.776178:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783965021.777057:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715029888 00000100:00100000:0.0:1783965021.777076:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715029888 00000100:00100000:0.0:1783965021.777155:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 216 00000100:00100000:0.0:1783965021.777171:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947408ec9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+13:8105:x1870622715029888:12345-192.168.204.12@tcp:503:mount.lustre.0 00000100:00100000:0.0:1783965021.779151:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947408ec9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+13:8105:x1870622715029888:12345-192.168.204.12@tcp:503:mount.lustre.0 Request processed in 1968us (2973us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965021.779179:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 216 00000100:00100000:3.0:1783965021.786675:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965021.788022:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715030016 00000100:00100000:2.0:1783965021.788040:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715030016 00000100:00100000:2.0:1783965021.788303:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 217 00000100:00100000:2.0:1783965021.788318:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947408eca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+13:8111:x1870622715030016:12345-192.168.204.12@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783965021.788723:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947408eca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+13:8111:x1870622715030016:12345-192.168.204.12@tcp:502:llog_process_th.0 Request processed in 409us (2064us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965021.788733:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 217 00000100:00100000:3.0:1783965021.795248:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965021.795342:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715030144 00000100:00100000:1.0:1783965021.795355:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715030144 00000100:00100000:1.0:1783965021.795426:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 218 00000100:00100000:1.0:1783965021.795438:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947408eca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+13:8111:x1870622715030144:12345-192.168.204.12@tcp:502:llog_process_th.0 00000100:00100000:1.0:1783965021.795788:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947408eca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+13:8111:x1870622715030144:12345-192.168.204.12@tcp:502:llog_process_th.0 Request processed in 351us (585us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965021.795797:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 218 00000100:00100000:3.0:1783965021.804090:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783965021.804173:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715030272 00000100:00100000:0.0:1783965021.804187:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715030272 00000100:00100000:0.0:1783965021.804350:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 10 00000100:00100000:0.0:1783965021.804361:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94741cc32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2356:x1870622715030272:12345-192.168.204.12@tcp:38:mount.lustre.0 00010000:00080000:0.0:1783965021.804405:0:5811:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from 49bbacc1-b013-4591-8d15-02f4f0d1884e@192.168.204.12@tcp t0 exp 0000000000000000 cur 256 last 0 00000020:00000080:0.0:1783965021.804459:0:5811:0:(genops.c:1406:class_connect()) connect: client 49bbacc1-b013-4591-8d15-02f4f0d1884e, cookie 0xe782b916994fd4e5 00000004:00100000:0.0:1783965021.804749:0:5811:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:0.0:1783965021.805349:0:5811:0:(import.c:65:import_set_state_nolock()) ffff947304bd7000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783965021.805701:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94741cc32d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49bbacc1-b013-4591-8d15-02f4f0d1884e+6:2356:x1870622715030272:12345-192.168.204.12@tcp:38:mount.lustre.0 Request processed in 1337us (2353us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965021.805712:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 10 00000100:00100000:0.0:1783965021.806769:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965021.807144:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715030656 00000100:00100000:3.0:1783965021.807157:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715030656 00000100:00100000:3.0:1783965021.807282:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 61 00000100:00100000:3.0:1783965021.807295:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743715f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9923189b-eb4a-470c-ab45-969435371000+6:2357:x1870622715030656:12345-192.168.204.12@tcp:400:kworker.0 00000100:00100000:3.0:1783965021.807408:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743715f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9923189b-eb4a-470c-ab45-969435371000+6:2357:x1870622715030656:12345-192.168.204.12@tcp:400:kworker.0 Request processed in 116us (1578us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965021.807417:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 61 00000100:00080000:0.0:1783965021.807502:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783965021.809316:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965021.809400:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965021.809499:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715030400 00000100:00100000:2.0:1783965021.809511:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715030400 00000100:00100000:2.0:1783965021.809605:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715030528 00000100:00100000:2.0:1783965021.809609:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715030528 00000100:00100000:2.0:1783965021.809631:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 11 00000100:00100000:2.0:1783965021.809641:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94741cc32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49bbacc1-b013-4591-8d15-02f4f0d1884e+7:0:x1870622715030400:12345-192.168.204.12@tcp:41:mount.lustre.0 00000004:00000024:2.0:1783965021.809700:0:5813:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1783965021.809798:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94741cc32300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49bbacc1-b013-4591-8d15-02f4f0d1884e+7:0:x1870622715030400:12345-192.168.204.12@tcp:41:mount.lustre.0 Request processed in 158us (493us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965021.809807:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 11 00000100:00100000:2.0:1783965021.809826:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 12 00000100:00100000:2.0:1783965021.809833:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94741cc30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49bbacc1-b013-4591-8d15-02f4f0d1884e+6:8105:x1870622715030528:12345-192.168.204.12@tcp:41:mount.lustre.0 00000004:00000024:2.0:1783965021.809845:0:5813:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1783965021.809880:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94741cc30a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49bbacc1-b013-4591-8d15-02f4f0d1884e+6:8105:x1870622715030528:12345-192.168.204.12@tcp:41:mount.lustre.0 Request processed in 47us (480us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965021.809887:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 12 00000100:00080000:1.0:1783965021.810400:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783965021.813160:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783965021.813318:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715030784 00000100:00100000:0.0:1783965021.813331:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715030784 00000100:00100000:0.0:1783965021.813403:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 13 00000100:00100000:0.0:1783965021.813415:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94742597b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49bbacc1-b013-4591-8d15-02f4f0d1884e+6:8105:x1870622715030784:12345-192.168.204.12@tcp:40:mount.lustre.0 00000100:00100000:0.0:1783965021.813551:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94742597b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49bbacc1-b013-4591-8d15-02f4f0d1884e+6:8105:x1870622715030784:12345-192.168.204.12@tcp:40:mount.lustre.0 Request processed in 137us (405us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965021.813560:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 13 00000100:00100000:0.0:1783965021.820501:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965021.822994:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965021.826567:0:8738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715030912 00000100:00100000:2.0:1783965021.826699:0:8738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715030912 00000100:00100000:2.0:1783965021.826766:0:8738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715031040 00000100:00100000:2.0:1783965021.826771:0:8738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715031040 00000100:00100000:2.0:1783965021.826799:0:8738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 13 00000100:00100000:2.0:1783965021.826809:0:8738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743715d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2356:x1870622715030912:12345-192.168.204.12@tcp:8:mount.lustre.0 00010000:00080000:2.0:1783965021.826856:0:8738:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 49bbacc1-b013-4591-8d15-02f4f0d1884e@192.168.204.12@tcp t0 exp 0000000000000000 cur 256 last 0 00000020:00000080:2.0:1783965021.827096:0:8738:0:(genops.c:1406:class_connect()) connect: client 49bbacc1-b013-4591-8d15-02f4f0d1884e, cookie 0xe782b916994fd4ec 00002000:00100000:2.0:1783965021.827111:0:8738:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 49bbacc1-b013-4591-8d15-02f4f0d1884e/ffff947429f74000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1783965021.827139:0:8738:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:3.0:1783965021.828244:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 14 00002000:00080000:2.0:1783965021.828247:0:8738:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00100000:3.0:1783965021.828258:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94741cc30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2356:x1870622715031040:12345-192.168.204.12@tcp:8:mount.lustre.0 00010000:00080000:3.0:1783965021.828302:0:6606:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 49bbacc1-b013-4591-8d15-02f4f0d1884e@192.168.204.12@tcp t0 exp 0000000000000000 cur 256 last 0 00000100:00080000:2.0:1783965021.828308:0:8738:0:(import.c:65:import_set_state_nolock()) ffff947429f75800 : changing import state from RECOVER to FULL 00000020:00000080:3.0:1783965021.828343:0:6606:0:(genops.c:1406:class_connect()) connect: client 49bbacc1-b013-4591-8d15-02f4f0d1884e, cookie 0xe782b916994fd4f3 00002000:00100000:3.0:1783965021.828353:0:6606:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 49bbacc1-b013-4591-8d15-02f4f0d1884e/ffff947304972800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1783965021.828377:0:6606:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00000100:00100000:2.0:1783965021.828420:0:8738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743715d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:49bbacc1-b013-4591-8d15-02f4f0d1884e+6:2356:x1870622715030912:12345-192.168.204.12@tcp:8:mount.lustre.0 Request processed in 1610us (7934us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965021.828441:0:8738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 13 00002000:00080000:3.0:1783965021.828591:0:6606:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1783965021.828609:0:6606:0:(import.c:65:import_set_state_nolock()) ffff947304971000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783965021.828637:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94741cc30700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:49bbacc1-b013-4591-8d15-02f4f0d1884e+6:2356:x1870622715031040:12345-192.168.204.12@tcp:8:mount.lustre.0 Request processed in 381us (5660us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965021.828645:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 14 00000100:00100000:0.0:1783965021.830705:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965021.832105:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715031168 00000100:00100000:2.0:1783965021.832127:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715031168 00000100:00100000:2.0:1783965021.832254:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 1 00000100:00100000:2.0:1783965021.832267:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743715d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:49bbacc1-b013-4591-8d15-02f4f0d1884e+6:8105:x1870622715031168:12345-192.168.204.12@tcp:33:mount.lustre.0 00000004:00200000:2.0:1783965021.832705:0:5814:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:2.0:1783965021.832891:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743715d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:49bbacc1-b013-4591-8d15-02f4f0d1884e+6:8105:x1870622715031168:12345-192.168.204.12@tcp:33:mount.lustre.0 Request processed in 624us (2211us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965021.832900:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 1 00010000:00010000:2.0:1783965021.870920:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1783965022.318900:0:6637:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 49bbacc1-b013-4591-8d15-02f4f0d1884e 00010000:00010000:3.0:1783965022.896490:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1783965023.820548:0:7523:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 49bbacc1-b013-4591-8d15-02f4f0d1884e 00000001:00100000:0.0:1783965023.821719:0:5835:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 49bbacc1-b013-4591-8d15-02f4f0d1884e 00010000:00010000:0.0:1783965023.915535:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783965024.811959:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94742597aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ae0997f7-3a15-4fc6-865a-35b2f101956e:3323:1870622732888576:0@lo:400:kworker.0 00000100:00100000:0.0:1783965024.812031:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783965024.812165:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94742597b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3325:1870622732888832:0@lo:400:kworker.0 00000100:00100000:0.0:1783965024.812344:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947425979180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3323:1870622732889088:0@lo:400:kworker.0 00000100:00100000:2.0:1783965024.812394:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783965024.812433:0:3325:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1783965024.812440:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94742597a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3325:1870622732888704:0@lo:400:kworker.0 00000100:00100000:2.0:1783965024.812465:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783965024.812483:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94742597b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3325:1870622732889216:0@lo:400:kworker.0 00000100:00100000:2.0:1783965024.812509:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783965024.812540:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732888576 00000100:00100000:2.0:1783965024.812547:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732888576 00000100:00100000:2.0:1783965024.812589:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:2.0:1783965024.812598:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947408ec8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae0997f7-3a15-4fc6-865a-35b2f101956e+19:3323:x1870622732888576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783965024.812659:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947408ec8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae0997f7-3a15-4fc6-865a-35b2f101956e+19:3323:x1870622732888576:12345-0@lo:400:kworker.0 Request processed in 61us (627us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965024.812666:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:2.0:1783965024.812700:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732888832 00000100:00100000:2.0:1783965024.812704:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732888832 00000100:00100000:2.0:1783965024.812739:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732888704 00000100:00100000:2.0:1783965024.812742:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732888704 00000100:00100000:2.0:1783965024.812761:0:6632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1783965024.812905:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1783965024.812914:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947425978700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3325:x1870622732888704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783965024.812956:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947425978700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3325:x1870622732888704:12345-0@lo:400:kworker.0 Request processed in 45us (491us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965024.812963:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1783965024.813041:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947425979500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3322:1870622732888960:0@lo:400:kworker.0 00000100:00100000:3.0:1783965024.813072:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783965024.813144:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732889216 00000100:00100000:0.0:1783965024.813149:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732889216 00000100:00100000:0.0:1783965024.813183:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732888960 00000100:00100000:0.0:1783965024.813187:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732888960 00000100:00100000:0.0:1783965024.813246:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1783965024.813254:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94742597bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3325:x1870622732889216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783965024.813285:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94742597bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3325:x1870622732889216:12345-0@lo:400:kworker.0 Request processed in 33us (776us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965024.813291:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1783965024.813305:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1783965024.813311:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94741cc33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3322:x1870622732888960:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783965024.813342:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94741cc33b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3322:x1870622732888960:12345-0@lo:400:kworker.0 Request processed in 31us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965024.813348:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:0.0:1783965024.813379:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff947425979500 x1870622732888960/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783965040 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783965024.813393:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947425979500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3322:1870622732888960:0@lo:400:kworker.0 00000100:00100000:2.0:1783965024.813787:0:6632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947425979880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3325:x1870622732888832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783965024.813938:0:6632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947425979880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3325:x1870622732888832:12345-0@lo:400:kworker.0 Request processed in 1170us (1737us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965024.813945:0:6632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:2.0:1783965024.813969:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783965024.813973:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783965024.813976:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783965024.814003:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94742597a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3325:1870622732888704:0@lo:400:kworker.0 00010000:00080000:2.0:1783965024.814016:0:3325:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94742597b100 x1870622732889216/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783965040 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783965024.814027:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94742597b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3325:1870622732889216:0@lo:400:kworker.0 00000100:00100000:2.0:1783965024.814037:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94742597b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3325:1870622732888832:0@lo:400:kworker.0 00000100:00100000:2.0:1783965024.814062:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783965024.814098:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94742597aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ae0997f7-3a15-4fc6-865a-35b2f101956e:3323:1870622732888576:0@lo:400:kworker.0 00000100:00100000:0.0:1783965024.815160:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732889088 00000100:00100000:0.0:1783965024.815168:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732889088 00000100:00080000:1.0:1783965024.815232:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783965024.815253:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1783965024.815262:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94742597b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3323:x1870622732889088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783965024.815331:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94742597b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3323:x1870622732889088:12345-0@lo:400:kworker.0 Request processed in 71us (1269us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965024.815338:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1783965024.815377:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947425979180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3323:1870622732889088:0@lo:400:kworker.0 00000100:00100000:0.0:1783965024.815881:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9474072a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3325:1870622732889344:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783965024.815918:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783965024.816095:0:6610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732889344 00000100:00100000:2.0:1783965024.816101:0:6610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732889344 00000100:00100000:2.0:1783965024.816183:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1783965024.816192:0:6610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743715f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3325:x1870622732889344:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783965024.816373:0:6610:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783965024.816457:0:6610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743715f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3325:x1870622732889344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 266us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965024.816463:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:0.0:1783965024.816547:0:3325:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9474072a9880 x1870622732889344/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783965040 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783965024.816563:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9474072a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3325:1870622732889344:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1783965024.948742:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783965025.963619:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783965026.859385:0:3323:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783965026.859415:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947429f47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3323:1870622732889472:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783965026.859512:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783965026.859594:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732889472 00000100:00100000:1.0:1783965026.859605:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732889472 00000100:00100000:1.0:1783965026.859678:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1783965026.859699:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947429f45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3323:x1870622732889472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783965026.859746:0:6611:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783965026.859806:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947429f45500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3323:x1870622732889472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (295us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965026.859815:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:1.0:1783965026.859842:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1783965026.859879:0:3323:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff947429f47480 x1870622732889472/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783965042 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783965026.859903:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947429f47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3323:1870622732889472:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1783965026.990552:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1783965027.129494:0:10198:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg412-client.virtnet: executing check_config_client /mnt/lustre 00000100:00100000:2.0:1783965027.193087:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965027.193192:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965027.193253:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965027.193277:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965027.193288:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715031680 00000100:00100000:3.0:1783965027.193299:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715031680 00000100:00100000:3.0:1783965027.193360:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 33 00000100:00100000:3.0:1783965027.193371:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94742597b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:49bbacc1-b013-4591-8d15-02f4f0d1884e+5:2358:x1870622715031680:12345-192.168.204.12@tcp:400:kworker.0 00000100:00100000:2.0:1783965027.193385:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965027.193445:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94742597b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:49bbacc1-b013-4591-8d15-02f4f0d1884e+5:2358:x1870622715031680:12345-192.168.204.12@tcp:400:kworker.0 Request processed in 76us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965027.193454:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 33 00000100:00100000:3.0:1783965027.193470:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715031808 00000100:00100000:3.0:1783965027.193473:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715031808 00000100:00100000:3.0:1783965027.193499:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 34 00000100:00100000:3.0:1783965027.193506:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947425979c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:49bbacc1-b013-4591-8d15-02f4f0d1884e+5:2358:x1870622715031808:12345-192.168.204.12@tcp:400:kworker.0 00000100:00100000:3.0:1783965027.193555:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947425979c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:49bbacc1-b013-4591-8d15-02f4f0d1884e+5:2358:x1870622715031808:12345-192.168.204.12@tcp:400:kworker.0 Request processed in 38us (158us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965027.193910:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 34 00000100:00100000:0.0:1783965027.193931:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715031424 00000100:00100000:3.0:1783965027.193936:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715031296 00000100:00100000:0.0:1783965027.193937:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715031424 00000100:00100000:3.0:1783965027.193942:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715031296 00000100:00100000:3.0:1783965027.193982:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 220 00000100:00100000:0.0:1783965027.193988:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715031552 00000100:00100000:3.0:1783965027.193993:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947408ec9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+13:2358:x1870622715031296:12345-192.168.204.12@tcp:400:kworker.0 00000100:00100000:0.0:1783965027.193994:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715031552 00000100:00100000:0.0:1783965027.194029:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 65 00000100:00100000:3.0:1783965027.194031:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947408ec9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+13:2358:x1870622715031296:12345-192.168.204.12@tcp:400:kworker.0 Request processed in 40us (776us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965027.194043:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94742597aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9923189b-eb4a-470c-ab45-969435371000+6:2358:x1870622715031424:12345-192.168.204.12@tcp:400:kworker.0 00000100:00100000:3.0:1783965027.194055:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 220 00000100:00100000:0.0:1783965027.194080:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94742597aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9923189b-eb4a-470c-ab45-969435371000+6:2358:x1870622715031424:12345-192.168.204.12@tcp:400:kworker.0 Request processed in 42us (1002us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965027.194086:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 65 00000100:00100000:0.0:1783965027.194101:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 66 00000100:00080000:3.0:1783965027.194102:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783965027.194107:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94742597a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49bbacc1-b013-4591-8d15-02f4f0d1884e+5:2358:x1870622715031552:12345-192.168.204.12@tcp:400:kworker.0 00000100:00080000:3.0:1783965027.194109:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783965027.194112:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783965027.194138:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94742597a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49bbacc1-b013-4591-8d15-02f4f0d1884e+5:2358:x1870622715031552:12345-192.168.204.12@tcp:400:kworker.0 Request processed in 32us (861us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965027.194143:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 66 00010000:00010000:1.0:1783965028.014016:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783965029.036534:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783965029.933575:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783965029.933605:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9474072a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3322:1870622732889600:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783965029.933708:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783965029.933792:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732889600 00000100:00100000:3.0:1783965029.933801:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732889600 00000100:00100000:3.0:1783965029.933873:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1783965029.933885:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e439f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1870622732889600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783965029.933932:0:6611:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783965029.933985:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e439f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1870622732889600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 102us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965029.933993:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:3.0:1783965029.934017:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1783965029.934055:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9474072a9880 x1870622732889600/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783965045 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783965029.934098:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9474072a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3322:1870622732889600:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783965029.951013:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743715dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3323:1870622732890112:0@lo:400:kworker.0 00000100:00100000:0.0:1783965029.951141:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783965029.951235:0:3323:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783965029.951242:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743715fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3323:1870622732889984:0@lo:400:kworker.0 00000100:00100000:0.0:1783965029.951273:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783965029.951302:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732890112 00000100:00100000:0.0:1783965029.951309:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732890112 00000100:00100000:0.0:1783965029.951385:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1783965029.951397:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743715e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3323:x1870622732890112:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783965029.951471:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743715e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3323:x1870622732890112:12345-0@lo:400:kworker.0 Request processed in 76us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965029.951480:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1783965029.951511:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732889984 00000100:00100000:0.0:1783965029.951514:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732889984 00000100:00100000:0.0:1783965029.951544:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1783965029.951551:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743715ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3323:x1870622732889984:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783965029.951583:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743715ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3323:x1870622732889984:12345-0@lo:400:kworker.0 Request processed in 33us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965029.951590:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1783965029.951639:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743715fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3323:1870622732889984:0@lo:400:kworker.0 00000100:00100000:3.0:1783965029.953152:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743715c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3325:1870622732889856:0@lo:400:kworker.0 00000100:00100000:3.0:1783965029.953261:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783965029.953315:0:3325:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1783965029.953324:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743715d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ae0997f7-3a15-4fc6-865a-35b2f101956e:3325:1870622732889728:0@lo:400:kworker.0 00000100:00100000:3.0:1783965029.953360:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783965029.953408:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743715ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3325:1870622732890240:0@lo:400:kworker.0 00000100:00100000:3.0:1783965029.953434:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783965029.953471:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732889728 00000100:00100000:3.0:1783965029.953478:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732889728 00000100:00100000:3.0:1783965029.953526:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1783965029.953781:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947408eca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+19:3325:x1870622732889728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783965029.953852:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947408eca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+19:3325:x1870622732889728:12345-0@lo:400:kworker.0 Request processed in 317us (491us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965029.953860:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1783965029.953924:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743715d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ae0997f7-3a15-4fc6-865a-35b2f101956e:3325:1870622732889728:0@lo:400:kworker.0 00010000:00080000:0.0:1783965029.959987:0:3323:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94743715dc00 x1870622732890112/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783965045 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783965029.960050:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743715dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3323:1870622732890112:0@lo:400:kworker.0 00000100:00100000:0.0:1783965029.960145:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732889856 00000100:00100000:0.0:1783965029.960156:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732889856 00000100:00100000:0.0:1783965029.960263:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732890240 00000100:00100000:0.0:1783965029.960266:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732890240 00000100:00100000:0.0:1783965029.960302:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1783965029.960312:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e439500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3325:x1870622732889856:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783965029.960442:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e439500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3325:x1870622732889856:12345-0@lo:400:kworker.0 Request processed in 131us (7181us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965029.960452:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1783965029.960474:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1783965029.960481:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e438380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3325:x1870622732890240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783965029.960513:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e438380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3325:x1870622732890240:12345-0@lo:400:kworker.0 Request processed in 33us (7078us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965029.960519:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:0.0:1783965029.960543:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1783965029.960550:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783965029.960593:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743715ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3325:1870622732890240:0@lo:400:kworker.0 00000100:00100000:0.0:1783965029.960608:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743715c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3325:1870622732889856:0@lo:400:kworker.0 00010000:00010000:1.0:1783965030.059650:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783965031.085256:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783965031.988254:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743715c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3325:1870622732890368:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783965031.988365:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783965031.988476:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732890368 00000100:00100000:2.0:1783965031.988487:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732890368 00000100:00100000:2.0:1783965031.988585:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1783965031.988606:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947429f45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3325:x1870622732890368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783965031.988655:0:6611:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783965031.988718:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947429f45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3325:x1870622732890368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 121us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965031.988726:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:2.0:1783965031.988777:0:3325:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94743715c700 x1870622732890368/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783965047 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783965031.988800:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743715c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3325:1870622732890368:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1783965031.989248:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1783965032.125472:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783965032.311976:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783965032.312027:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783965032.312067:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783965032.312113:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965032.312249:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715031936 00000100:00100000:2.0:1783965032.312265:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715031936 00000100:00100000:2.0:1783965032.312337:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 222 00000100:00100000:2.0:1783965032.312351:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947408ec8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+13:2358:x1870622715031936:12345-192.168.204.12@tcp:400:kworker.0 00000100:00100000:2.0:1783965032.312464:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947408ec8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+13:2358:x1870622715031936:12345-192.168.204.12@tcp:400:kworker.0 Request processed in 117us (506us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965032.312478:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 222 00000100:00100000:0.0:1783965032.313325:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783965032.313364:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715032320 00000100:00100000:0.0:1783965032.313371:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715032320 00000100:00100000:0.0:1783965032.313427:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715032448 00000100:00100000:0.0:1783965032.313431:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715032448 00000100:00100000:0.0:1783965032.313458:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 36 00000100:00100000:0.0:1783965032.313468:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743715dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:49bbacc1-b013-4591-8d15-02f4f0d1884e+5:2357:x1870622715032320:12345-192.168.204.12@tcp:400:kworker.0 00000100:00100000:0.0:1783965032.313545:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743715dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:49bbacc1-b013-4591-8d15-02f4f0d1884e+5:2357:x1870622715032320:12345-192.168.204.12@tcp:400:kworker.0 Request processed in 79us (1477us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965032.313553:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 36 00000100:00100000:0.0:1783965032.313573:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 37 00000100:00100000:0.0:1783965032.313581:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743715c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:49bbacc1-b013-4591-8d15-02f4f0d1884e+5:2357:x1870622715032448:12345-192.168.204.12@tcp:400:kworker.0 00000100:00100000:0.0:1783965032.314199:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743715c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:49bbacc1-b013-4591-8d15-02f4f0d1884e+5:2357:x1870622715032448:12345-192.168.204.12@tcp:400:kworker.0 Request processed in 543us (803us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965032.314233:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 37 00000100:00080000:0.0:1783965032.314265:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783965032.314270:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783965032.314561:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715032064 00000100:00100000:2.0:1783965032.314568:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715032064 00000100:00100000:2.0:1783965032.314617:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715032192 00000100:00100000:2.0:1783965032.314621:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715032192 00000100:00100000:2.0:1783965032.314652:0:6632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 70 00000100:00100000:2.0:1783965032.314660:0:6632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743715ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9923189b-eb4a-470c-ab45-969435371000+6:2358:x1870622715032064:12345-192.168.204.12@tcp:400:kworker.0 00000100:00100000:2.0:1783965032.314701:0:6632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743715ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9923189b-eb4a-470c-ab45-969435371000+6:2358:x1870622715032064:12345-192.168.204.12@tcp:400:kworker.0 Request processed in 42us (2674us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965032.314708:0:6632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 70 00000100:00100000:2.0:1783965032.314722:0:6632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 71 00000100:00100000:2.0:1783965032.314729:0:6632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743715fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49bbacc1-b013-4591-8d15-02f4f0d1884e+5:2357:x1870622715032192:12345-192.168.204.12@tcp:400:kworker.0 00000100:00100000:2.0:1783965032.314753:0:6632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743715fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49bbacc1-b013-4591-8d15-02f4f0d1884e+5:2357:x1870622715032192:12345-192.168.204.12@tcp:400:kworker.0 Request processed in 24us (2640us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965032.314760:0:6632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 71 00000100:00080000:3.0:1783965032.315248:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1783965033.136531:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783965034.156902:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783965035.051493:0:3323:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783965035.061683:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9474072a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3323:1870622732890496:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783965035.061767:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783965035.062189:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947407295880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3322:1870622732891008:0@lo:400:kworker.0 00000100:00100000:2.0:1783965035.062239:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783965035.062260:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1783965035.062266:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947425979180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ae0997f7-3a15-4fc6-865a-35b2f101956e:3322:1870622732890624:0@lo:400:kworker.0 00000100:00100000:2.0:1783965035.062291:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783965035.062311:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947407295c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3322:1870622732891136:0@lo:400:kworker.0 00000100:00100000:2.0:1783965035.062333:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783965035.062357:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947425979500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3324:1870622732890752:0@lo:400:kworker.0 00000100:00100000:2.0:1783965035.062380:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783965035.062410:0:3324:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783965035.062416:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947407294a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3324:1870622732890880:0@lo:400:kworker.0 00000100:00100000:2.0:1783965035.062449:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783965035.062484:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732891136 00000100:00100000:2.0:1783965035.062491:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732891136 00000100:00100000:2.0:1783965035.062538:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732890752 00000100:00100000:2.0:1783965035.062542:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732890752 00000100:00100000:2.0:1783965035.062554:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732890880 00000100:00100000:2.0:1783965035.062556:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732890880 00000100:00100000:2.0:1783965035.062574:0:6632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1783965035.062583:0:6632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947407297b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3322:x1870622732891136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783965035.062635:0:6632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947407297b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3322:x1870622732891136:12345-0@lo:400:kworker.0 Request processed in 54us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965035.062642:0:6632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1783965035.062659:0:6632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1783965035.062664:0:6632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947407294700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3324:x1870622732890752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783965035.062693:0:6632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947407294700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3324:x1870622732890752:12345-0@lo:400:kworker.0 Request processed in 29us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965035.062699:0:6632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1783965035.062710:0:6632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1783965035.062716:0:6632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9474057dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3324:x1870622732890880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783965035.062741:0:6632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9474057dad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3324:x1870622732890880:12345-0@lo:400:kworker.0 Request processed in 25us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965035.062746:0:6632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1783965035.062793:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947407294a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3324:1870622732890880:0@lo:400:kworker.0 00000100:00100000:2.0:1783965035.062802:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947425979500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3324:1870622732890752:0@lo:400:kworker.0 00000100:00100000:2.0:1783965035.062840:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947407295c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3322:1870622732891136:0@lo:400:kworker.0 00000100:00100000:3.0:1783965035.065301:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732890624 00000100:00100000:3.0:1783965035.065317:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732890624 00000100:00100000:3.0:1783965035.065380:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:3.0:1783965035.065390:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947408ec8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae0997f7-3a15-4fc6-865a-35b2f101956e+19:3322:x1870622732890624:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783965035.065489:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947408ec8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae0997f7-3a15-4fc6-865a-35b2f101956e+19:3322:x1870622732890624:12345-0@lo:400:kworker.0 Request processed in 101us (3196us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965035.065497:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00080000:3.0:1783965035.065547:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783965035.065586:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947425979180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ae0997f7-3a15-4fc6-865a-35b2f101956e:3322:1870622732890624:0@lo:400:kworker.0 00000100:00100000:0.0:1783965035.065748:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732890496 00000100:00100000:0.0:1783965035.065754:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732890496 00000100:00100000:0.0:1783965035.065792:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1783965035.065799:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947429f47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3323:x1870622732890496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783965035.065828:0:6611:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783965035.065869:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947429f47100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3323:x1870622732890496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 72us (4104us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965035.065875:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1783965035.065904:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732891008 00000100:00100000:0.0:1783965035.065908:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732891008 00000100:00100000:0.0:1783965035.065937:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1783965035.065943:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947407296300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3322:x1870622732891008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783965035.065976:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947407296300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3322:x1870622732891008:12345-0@lo:400:kworker.0 Request processed in 34us (3737us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965035.065982:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:0.0:1783965035.066010:0:3323:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9474072a9880 x1870622732890496/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783965051 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783965035.066037:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9474072a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3323:1870622732890496:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1783965035.066508:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783965035.066514:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1783965035.066539:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff947407295880 x1870622732891008/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783965051 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783965035.066550:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947407295880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3322:1870622732891008:0@lo:400:kworker.0 00010000:00010000:0.0:1783965035.179394:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783965036.207923:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783965037.100522:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743715df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3324:1870622732891264:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783965037.100600:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783965037.100856:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732891264 00000100:00100000:0.0:1783965037.100882:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732891264 00000100:00080000:3.0:1783965037.100949:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783965037.100960:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1783965037.100973:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9474057d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3324:x1870622732891264:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783965037.101020:0:6611:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783965037.101083:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9474057d8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3324:x1870622732891264:12345-0@lo:13:osp-pre-0-0.0 Request processed in 112us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965037.101091:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:2.0:1783965037.101261:0:3324:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94743715df80 x1870622732891264/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783965053 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783965037.101281:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743715df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3324:1870622732891264:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1783965037.231074:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783965037.438800:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783965037.438839:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783965037.438864:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783965037.438883:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783965037.438909:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783965037.439544:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715032576 00000100:00100000:0.0:1783965037.439565:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715032576 00000100:00100000:0.0:1783965037.440151:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 224 00000100:00100000:0.0:1783965037.440161:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947408ecac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+13:2359:x1870622715032576:12345-192.168.204.12@tcp:400:kworker.0 00000100:00100000:0.0:1783965037.440269:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947408ecac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+13:2359:x1870622715032576:12345-192.168.204.12@tcp:400:kworker.0 Request processed in 109us (1477us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965037.440278:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 224 00000100:00100000:0.0:1783965037.440316:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715032832 00000100:00100000:0.0:1783965037.440320:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715032832 00000100:00100000:0.0:1783965037.440355:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715032704 00000100:00100000:0.0:1783965037.440359:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715032704 00000100:00100000:0.0:1783965037.440381:0:6632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 75 00000100:00100000:0.0:1783965037.440388:0:6632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743715df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49bbacc1-b013-4591-8d15-02f4f0d1884e+5:2359:x1870622715032832:12345-192.168.204.12@tcp:400:kworker.0 00000100:00100000:1.0:1783965037.442174:0:8738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715033088 00000100:00100000:1.0:1783965037.442188:0:8738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715033088 00000100:00100000:1.0:1783965037.442251:0:8738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715032960 00000100:00100000:1.0:1783965037.442255:0:8738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715032960 00000100:00100000:1.0:1783965037.442284:0:8738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 39 00000100:00100000:1.0:1783965037.442293:0:8738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743715c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:49bbacc1-b013-4591-8d15-02f4f0d1884e+5:2359:x1870622715033088:12345-192.168.204.12@tcp:400:kworker.0 00000100:00100000:1.0:1783965037.442357:0:8738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743715c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:49bbacc1-b013-4591-8d15-02f4f0d1884e+5:2359:x1870622715033088:12345-192.168.204.12@tcp:400:kworker.0 Request processed in 65us (3492us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965037.442366:0:8738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 39 00000100:00100000:1.0:1783965037.442383:0:8738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 40 00000100:00100000:1.0:1783965037.442388:0:8738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94741cccc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:49bbacc1-b013-4591-8d15-02f4f0d1884e+5:2359:x1870622715032960:12345-192.168.204.12@tcp:400:kworker.0 00000100:00100000:0.0:1783965037.442524:0:6632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743715df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49bbacc1-b013-4591-8d15-02f4f0d1884e+5:2359:x1870622715032832:12345-192.168.204.12@tcp:400:kworker.0 Request processed in 2136us (3684us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965037.442532:0:6632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 75 00000100:00100000:0.0:1783965037.442549:0:6632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 76 00000100:00100000:0.0:1783965037.442557:0:6632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743715d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9923189b-eb4a-470c-ab45-969435371000+6:2359:x1870622715032704:12345-192.168.204.12@tcp:400:kworker.0 00000100:00100000:1.0:1783965037.442683:0:8738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94741cccc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:49bbacc1-b013-4591-8d15-02f4f0d1884e+5:2359:x1870622715032960:12345-192.168.204.12@tcp:400:kworker.0 Request processed in 293us (3771us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965037.442690:0:8738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 40 00000100:00100000:0.0:1783965037.443514:0:6632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743715d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9923189b-eb4a-470c-ab45-969435371000+6:2359:x1870622715032704:12345-192.168.204.12@tcp:400:kworker.0 Request processed in 954us (4626us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965037.443523:0:6632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 76 00000100:00080000:0.0:1783965037.444436:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1783965037.444442:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783965037.444446:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1783965038.257640:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783965039.275479:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783965040.172437:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9474057da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3324:1870622732891776:0@lo:400:kworker.0 00000100:00100000:2.0:1783965040.172530:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783965040.172606:0:3324:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1783965040.172613:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9474057d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ae0997f7-3a15-4fc6-865a-35b2f101956e:3324:1870622732891392:0@lo:400:kworker.0 00000100:00100000:2.0:1783965040.172646:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783965040.172672:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9474057d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3324:1870622732891904:0@lo:400:kworker.0 00000100:00100000:2.0:1783965040.172699:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783965040.172730:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9474057d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3323:1870622732891648:0@lo:400:kworker.0 00000100:00100000:2.0:1783965040.172756:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783965040.172776:0:3323:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1783965040.172781:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9474057d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3323:1870622732891520:0@lo:400:kworker.0 00000100:00100000:2.0:1783965040.172804:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783965040.172823:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9474057db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3323:1870622732892032:0@lo:400:kworker.0 00000100:00100000:2.0:1783965040.172844:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783965040.172877:0:8738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732891776 00000100:00100000:2.0:1783965040.172887:0:8738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732891776 00000100:00100000:2.0:1783965040.172963:0:8738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732892032 00000100:00100000:2.0:1783965040.172967:0:8738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732892032 00000100:00100000:2.0:1783965040.173018:0:8738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1783965040.173029:0:8738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9474057daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3324:x1870622732891776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783965040.173092:0:8738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9474057daa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3324:x1870622732891776:12345-0@lo:400:kworker.0 Request processed in 65us (562us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965040.173100:0:8738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1783965040.173119:0:8738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1783965040.173125:0:8738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9474057d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3323:x1870622732892032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783965040.173155:0:8738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9474057d9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3323:x1870622732892032:12345-0@lo:400:kworker.0 Request processed in 30us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965040.173161:0:8738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1783965040.173181:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732891392 00000100:00100000:2.0:1783965040.173184:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732891392 00000100:00100000:2.0:1783965040.173240:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1783965040.173247:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947408ec9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae0997f7-3a15-4fc6-865a-35b2f101956e+19:3324:x1870622732891392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783965040.173278:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947408ec9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae0997f7-3a15-4fc6-865a-35b2f101956e+19:3324:x1870622732891392:12345-0@lo:400:kworker.0 Request processed in 32us (632us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965040.173284:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1783965040.173316:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732891904 00000100:00100000:2.0:1783965040.173320:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732891904 00000100:00100000:2.0:1783965040.173347:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732891648 00000100:00100000:2.0:1783965040.173350:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732891648 00000100:00100000:2.0:1783965040.173362:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732891520 00000100:00100000:2.0:1783965040.173364:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732891520 00000100:00100000:2.0:1783965040.173380:0:6632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1783965040.173387:0:6632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9474057da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3324:x1870622732891904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783965040.173417:0:6632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9474057da300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3324:x1870622732891904:12345-0@lo:400:kworker.0 Request processed in 31us (718us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965040.173433:0:6632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1783965040.173447:0:6632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1783965040.173452:0:6632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9474057db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3323:x1870622732891648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783965040.173606:0:6632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9474057db480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3323:x1870622732891648:12345-0@lo:400:kworker.0 Request processed in 154us (849us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965040.173613:0:6632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1783965040.173625:0:6632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1783965040.173631:0:6632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9474057d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3323:x1870622732891520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783965040.173658:0:6632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9474057d9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3323:x1870622732891520:12345-0@lo:400:kworker.0 Request processed in 28us (853us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965040.173664:0:6632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:2.0:1783965040.173695:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783965040.173700:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783965040.173702:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783965040.173753:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9474057d9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3323:1870622732891520:0@lo:400:kworker.0 00010000:00080000:2.0:1783965040.173769:0:3323:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9474057db800 x1870622732892032/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783965056 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783965040.173781:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9474057db800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3323:1870622732892032:0@lo:400:kworker.0 00000100:00100000:2.0:1783965040.173789:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9474057d8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3323:1870622732891648:0@lo:400:kworker.0 00000100:00100000:2.0:1783965040.178254:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9474057d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ae0997f7-3a15-4fc6-865a-35b2f101956e:3324:1870622732891392:0@lo:400:kworker.0 00000100:00100000:2.0:1783965040.178285:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9474057d8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3324:1870622732891904:0@lo:400:kworker.0 00010000:00080000:2.0:1783965040.178513:0:3324:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9474057da680 x1870622732891776/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783965056 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783965040.178557:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9474057da680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3324:1870622732891776:0@lo:400:kworker.0 00000100:00100000:3.0:1783965040.179748:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783965040.179770:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9474072a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3322:1870622732892160:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783965040.179850:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783965040.179906:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732892160 00000100:00100000:3.0:1783965040.179913:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732892160 00000100:00100000:3.0:1783965040.179988:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1783965040.180001:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9474072ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1870622732892160:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783965040.180044:0:6611:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783965040.180088:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9474072ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1870622732892160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965040.180096:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:3.0:1783965040.180137:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9474072a9500 x1870622732892160/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783965056 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783965040.180154:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9474072a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3322:1870622732892160:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1783965040.300752:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783965041.326775:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783965042.219596:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9474072a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3324:1870622732892288:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783965042.219670:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783965042.221175:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732892288 00000100:00100000:3.0:1783965042.221187:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732892288 00000100:00100000:3.0:1783965042.221296:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1783965042.221307:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9474072a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3324:x1870622732892288:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783965042.221347:0:6611:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783965042.221415:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9474072a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3324:x1870622732892288:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (1744us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965042.221422:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:3.0:1783965042.221443:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1783965042.221477:0:3324:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9474072a9500 x1870622732892288/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783965058 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783965042.221499:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9474072a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3324:1870622732892288:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1783965042.349663:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783965042.560733:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965042.560797:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965042.560834:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965042.560861:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965042.560962:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965042.560999:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715033344 00000100:00100000:2.0:1783965042.561010:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715033344 00000100:00100000:2.0:1783965042.561068:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715033472 00000100:00100000:2.0:1783965042.561072:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715033472 00000100:00100000:2.0:1783965042.561096:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 80 00000100:00100000:2.0:1783965042.561105:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9474057da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9923189b-eb4a-470c-ab45-969435371000+6:2358:x1870622715033344:12345-192.168.204.12@tcp:400:kworker.0 00000100:00100000:2.0:1783965042.561191:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9474057da680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9923189b-eb4a-470c-ab45-969435371000+6:2358:x1870622715033344:12345-192.168.204.12@tcp:400:kworker.0 Request processed in 87us (468us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965042.561238:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 80 00000100:00100000:2.0:1783965042.561256:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 81 00000100:00100000:2.0:1783965042.561264:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9474057d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49bbacc1-b013-4591-8d15-02f4f0d1884e+5:2358:x1870622715033472:12345-192.168.204.12@tcp:400:kworker.0 00000100:00100000:2.0:1783965042.561291:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9474057d8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49bbacc1-b013-4591-8d15-02f4f0d1884e+5:2358:x1870622715033472:12345-192.168.204.12@tcp:400:kworker.0 Request processed in 28us (456us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965042.561297:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 81 00000100:00100000:2.0:1783965042.561316:0:8738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715033600 00000100:00100000:2.0:1783965042.561320:0:8738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715033600 00000100:00100000:2.0:1783965042.561344:0:8738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715033728 00000100:00100000:2.0:1783965042.561347:0:8738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715033728 00000100:00100000:2.0:1783965042.561369:0:8738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 15 00000100:00100000:2.0:1783965042.561375:0:8738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9474057d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:49bbacc1-b013-4591-8d15-02f4f0d1884e+5:2356:x1870622715033600:12345-192.168.204.12@tcp:9:kworker.0 00000020:00000080:2.0:1783965042.561404:0:8738:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe782b916994fd4ec 00000100:00080000:2.0:1783965042.561423:0:8738:0:(import.c:65:import_set_state_nolock()) ffff947429f75800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1783965042.561462:0:8738:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1783965042.561798:0:8738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9474057d8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:49bbacc1-b013-4591-8d15-02f4f0d1884e+2:2356:x1870622715033600:12345-192.168.204.12@tcp:9:kworker.0 Request processed in 422us (934us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965042.561806:0:8738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 15 00000100:00100000:2.0:1783965042.561823:0:8738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 16 00000100:00100000:2.0:1783965042.561830:0:8738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9474057d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:49bbacc1-b013-4591-8d15-02f4f0d1884e+5:2356:x1870622715033728:12345-192.168.204.12@tcp:9:kworker.0 00000020:00000080:2.0:1783965042.561842:0:8738:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe782b916994fd4f3 00000100:00080000:2.0:1783965042.561847:0:8738:0:(import.c:65:import_set_state_nolock()) ffff947304971000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1783965042.561868:0:8738:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1783965042.562072:0:8738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9474057d8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:49bbacc1-b013-4591-8d15-02f4f0d1884e+2:2356:x1870622715033728:12345-192.168.204.12@tcp:9:kworker.0 Request processed in 242us (1108us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965042.562079:0:8738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 16 00010000:00010000:2.0:1783965042.562112:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783965042.562654:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715033216 00000100:00100000:1.0:1783965042.562661:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715033216 00000100:00100000:1.0:1783965042.562692:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 226 00000100:00100000:1.0:1783965042.562699:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947408ecbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+13:2358:x1870622715033216:12345-192.168.204.12@tcp:400:kworker.0 00000100:00100000:1.0:1783965042.562738:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947408ecbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+13:2358:x1870622715033216:12345-192.168.204.12@tcp:400:kworker.0 Request processed in 39us (1940us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965042.562745:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 226 00010000:00010000:1.0:1783965042.562771:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1783965042.562981:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783965042.562986:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783965042.562989:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00100000:0.0:1783965042.779908:0:6637:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 49bbacc1-b013-4591-8d15-02f4f0d1884e 00000020:00000080:0.0:1783965042.779931:0:6637:0:(genops.c:906:class_export_put()) final put ffff947429f74000/49bbacc1-b013-4591-8d15-02f4f0d1884e 00000020:00000080:3.0:1783965042.780028:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff947429f74000/49bbacc1-b013-4591-8d15-02f4f0d1884e for lustre-OST0000 00000020:00000080:3.0:1783965042.780169:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff947429f75800 for lustre-OST0000 00010000:00010000:2.0:1783965043.371528:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1783965044.324550:0:7523:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 49bbacc1-b013-4591-8d15-02f4f0d1884e 00000020:00000080:1.0:1783965044.324564:0:7523:0:(genops.c:906:class_export_put()) final put ffff947304972800/49bbacc1-b013-4591-8d15-02f4f0d1884e 00000020:00000080:0.0:1783965044.324638:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff947304972800/49bbacc1-b013-4591-8d15-02f4f0d1884e for lustre-OST0001 00000020:00000080:0.0:1783965044.324715:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff947304971000 for lustre-OST0001 00010000:00010000:1.0:1783965044.401611:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1783965044.744118:0:10900:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:1.0:1783965045.291483:0:3324:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783965045.291506:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947429f47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3324:1870622732892416:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783965045.291577:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783965045.291643:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732892416 00000100:00100000:1.0:1783965045.291651:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732892416 00000100:00100000:1.0:1783965045.291705:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1783965045.291715:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947429f45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3324:x1870622732892416:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783965045.291752:0:6611:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783965045.291797:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947429f45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3324:x1870622732892416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965045.291815:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:1.0:1783965045.291849:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1783965045.291881:0:3324:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff947429f47800 x1870622732892416/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783965061 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783965045.291899:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947429f47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3324:1870622732892416:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783965045.292487:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947429f44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3323:1870622732892672:0@lo:400:kworker.0 00000100:00100000:1.0:1783965045.292525:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783965045.292551:0:3323:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1783965045.292556:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947429f47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ae0997f7-3a15-4fc6-865a-35b2f101956e:3323:1870622732892544:0@lo:400:kworker.0 00000100:00100000:1.0:1783965045.292590:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783965045.292615:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947429f46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3323:1870622732893056:0@lo:400:kworker.0 00000100:00100000:1.0:1783965045.292638:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783965045.292665:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732892672 00000100:00100000:1.0:1783965045.292669:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732892672 00000100:00100000:1.0:1783965045.292696:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732893056 00000100:00100000:1.0:1783965045.292699:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732893056 00000100:00100000:1.0:1783965045.292727:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1783965045.292734:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947429f44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3323:x1870622732892672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783965045.292776:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947429f44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3323:x1870622732892672:12345-0@lo:400:kworker.0 Request processed in 43us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965045.292783:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1783965045.292796:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1783965045.292803:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947429f44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3323:x1870622732893056:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783965045.292844:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947429f44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3323:x1870622732893056:12345-0@lo:400:kworker.0 Request processed in 41us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965045.292861:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1783965045.292883:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732892544 00000100:00100000:1.0:1783965045.292886:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732892544 00000100:00100000:2.0:1783965045.292906:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947429f45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3325:1870622732892928:0@lo:400:kworker.0 00000100:00100000:1.0:1783965045.292913:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:1.0:1783965045.292921:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947408ec9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+19:3323:x1870622732892544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783965045.292960:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783965045.292966:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947408ec9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+19:3323:x1870622732892544:12345-0@lo:400:kworker.0 Request processed in 43us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965045.292973:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1783965045.292994:0:3325:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783965045.293004:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947429f47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3325:1870622732892800:0@lo:400:kworker.0 00000100:00080000:1.0:1783965045.293009:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783965045.293035:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947429f47800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ae0997f7-3a15-4fc6-865a-35b2f101956e:3323:1870622732892544:0@lo:400:kworker.0 00000100:00100000:2.0:1783965045.293040:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783965045.293054:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947429f46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3323:1870622732893056:0@lo:400:kworker.0 00000100:00100000:1.0:1783965045.293070:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947429f44700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3323:1870622732892672:0@lo:400:kworker.0 00000100:00100000:0.0:1783965045.293073:0:8738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732892928 00000100:00100000:0.0:1783965045.293080:0:8738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732892928 00000100:00100000:2.0:1783965045.293082:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732892800 00000100:00100000:2.0:1783965045.293088:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732892800 00000100:00080000:1.0:1783965045.293103:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783965045.293108:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783965045.293134:0:8738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1783965045.293142:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1783965045.293146:0:8738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9474057db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3325:x1870622732892928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783965045.293154:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9474057d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3325:x1870622732892800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783965045.293231:0:8738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9474057db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3325:x1870622732892928:12345-0@lo:400:kworker.0 Request processed in 59us (242us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965045.293240:0:8738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1783965045.293260:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9474057d9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3325:x1870622732892800:12345-0@lo:400:kworker.0 Request processed in 106us (221us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965045.297462:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1783965045.297562:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947429f47b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3325:1870622732892800:0@lo:400:kworker.0 00010000:00080000:2.0:1783965045.297580:0:3325:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff947429f45c00 x1870622732892928/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783965061 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783965045.297591:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947429f45c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3325:1870622732892928:0@lo:400:kworker.0 00010000:00010000:0.0:1783965045.420376:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783965046.443423:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783965047.339974:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9474072a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3323:1870622732893184:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783965047.340096:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783965047.340492:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732893184 00000100:00100000:3.0:1783965047.340503:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732893184 00000100:00100000:3.0:1783965047.340590:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1783965047.340601:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947429f44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3323:x1870622732893184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783965047.340651:0:6611:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783965047.340718:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947429f44700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3323:x1870622732893184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 118us (622us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965047.340726:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:3.0:1783965047.340795:0:3323:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9474072a9500 x1870622732893184/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783965063 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783965047.340822:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9474072a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3323:1870622732893184:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1783965047.342118:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1783965047.471865:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783965047.672678:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965047.672726:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965047.672746:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965047.672826:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715033984 00000100:00100000:2.0:1783965047.672836:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715033984 00000100:00100000:2.0:1783965047.672907:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715034112 00000100:00100000:2.0:1783965047.672911:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715034112 00000100:00100000:2.0:1783965047.672936:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 85 00000100:00100000:2.0:1783965047.672946:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9474072a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9923189b-eb4a-470c-ab45-969435371000+6:2357:x1870622715033984:12345-192.168.204.12@tcp:400:kworker.0 00000100:00100000:2.0:1783965047.673030:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9474072a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9923189b-eb4a-470c-ab45-969435371000+6:2357:x1870622715033984:12345-192.168.204.12@tcp:400:kworker.0 Request processed in 85us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965047.673037:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 85 00000100:00100000:2.0:1783965047.673055:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 86 00000100:00100000:2.0:1783965047.673061:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9474072ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49bbacc1-b013-4591-8d15-02f4f0d1884e+5:2357:x1870622715034112:12345-192.168.204.12@tcp:400:kworker.0 00000100:00100000:2.0:1783965047.673086:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9474072ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49bbacc1-b013-4591-8d15-02f4f0d1884e+5:2357:x1870622715034112:12345-192.168.204.12@tcp:400:kworker.0 Request processed in 24us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965047.673092:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 86 00000100:00100000:2.0:1783965047.673110:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715033856 00000100:00100000:2.0:1783965047.673114:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715033856 00000100:00100000:2.0:1783965047.673137:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 228 00000100:00100000:2.0:1783965047.673143:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947408ecb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+13:2357:x1870622715033856:12345-192.168.204.12@tcp:400:kworker.0 00000100:00100000:2.0:1783965047.673167:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947408ecb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+13:2357:x1870622715033856:12345-192.168.204.12@tcp:400:kworker.0 Request processed in 24us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965047.673184:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 228 00000100:00080000:3.0:1783965047.673409:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00000080:1.0:1783965048.049684:0:11048:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffde6f2b4d0 20000000:00000080:1.0:1783965048.049706:0:11048:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff947405e1e800 uarg=0000000000000000 20000000:01000000:1.0:1783965048.049747:0:11048:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1783965048.049753:0:11048:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1783965048.049759:0:11048:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1783965048.050742:0:11049:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:1.0:1783965048.050935:0:11048:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1783965048.060375:0:11048:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1783965048.060412:0:11048:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff94743d9ee200/0xe782b916994fd4fa lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965048.060451:0:11048:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff947436f26800/0xe782b916994fd4a6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe782b916994fd49f expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965048.060459:0:11048:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff947400030000/0xe782b916994fd4b4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe782b916994fd4ad expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965048.060466:0:11048:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94743d9ef800/0xe782b916994fd4c2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe782b916994fd4bb expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965048.060477:0:11048:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff947400030200/0xe782b916994fd4c9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5efe8a expref: 12 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965048.060486:0:11048:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff947400030c00/0xe782b916994fd4de lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5efec2 expref: 12 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965048.060493:0:11048:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff94743d9ee200/0xe782b916994fd4fa lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965048.060565:0:11048:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff947400030c00/0xe782b916994fd4de lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5efec2 expref: 12 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965048.060581:0:11048:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff947400030c00/0xe782b916994fd4de lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5efec2 expref: 12 pid: 5805 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783965048.060598:0:11048:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947429f46d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11048:1870622732893312:192.168.204.12@tcp:104: 00010000:00010000:1.0:1783965048.060725:0:11048:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff947400030200/0xe782b916994fd4c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5efe8a expref: 12 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965048.060735:0:11048:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff947400030200/0xe782b916994fd4c9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5efe8a expref: 12 pid: 5806 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783965048.060749:0:11048:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947429f47800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11048:1870622732893440:192.168.204.12@tcp:104: 00010000:00010000:1.0:1783965048.060800:0:11048:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94743d9ef800/0xe782b916994fd4c2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe782b916994fd4bb expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965048.060810:0:11048:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff94743d9ef800/0xe782b916994fd4c2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe782b916994fd4bb expref: 18 pid: 5805 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783965048.060819:0:11048:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947429f45f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11048:1870622732893568:0@lo:104: 00000100:00100000:1.0:1783965048.060865:0:11048:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783965048.060901:0:11048:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff947400030000/0xe782b916994fd4b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe782b916994fd4ad expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965048.060909:0:11048:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff947400030000/0xe782b916994fd4b4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe782b916994fd4ad expref: 18 pid: 5805 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783965048.060917:0:11048:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947429f46680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11048:1870622732893696:0@lo:104: 00000100:00100000:1.0:1783965048.060938:0:11048:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1783965048.060967:0:11048:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff947436f26800/0xe782b916994fd4a6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe782b916994fd49f expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965048.060975:0:11048:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff947436f26800/0xe782b916994fd4a6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe782b916994fd49f expref: 18 pid: 5805 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783965048.060983:0:11048:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947429f47b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11048:1870622732893824:0@lo:104: 00000100:00100000:1.0:1783965048.061003:0:11048:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783965048.061018:0:11048:0:(client.c:2702:ptlrpc_set_wait()) set ffff94743fac9f00 going to sleep for 11 seconds 00000100:00100000:3.0:1783965048.061121:0:8328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732893568 00000100:00100000:3.0:1783965048.061130:0:8328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732893568 00000100:00100000:3.0:1783965048.061183:0:8328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732893696 00000100:00100000:3.0:1783965048.061186:0:8328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732893696 00000100:00100000:3.0:1783965048.061197:0:8328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732893824 00000100:00100000:3.0:1783965048.061224:0:8328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732893824 00000100:00100000:3.0:1783965048.061242:0:8328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1783965048.061250:0:8328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947429f44380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ae0997f7-3a15-4fc6-865a-35b2f101956e+5:11048:x1870622732893568:12345-0@lo:104: 00010000:00010000:3.0:1783965048.061266:0:8328:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.112@tcp lock: ffff947425974a00/0xe782b916994fd4bb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe782b916994fd4c2 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965048.061324:0:8328:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1783965048.061330:0:8328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947429f44380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ae0997f7-3a15-4fc6-865a-35b2f101956e+5:11048:x1870622732893568:12345-0@lo:104: Request processed in 81us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965048.061336:0:8328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1783965048.061354:0:8328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1783965048.061360:0:8328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947429f45c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ae0997f7-3a15-4fc6-865a-35b2f101956e+4:11048:x1870622732893696:12345-0@lo:104: 00010000:00010000:3.0:1783965048.061367:0:8328:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.112@tcp lock: ffff947436f27000/0xe782b916994fd4ad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe782b916994fd4b4 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965048.061397:0:8328:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1783965048.061402:0:8328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947429f45c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ae0997f7-3a15-4fc6-865a-35b2f101956e+4:11048:x1870622732893696:12345-0@lo:104: Request processed in 44us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965048.061408:0:8328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1783965048.061428:0:8328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1783965048.061434:0:8328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947429f47480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ae0997f7-3a15-4fc6-865a-35b2f101956e+3:11048:x1870622732893824:12345-0@lo:104: 00010000:00010000:3.0:1783965048.061442:0:8328:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.112@tcp lock: ffff947401482600/0xe782b916994fd49f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe782b916994fd4a6 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965048.061469:0:8328:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1783965048.061474:0:8328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947429f47480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:ae0997f7-3a15-4fc6-865a-35b2f101956e+3:11048:x1870622732893824:12345-0@lo:104: Request processed in 41us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965048.061479:0:8328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:3.0:1783965048.061516:0:5800:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1783965048.061523:0:5800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.112@tcp lock: ffff947425974a00/0xe782b916994fd4bb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe782b916994fd4c2 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965048.061529:0:5800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947425974a00 already unused, calling callback (ffffffffc1ca8c20) 10000000:00010000:3.0:1783965048.061535:0:5800:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.112@tcp lock: ffff947425974a00/0xe782b916994fd4bb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xe782b916994fd4c2 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965048.061544:0:5800:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.112@tcp lock: ffff947425974a00/0xe782b916994fd4bb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xe782b916994fd4c2 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783965048.061552:0:5800:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.112@tcp lock: ffff947425974a00/0xe782b916994fd4bb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xe782b916994fd4c2 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783965048.061557:0:5800:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1783965048.061586:0:5800:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.112@tcp lock: ffff947425974a00/0xe782b916994fd4bb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe782b916994fd4c2 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965048.061593:0:5800:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783965048.061614:0:5800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.112@tcp lock: ffff947425974a00/0xe782b916994fd4bb lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe782b916994fd4c2 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965048.061632:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.112@tcp lock: ffff947425974a00/0xe782b916994fd4bb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe782b916994fd4c2 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965048.061647:0:5800:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783965048.061651:0:5800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.112@tcp lock: ffff947436f27000/0xe782b916994fd4ad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe782b916994fd4b4 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965048.061656:0:5800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947436f27000 already unused, calling callback (ffffffffc1ca8c20) 10000000:00010000:3.0:1783965048.061659:0:5800:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.112@tcp lock: ffff947436f27000/0xe782b916994fd4ad lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xe782b916994fd4b4 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965048.061666:0:5800:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.112@tcp lock: ffff947436f27000/0xe782b916994fd4ad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xe782b916994fd4b4 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783965048.061672:0:5800:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.112@tcp lock: ffff947436f27000/0xe782b916994fd4ad lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xe782b916994fd4b4 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783965048.061677:0:5800:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1783965048.061691:0:5800:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.112@tcp lock: ffff947436f27000/0xe782b916994fd4ad lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe782b916994fd4b4 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965048.061697:0:5800:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783965048.061703:0:5800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.112@tcp lock: ffff947436f27000/0xe782b916994fd4ad lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe782b916994fd4b4 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965048.061709:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.112@tcp lock: ffff947436f27000/0xe782b916994fd4ad lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe782b916994fd4b4 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965048.061718:0:5800:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783965048.061728:0:5800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.112@tcp lock: ffff947401482600/0xe782b916994fd49f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe782b916994fd4a6 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965048.061733:0:5800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947401482600 already unused, calling callback (ffffffffc1ca8c20) 10000000:00010000:3.0:1783965048.061736:0:5800:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.112@tcp lock: ffff947401482600/0xe782b916994fd49f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe782b916994fd4a6 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965048.061742:0:5800:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.112@tcp lock: ffff947401482600/0xe782b916994fd49f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe782b916994fd4a6 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783965048.061748:0:5800:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.112@tcp lock: ffff947401482600/0xe782b916994fd49f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe782b916994fd4a6 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783965048.061753:0:5800:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1783965048.061765:0:5800:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.112@tcp lock: ffff947401482600/0xe782b916994fd49f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe782b916994fd4a6 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965048.061771:0:5800:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783965048.061798:0:5800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.112@tcp lock: ffff947401482600/0xe782b916994fd49f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe782b916994fd4a6 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965048.061804:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.112@tcp lock: ffff947401482600/0xe782b916994fd49f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe782b916994fd4a6 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965048.061819:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783965048.061821:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783965048.061823:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783965048.061836:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9474072a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ae0997f7-3a15-4fc6-865a-35b2f101956e:3324:1870622732893952:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783965048.061871:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783965048.061893:0:3324:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783965048.061899:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9474072a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ae0997f7-3a15-4fc6-865a-35b2f101956e:3324:1870622732894080:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783965048.061927:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783965048.061951:0:3323:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783965048.061959:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9474072abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ae0997f7-3a15-4fc6-865a-35b2f101956e:3323:1870622732894208:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783965048.061994:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783965048.062021:0:8330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732893952 00000100:00100000:3.0:1783965048.062025:0:8330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732893952 00010000:00010000:3.0:1783965048.062045:0:8330:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94743d9ef800/0xe782b916994fd4c2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe782b916994fd4bb expref: 19 pid: 5805 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783965048.062068:0:8330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732894080 00000100:00100000:3.0:1783965048.062071:0:8330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732894080 00010000:00010000:3.0:1783965048.062082:0:8330:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff947400030000/0xe782b916994fd4b4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe782b916994fd4ad expref: 20 pid: 5805 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783965048.062091:0:8330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732894208 00000100:00100000:3.0:1783965048.062094:0:8330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732894208 00010000:00010000:3.0:1783965048.062102:0:8330:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff947436f26800/0xe782b916994fd4a6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe782b916994fd49f expref: 21 pid: 5805 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783965048.062112:0:8330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1783965048.062118:0:8330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94741843dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ae0997f7-3a15-4fc6-865a-35b2f101956e+21:3324:x1870622732893952:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783965048.062129:0:8330:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783965048.062134:0:8330:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94743d9ef800/0xe782b916994fd4c2 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe782b916994fd4bb expref: 21 pid: 5805 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965048.062143:0:8330:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94743d9ef800/0xe782b916994fd4c2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe782b916994fd4bb expref: 21 pid: 5805 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965048.062158:0:8330:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783965048.062185:0:8330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94741843dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ae0997f7-3a15-4fc6-865a-35b2f101956e+21:3324:x1870622732893952:12345-0@lo:103:ldlm_bl.0 Request processed in 67us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965048.062198:0:8330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1783965048.062259:0:8330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1783965048.062266:0:8330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9474072a9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ae0997f7-3a15-4fc6-865a-35b2f101956e+20:3324:x1870622732894080:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783965048.062273:0:8330:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783965048.062277:0:8330:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff947400030000/0xe782b916994fd4b4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe782b916994fd4ad expref: 20 pid: 5805 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965048.062284:0:8330:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff947400030000/0xe782b916994fd4b4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe782b916994fd4ad expref: 20 pid: 5805 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965048.062294:0:8330:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783965048.062315:0:8330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9474072a9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ae0997f7-3a15-4fc6-865a-35b2f101956e+20:3324:x1870622732894080:12345-0@lo:103:ldlm_bl.0 Request processed in 50us (387us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965048.062321:0:8330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1783965048.062332:0:8330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1783965048.062337:0:8330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436c3c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ae0997f7-3a15-4fc6-865a-35b2f101956e+19:3323:x1870622732894208:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783965048.062344:0:8330:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783965048.062348:0:8330:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff947436f26800/0xe782b916994fd4a6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe782b916994fd49f expref: 19 pid: 5805 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965048.062356:0:8330:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff947436f26800/0xe782b916994fd4a6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe782b916994fd49f expref: 19 pid: 5805 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965048.062365:0:8330:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783965048.062389:0:8330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436c3c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ae0997f7-3a15-4fc6-865a-35b2f101956e+19:3323:x1870622732894208:12345-0@lo:103:ldlm_bl.0 Request processed in 52us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965048.062395:0:8330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1783965048.062430:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9474072abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ae0997f7-3a15-4fc6-865a-35b2f101956e:3323:1870622732894208:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783965048.062463:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9474072a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ae0997f7-3a15-4fc6-865a-35b2f101956e:3324:1870622732894080:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783965048.062470:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9474072a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ae0997f7-3a15-4fc6-865a-35b2f101956e:3324:1870622732893952:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783965048.062680:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783965048.062907:0:11048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94743d9ef800/0xe782b916994fd4c2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe782b916994fd4bb expref: 18 pid: 5805 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783965048.062942:0:11048:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947429f45f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11048:1870622732893568:0@lo:104: 00010000:00010000:1.0:1783965048.062956:0:11048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff947400030000/0xe782b916994fd4b4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe782b916994fd4ad expref: 17 pid: 5805 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783965048.062964:0:11048:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947429f46680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11048:1870622732893696:0@lo:104: 00010000:00010000:1.0:1783965048.062973:0:11048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff947436f26800/0xe782b916994fd4a6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe782b916994fd49f expref: 16 pid: 5805 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783965048.062980:0:11048:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947429f47b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11048:1870622732893824:0@lo:104: 00000100:00100000:1.0:1783965048.079127:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965048.079194:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965048.080067:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715034240 00000100:00100000:3.0:1783965048.080080:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715034240 00010000:00010000:3.0:1783965048.080128:0:5799:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff947400030c00/0xe782b916994fd4de lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5efec2 expref: 13 pid: 5805 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783965048.080193:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715034368 00000100:00100000:3.0:1783965048.080197:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715034368 00010000:00010000:3.0:1783965048.080232:0:5799:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff947400030200/0xe782b916994fd4c9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5efe8a expref: 14 pid: 5806 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783965048.080251:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 28 00000100:00100000:3.0:1783965048.080260:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947429f46300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+14:2360:x1870622715034240:12345-192.168.204.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783965048.080275:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783965048.080281:0:5799:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff947400030c00/0xe782b916994fd4de lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5efec2 expref: 14 pid: 5805 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965048.080293:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff947400030c00/0xe782b916994fd4de lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5efec2 expref: 14 pid: 5805 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965048.080317:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783965048.080375:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947429f46300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+14:2360:x1870622715034240:12345-192.168.204.12@tcp:103:ldlm_bl.0 Request processed in 115us (1259us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965048.080383:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 28 00000100:00100000:3.0:1783965048.080402:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 29 00000100:00100000:3.0:1783965048.080410:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947429f46a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+13:2360:x1870622715034368:12345-192.168.204.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783965048.080435:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783965048.080439:0:5799:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff947400030200/0xe782b916994fd4c9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5efe8a expref: 13 pid: 5806 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965048.080449:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff947400030200/0xe782b916994fd4c9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5efe8a expref: 13 pid: 5806 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965048.080463:0:5799:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff94743d9ee200/0xe782b916994fd4fa lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965048.080471:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94743d9ee200/0xe782b916994fd4fa lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965048.080489:0:5799:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff94743d9ee200/0xe782b916994fd4fa lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965048.080497:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff94743d9ee200/0xe782b916994fd4fa lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965048.080504:0:5799:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff94743d9ee200/0xe782b916994fd4fa lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965048.080511:0:5799:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff94743d9ee200/0xe782b916994fd4fa lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965048.080518:0:5799:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743d9ee200 already unused, calling callback (ffffffffc168d230) 00010000:00010000:3.0:1783965048.080523:0:5799:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff94743d9ee200/0xe782b916994fd4fa lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965048.080530:0:5799:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff94743d9ee200/0xe782b916994fd4fa lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965048.080550:0:5799:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff94743d9ee200/0xe782b916994fd4fa lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965048.080577:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783965048.080600:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947429f46a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+13:2360:x1870622715034368:12345-192.168.204.12@tcp:103:ldlm_bl.0 Request processed in 191us (1405us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965048.080607:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 29 00010000:00010000:3.0:1783965048.080662:0:11048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff947400030c00/0xe782b916994fd4de lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5efec2 expref: 12 pid: 5805 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783965048.080677:0:11048:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947429f46d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11048:1870622732893312:192.168.204.12@tcp:104: 00010000:00010000:3.0:1783965048.080689:0:11048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff947400030200/0xe782b916994fd4c9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5efe8a expref: 11 pid: 5806 timeout: 382 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783965048.080696:0:11048:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947429f47800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11048:1870622732893440:192.168.204.12@tcp:104: 00010000:00010000:3.0:1783965048.080731:0:11048:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff94743d9ee200/0xe782b916994fd4fa lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965048.080740:0:11048:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff94743d9ee200/0xe782b916994fd4fa lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965048.080747:0:11048:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff94743d9ee200/0xe782b916994fd4fa lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965048.080754:0:11048:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94743d9ee200/0xe782b916994fd4fa lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11048 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965048.491444:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783965049.209268:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965049.209305:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715034496 00000100:00100000:2.0:1783965049.209314:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715034496 00000100:00100000:2.0:1783965049.209359:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 229 00000100:00100000:2.0:1783965049.209369:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947408ecb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+11:5573:x1870622715034496:12345-192.168.204.12@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783965049.209386:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783965049.209405:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff947425974400/0xe782b916994fd501 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5efeec expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965049.209433:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff947425974400/0xe782b916994fd501 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5efeec expref: 12 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965049.209444:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff947425974400/0xe782b916994fd501 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5efeec expref: 12 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965049.209453:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff947425974400, rc 0) 00000100:00100000:2.0:1783965049.209507:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947408ecb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+12:5573:x1870622715034496:12345-192.168.204.12@tcp:101:ll_cfg_requeue.0 Request processed in 139us (247us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965049.209514:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 229 00000100:00100000:3.0:1783965049.218277:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965049.219942:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715034624 00000100:00100000:3.0:1783965049.219958:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715034624 00000100:00100000:3.0:1783965049.220034:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 230 00000100:00100000:3.0:1783965049.220046:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947408ecb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+12:5573:x1870622715034624:12345-192.168.204.12@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783965049.220397:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947408ecb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+12:5573:x1870622715034624:12345-192.168.204.12@tcp:501:ll_cfg_requeue.0 Request processed in 353us (2132us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965049.220405:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 230 00000100:00100000:2.0:1783965049.226391:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783965049.227040:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715034752 00000100:00100000:0.0:1783965049.227052:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715034752 00000100:00100000:0.0:1783965049.227118:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 231 00000100:00100000:0.0:1783965049.227128:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947405adfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+12:5573:x1870622715034752:12345-192.168.204.12@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783965049.227576:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947405adfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+12:5573:x1870622715034752:12345-192.168.204.12@tcp:503:ll_cfg_requeue.0 Request processed in 447us (1193us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965049.227585:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 231 00000100:00100000:0.0:1783965049.238819:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783965049.238865:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715034880 00000100:00100000:0.0:1783965049.238875:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715034880 00000100:00100000:0.0:1783965049.238929:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 232 00000100:00100000:0.0:1783965049.238940:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947405add850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+12:5573:x1870622715034880:12345-192.168.204.12@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783965049.238958:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783965049.238979:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff947430c10200/0xe782b916994fd508 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5efef3 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965049.239071:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff947430c10200/0xe782b916994fd508 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5efef3 expref: 13 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965049.239083:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff947430c10200/0xe782b916994fd508 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5efef3 expref: 13 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965049.239091:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff947430c10200, rc 0) 00000100:00100000:0.0:1783965049.239144:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947405add850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+13:5573:x1870622715034880:12345-192.168.204.12@tcp:101:ll_cfg_requeue.0 Request processed in 207us (337us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965049.239152:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 232 00000100:00100000:0.0:1783965049.246797:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965049.248185:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715035008 00000100:00100000:1.0:1783965049.248226:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715035008 00000100:00100000:1.0:1783965049.248291:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 233 00000100:00100000:1.0:1783965049.248302:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947405adf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+13:5573:x1870622715035008:12345-192.168.204.12@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783965049.248613:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947405adf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+13:5573:x1870622715035008:12345-192.168.204.12@tcp:501:ll_cfg_requeue.0 Request processed in 312us (1825us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965049.248621:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 233 00000100:00100000:0.0:1783965049.263352:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965049.263411:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715035136 00000100:00100000:3.0:1783965049.263422:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715035136 00000100:00100000:3.0:1783965049.263486:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 234 00000100:00100000:3.0:1783965049.263498:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947405adf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+13:5573:x1870622715035136:12345-192.168.204.12@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783965049.263791:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947405adf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+13:5573:x1870622715035136:12345-192.168.204.12@tcp:503:ll_cfg_requeue.0 Request processed in 294us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965049.263801:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 234 00010000:00010000:0.0:1783965049.516820:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1783965050.031169:0:5809:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1783965050.031178:0:5809:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9474369fb000 from 7 10000000:01000000:3.0:1783965050.031182:0:5809:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783965050.031258:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.112@tcp lock: ffff947436f26400/0xe782b916994fd50f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965050.031271:0:5809:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.112@tcp lock: ffff947436f26400/0xe782b916994fd50f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965050.031284:0:5809:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.112@tcp lock: ffff947436f26400/0xe782b916994fd50f lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783965050.031315:0:5809:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947436c3e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae0997f7-3a15-4fc6-865a-35b2f101956e:5809:1870622732894336:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783965050.031404:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783965050.031454:0:5809:0:(client.c:2702:ptlrpc_set_wait()) set ffff94743fac6e40 going to sleep for 11 seconds 00000100:00100000:2.0:1783965050.031592:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732894336 00000100:00100000:2.0:1783965050.031600:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732894336 00000100:00100000:2.0:1783965050.031653:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1783965050.031662:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947405adf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae0997f7-3a15-4fc6-865a-35b2f101956e+16:5809:x1870622732894336:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783965050.031675:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783965050.031687:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff947425974e00/0xe782b916994fd516 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe782b916994fd50f expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965050.031721:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff947425974e00/0xe782b916994fd516 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe782b916994fd50f expref: 17 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965050.031731:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff947425974e00/0xe782b916994fd516 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe782b916994fd50f expref: 17 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965050.031749:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff947425974e00, rc 0) 00000100:00100000:2.0:1783965050.031795:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947405adf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae0997f7-3a15-4fc6-865a-35b2f101956e+17:5809:x1870622732894336:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 134us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965050.031802:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:2.0:1783965050.031846:0:5809:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947436c3e680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae0997f7-3a15-4fc6-865a-35b2f101956e:5809:1870622732894336:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783965050.031858:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.112@tcp lock: ffff947436f26400/0xe782b916994fd50f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fd516 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965050.031867:0:5809:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.112@tcp lock: ffff947436f26400/0xe782b916994fd50f lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe782b916994fd516 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783965050.031915:0:5809:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9474057db100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae0997f7-3a15-4fc6-865a-35b2f101956e:5809:1870622732894464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783965050.031951:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783965050.031964:0:5809:0:(client.c:2702:ptlrpc_set_wait()) set ffff94741cc02600 going to sleep for 11 seconds 00000100:00100000:2.0:1783965050.031975:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732894464 00000100:00100000:2.0:1783965050.031979:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732894464 00000100:00100000:2.0:1783965050.031997:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1783965050.032002:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947405adcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+17:5809:x1870622732894464:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783965050.032366:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947405adcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+17:5809:x1870622732894464:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 362us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965050.032381:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1783965050.032414:0:5809:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9474057db100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae0997f7-3a15-4fc6-865a-35b2f101956e:5809:1870622732894464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783965050.032440:0:5809:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9474057db100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae0997f7-3a15-4fc6-865a-35b2f101956e:5809:1870622732894592:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783965050.032471:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783965050.032483:0:5809:0:(client.c:2702:ptlrpc_set_wait()) set ffff94741cc02600 going to sleep for 11 seconds 00000100:00100000:2.0:1783965050.032493:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732894592 00000100:00100000:2.0:1783965050.032496:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732894592 00000100:00100000:2.0:1783965050.032513:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1783965050.032518:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947405add450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+17:5809:x1870622732894592:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783965050.032643:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947405add450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+17:5809:x1870622732894592:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 124us (171us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965050.032649:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1783965050.032679:0:5809:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9474057db100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae0997f7-3a15-4fc6-865a-35b2f101956e:5809:1870622732894592:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1783965050.033604:0:11119:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1783965050.033893:0:5809:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1783965050.033916:0:5809:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783965050.033926:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.112@tcp lock: ffff947436f26400/0xe782b916994fd50f lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fd516 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965050.033937:0:5809:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.112@tcp lock: ffff947436f26400/0xe782b916994fd50f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fd516 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783965050.033948:0:5809:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1783965050.033951:0:5809:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff94743e519000 from 7 10000000:01000000:3.0:1783965050.033953:0:5809:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783965050.033985:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.112@tcp lock: ffff947436f27000/0xe782b916994fd51d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965050.033993:0:5809:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.112@tcp lock: ffff947436f27000/0xe782b916994fd51d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965050.034002:0:5809:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.112@tcp lock: ffff947436f27000/0xe782b916994fd51d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783965050.034020:0:5809:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947436c3ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae0997f7-3a15-4fc6-865a-35b2f101956e:5809:1870622732894720:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783965050.034075:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783965050.034118:0:5809:0:(client.c:2702:ptlrpc_set_wait()) set ffff94743fac6e40 going to sleep for 11 seconds 00000100:00100000:2.0:1783965050.034277:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732894720 00000100:00100000:2.0:1783965050.034283:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732894720 00000100:00100000:2.0:1783965050.034352:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1783965050.034361:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947405ade050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+17:5809:x1870622732894720:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783965050.034372:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783965050.034387:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff947425974600/0xe782b916994fd524 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe782b916994fd51d expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965050.034408:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff947425974600/0xe782b916994fd524 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe782b916994fd51d expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965050.034419:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff947425974600/0xe782b916994fd524 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe782b916994fd51d expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965050.034439:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff947425974600, rc 0) 00000100:00100000:2.0:1783965050.034491:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947405ade050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+18:5809:x1870622732894720:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (415us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965050.034504:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:0.0:1783965050.035602:0:5809:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947436c3ce00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae0997f7-3a15-4fc6-865a-35b2f101956e:5809:1870622732894720:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783965050.035645:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.112@tcp lock: ffff947436f27000/0xe782b916994fd51d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fd524 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965050.035660:0:5809:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.112@tcp lock: ffff947436f27000/0xe782b916994fd51d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe782b916994fd524 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783965050.035773:0:5809:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743715ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae0997f7-3a15-4fc6-865a-35b2f101956e:5809:1870622732894848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783965050.035844:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783965050.035893:0:5809:0:(client.c:2702:ptlrpc_set_wait()) set ffff9474057dd600 going to sleep for 11 seconds 00000100:00100000:3.0:1783965050.035926:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732894848 00000100:00100000:3.0:1783965050.035940:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732894848 00000100:00100000:3.0:1783965050.036003:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1783965050.036013:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947405ade850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae0997f7-3a15-4fc6-865a-35b2f101956e+18:5809:x1870622732894848:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783965050.036361:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947405ade850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae0997f7-3a15-4fc6-865a-35b2f101956e+18:5809:x1870622732894848:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 349us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965050.036378:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:0.0:1783965050.036902:0:5809:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743715ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae0997f7-3a15-4fc6-865a-35b2f101956e:5809:1870622732894848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783965050.036973:0:5809:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743715ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae0997f7-3a15-4fc6-865a-35b2f101956e:5809:1870622732894976:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783965050.037317:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783965050.037441:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732894976 00000100:00100000:0.0:1783965050.037443:0:5809:0:(client.c:2702:ptlrpc_set_wait()) set ffff9474057dd600 going to sleep for 11 seconds 00000100:00100000:2.0:1783965050.037458:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732894976 00000100:00100000:2.0:1783965050.037514:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:2.0:1783965050.037523:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947405adc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+18:5809:x1870622732894976:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783965050.037767:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947405adc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+18:5809:x1870622732894976:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 244us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965050.037774:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:0.0:1783965050.038185:0:5809:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743715ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae0997f7-3a15-4fc6-865a-35b2f101956e:5809:1870622732894976:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1783965050.040555:0:11120:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1783965050.041930:0:5809:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1783965050.041975:0:5809:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783965050.041991:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.112@tcp lock: ffff947436f27000/0xe782b916994fd51d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fd524 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965050.042008:0:5809:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.112@tcp lock: ffff947436f27000/0xe782b916994fd51d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fd524 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783965050.042045:0:5809:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1783965050.042049:0:5809:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff947403dc3000 from 7 10000000:01000000:1.0:1783965050.042053:0:5809:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783965050.042129:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.112@tcp lock: ffff94743d9efa00/0xe782b916994fd52b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965050.042139:0:5809:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.112@tcp lock: ffff94743d9efa00/0xe782b916994fd52b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965050.042152:0:5809:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.112@tcp lock: ffff94743d9efa00/0xe782b916994fd52b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783965050.042190:0:5809:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947429f47800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae0997f7-3a15-4fc6-865a-35b2f101956e:5809:1870622732895104:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783965050.042307:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783965050.042391:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732895104 00000100:00100000:2.0:1783965050.042407:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732895104 00000100:00100000:1.0:1783965050.042480:0:5809:0:(client.c:2702:ptlrpc_set_wait()) set ffff9474400a4cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1783965050.042502:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1783965050.042519:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947405add050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae0997f7-3a15-4fc6-865a-35b2f101956e+18:5809:x1870622732895104:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783965050.042538:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783965050.042561:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff947425974c00/0xe782b916994fd532 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xe782b916994fd52b expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965050.042592:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff947425974c00/0xe782b916994fd532 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe782b916994fd52b expref: 19 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965050.042604:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff947425974c00/0xe782b916994fd532 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe782b916994fd52b expref: 19 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965050.042613:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff947425974c00, rc 0) 00000100:00100000:2.0:1783965050.042721:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947405add050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae0997f7-3a15-4fc6-865a-35b2f101956e+19:5809:x1870622732895104:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 208us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965050.042728:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:2.0:1783965050.042809:0:5809:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947429f47800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae0997f7-3a15-4fc6-865a-35b2f101956e:5809:1870622732895104:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783965050.042832:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.112@tcp lock: ffff94743d9efa00/0xe782b916994fd52b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fd532 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965050.042841:0:5809:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.112@tcp lock: ffff94743d9efa00/0xe782b916994fd52b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe782b916994fd532 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783965050.042918:0:5809:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9474057db100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae0997f7-3a15-4fc6-865a-35b2f101956e:5809:1870622732895232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783965050.042957:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783965050.042994:0:5809:0:(client.c:2702:ptlrpc_set_wait()) set ffff94741cc02180 going to sleep for 11 seconds 00000100:00100000:0.0:1783965050.044030:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732895232 00000100:00100000:0.0:1783965050.044040:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732895232 00000100:00100000:0.0:1783965050.044087:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1783965050.044095:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947405ade450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae0997f7-3a15-4fc6-865a-35b2f101956e+19:5809:x1870622732895232:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783965050.044444:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947405ade450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae0997f7-3a15-4fc6-865a-35b2f101956e+19:5809:x1870622732895232:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 349us (1485us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965050.044454:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:0.0:1783965050.044503:0:5809:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9474057db100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae0997f7-3a15-4fc6-865a-35b2f101956e:5809:1870622732895232:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783965050.044542:0:5809:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743715ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae0997f7-3a15-4fc6-865a-35b2f101956e:5809:1870622732895360:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783965050.044581:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783965050.044605:0:5809:0:(client.c:2702:ptlrpc_set_wait()) set ffff9474057dd780 going to sleep for 11 seconds 00000100:00100000:0.0:1783965050.044617:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732895360 00000100:00100000:0.0:1783965050.044621:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732895360 00000100:00100000:0.0:1783965050.044641:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1783965050.044647:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947405adc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae0997f7-3a15-4fc6-865a-35b2f101956e+19:5809:x1870622732895360:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783965050.044795:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947405adc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae0997f7-3a15-4fc6-865a-35b2f101956e+19:5809:x1870622732895360:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 147us (213us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965050.044802:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:0.0:1783965050.044843:0:5809:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743715ea00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae0997f7-3a15-4fc6-865a-35b2f101956e:5809:1870622732895360:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1783965050.045553:0:11121:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:1.0:1783965050.047027:0:5809:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:1.0:1783965050.047102:0:5809:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783965050.047120:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.112@tcp lock: ffff94743d9efa00/0xe782b916994fd52b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fd532 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965050.047138:0:5809:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.112@tcp lock: ffff94743d9efa00/0xe782b916994fd52b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fd532 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783965050.411429:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947429f46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3323:1870622732895488:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783965050.411534:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783965050.411633:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732895488 00000100:00100000:1.0:1783965050.411642:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732895488 00000100:00100000:1.0:1783965050.411718:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1783965050.411751:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947429f47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3323:x1870622732895488:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783965050.411883:0:6611:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783965050.411941:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947429f47b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3323:x1870622732895488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 193us (408us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965050.411950:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:1.0:1783965050.411976:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1783965050.412017:0:3323:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff947429f46d80 x1870622732895488/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783965066 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783965050.412041:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947429f46d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3323:1870622732895488:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783965050.414001:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9474057dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3322:1870622732895872:0@lo:400:kworker.0 00000100:00100000:2.0:1783965050.414087:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783965050.414130:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783965050.414137:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9474057d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3322:1870622732896000:0@lo:400:kworker.0 00000100:00100000:2.0:1783965050.414167:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783965050.415013:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9474057d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3325:1870622732895744:0@lo:400:kworker.0 00000100:00100000:1.0:1783965050.415066:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783965050.415102:0:3325:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783965050.415109:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9474057d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3325:1870622732895616:0@lo:400:kworker.0 00000100:00100000:1.0:1783965050.415134:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783965050.416128:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732895872 00000100:00100000:2.0:1783965050.416145:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732895872 00000100:00100000:2.0:1783965050.416246:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1783965050.416259:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9474057db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3322:x1870622732895872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783965050.416441:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9474057db100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3322:x1870622732895872:12345-0@lo:400:kworker.0 Request processed in 185us (2353us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965050.416449:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1783965050.416478:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732896000 00000100:00100000:2.0:1783965050.416482:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732896000 00000100:00100000:2.0:1783965050.416526:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732895744 00000100:00100000:2.0:1783965050.416530:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732895744 00000100:00100000:2.0:1783965050.416545:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732895616 00000100:00100000:2.0:1783965050.416548:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732895616 00000100:00100000:2.0:1783965050.416890:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1783965050.416899:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94742597ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3322:x1870622732896000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783965050.417016:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94742597ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3322:x1870622732896000:12345-0@lo:400:kworker.0 Request processed in 119us (2848us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965050.417023:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1783965050.417037:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1783965050.417044:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947429f46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3325:x1870622732895744:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783965050.417085:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947429f46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3325:x1870622732895744:12345-0@lo:400:kworker.0 Request processed in 42us (2020us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965050.417091:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:1.0:1783965050.417097:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783965050.417102:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00080000:1.0:1783965050.417104:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783965050.417107:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947429f46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3325:x1870622732895616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783965050.417136:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947429f46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3325:x1870622732895616:12345-0@lo:400:kworker.0 Request processed in 29us (2001us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965050.417142:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1783965050.417232:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9474057d9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3325:1870622732895616:0@lo:400:kworker.0 00000100:00100000:2.0:1783965050.417248:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9474057d8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3325:1870622732895744:0@lo:400:kworker.0 00000100:00100000:3.0:1783965050.419879:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9474057d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3322:1870622732896000:0@lo:400:kworker.0 00010000:00080000:3.0:1783965050.419916:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9474057dbb80 x1870622732895872/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783965066 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783965050.419929:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9474057dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3322:1870622732895872:0@lo:400:kworker.0 00010000:00010000:3.0:1783965050.539398:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783965051.568141:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1783965052.446442:0:11247:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg412-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:2.0:1783965052.460050:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947436c3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3324:1870622732896128:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783965052.460170:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783965052.461220:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732896128 00000100:00100000:3.0:1783965052.461236:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732896128 00000100:00100000:3.0:1783965052.461322:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1783965052.461335:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94742597bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3324:x1870622732896128:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783965052.461386:0:6611:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783965052.461636:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94742597bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3324:x1870622732896128:12345-0@lo:13:osp-pre-0-0.0 Request processed in 303us (1466us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965052.461645:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:2.0:1783965052.462058:0:3324:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff947436c3f800 x1870622732896128/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783965068 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783965052.462101:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947436c3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3324:1870622732896128:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1783965052.463376:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1783965052.587333:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783965052.798725:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783965052.798785:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783965052.798830:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715035520 00000100:00100000:0.0:1783965052.798842:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715035520 00000100:00100000:3.0:1783965052.799018:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715035264 00000100:00100000:3.0:1783965052.799024:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715035264 00000100:00100000:3.0:1783965052.799139:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 244 00000100:00100000:3.0:1783965052.799153:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947405adc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+13:2357:x1870622715035264:12345-192.168.204.12@tcp:400:kworker.0 00000100:00100000:3.0:1783965052.799292:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947405adc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+13:2357:x1870622715035264:12345-192.168.204.12@tcp:400:kworker.0 Request processed in 142us (582us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965052.799300:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 244 00000100:00100000:0.0:1783965052.799772:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 90 00000100:00100000:0.0:1783965052.799785:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743715ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49bbacc1-b013-4591-8d15-02f4f0d1884e+5:2357:x1870622715035520:12345-192.168.204.12@tcp:400:kworker.0 00000100:00100000:0.0:1783965052.799833:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743715ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49bbacc1-b013-4591-8d15-02f4f0d1884e+5:2357:x1870622715035520:12345-192.168.204.12@tcp:400:kworker.0 Request processed in 52us (1048us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965052.799841:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 90 00000100:00080000:0.0:1783965052.799869:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783965052.800020:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965052.800888:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715035392 00000100:00100000:3.0:1783965052.800902:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715035392 00000100:00100000:3.0:1783965052.801004:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 91 00000100:00100000:3.0:1783965052.801017:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743715d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9923189b-eb4a-470c-ab45-969435371000+6:2357:x1870622715035392:12345-192.168.204.12@tcp:400:kworker.0 00000100:00100000:3.0:1783965052.801104:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743715d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9923189b-eb4a-470c-ab45-969435371000+6:2357:x1870622715035392:12345-192.168.204.12@tcp:400:kworker.0 Request processed in 90us (1084us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965052.801111:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 91 00000100:00080000:2.0:1783965052.801749:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1783965053.617457:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783965054.636332:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783965055.531442:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947425979c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3322:1870622732896384:0@lo:400:kworker.0 00000100:00100000:2.0:1783965055.531507:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783965055.531554:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9474057d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3322:1870622732896896:0@lo:400:kworker.0 00000100:00100000:2.0:1783965055.531579:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783965055.531608:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783965055.531614:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947425979180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3322:1870622732896512:0@lo:400:kworker.0 00000100:00100000:2.0:1783965055.531646:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783965055.531720:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947425979500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3324:1870622732896640:0@lo:400:kworker.0 00000100:00100000:1.0:1783965055.531751:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783965055.531780:0:3324:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1783965055.531786:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94742597b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ae0997f7-3a15-4fc6-865a-35b2f101956e:3324:1870622732896256:0@lo:400:kworker.0 00000100:00100000:1.0:1783965055.531815:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783965055.531834:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9474057dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3324:1870622732896768:0@lo:400:kworker.0 00000100:00100000:1.0:1783965055.531855:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783965055.531886:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732896384 00000100:00100000:1.0:1783965055.531905:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732896384 00000100:00100000:1.0:1783965055.531949:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732896512 00000100:00100000:1.0:1783965055.531952:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732896512 00000100:00100000:1.0:1783965055.531970:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732896768 00000100:00100000:1.0:1783965055.531972:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732896768 00000100:00100000:1.0:1783965055.531987:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1783965055.531993:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9474057d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3322:x1870622732896384:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783965055.532059:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9474057d8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3322:x1870622732896384:12345-0@lo:400:kworker.0 Request processed in 64us (550us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965055.532066:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1783965055.532081:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1783965055.532087:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947407297800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3322:x1870622732896512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783965055.532112:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947407297800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3322:x1870622732896512:12345-0@lo:400:kworker.0 Request processed in 26us (465us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965055.532118:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:1.0:1783965055.532127:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:1.0:1783965055.532133:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947429f47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3324:x1870622732896768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783965055.532160:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947429f47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3324:x1870622732896768:12345-0@lo:400:kworker.0 Request processed in 27us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965055.532166:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00080000:1.0:1783965055.532183:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783965055.532255:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9474057dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3324:1870622732896768:0@lo:400:kworker.0 00000100:00100000:1.0:1783965055.532303:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9474057dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3323:1870622732897024:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783965055.532328:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783965055.532353:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732897024 00000100:00100000:1.0:1783965055.532363:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732897024 00000100:00100000:1.0:1783965055.532390:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1783965055.532402:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e298e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3323:x1870622732897024:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783965055.532432:0:6611:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783965055.532469:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e298e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3323:x1870622732897024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (140us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965055.532475:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:1.0:1783965055.532488:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1783965055.532504:0:3323:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9474057dbb80 x1870622732897024/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783965071 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783965055.532519:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9474057dbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3323:1870622732897024:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783965055.532545:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947425979180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3322:1870622732896512:0@lo:400:kworker.0 00000100:00100000:1.0:1783965055.532556:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947425979c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3322:1870622732896384:0@lo:400:kworker.0 00000100:00100000:0.0:1783965055.532744:0:8738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732896896 00000100:00100000:0.0:1783965055.532749:0:8738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732896896 00000100:00100000:0.0:1783965055.532783:0:8738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732896640 00000100:00100000:0.0:1783965055.532786:0:8738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732896640 00000100:00100000:0.0:1783965055.532819:0:8738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1783965055.532826:0:8738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9474057d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3322:x1870622732896896:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783965055.532866:0:8738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9474057d9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3322:x1870622732896896:12345-0@lo:400:kworker.0 Request processed in 41us (1286us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965055.532872:0:8738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1783965055.532886:0:8738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1783965055.532892:0:8738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947429f45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3324:x1870622732896640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783965055.532924:0:8738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947429f45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3324:x1870622732896640:12345-0@lo:400:kworker.0 Request processed in 32us (1172us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965055.532929:0:8738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1783965055.532958:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732896256 00000100:00100000:0.0:1783965055.532961:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732896256 00000100:00100000:0.0:1783965055.532985:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1783965055.532990:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947405addc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae0997f7-3a15-4fc6-865a-35b2f101956e+19:3324:x1870622732896256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783965055.533016:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947405addc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae0997f7-3a15-4fc6-865a-35b2f101956e+19:3324:x1870622732896256:12345-0@lo:400:kworker.0 Request processed in 26us (1201us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965055.533021:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1783965055.533082:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94742597b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ae0997f7-3a15-4fc6-865a-35b2f101956e:3324:1870622732896256:0@lo:400:kworker.0 00010000:00080000:0.0:1783965055.533092:0:3324:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff947425979500 x1870622732896640/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783965071 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783965055.533102:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947425979500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3324:1870622732896640:0@lo:400:kworker.0 00010000:00080000:0.0:1783965055.533122:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9474057d9c00 x1870622732896896/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783965071 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783965055.533130:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9474057d9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3322:1870622732896896:0@lo:400:kworker.0 00000100:00080000:1.0:1783965055.534146:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1783965055.659745:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1783965056.133813:0:11346:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 13:50:54 (1783965054) === 00000100:00100000:1.0:1783965056.355600:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965056.355681:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783965056.355718:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715035776 00000100:00100000:0.0:1783965056.355729:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715035776 00000100:00080000:1.0:1783965056.355773:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783965056.355788:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 0 00000100:00100000:0.0:1783965056.355799:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e298380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:9923189b-eb4a-470c-ab45-969435371000+6:9654:x1870622715035776:12345-192.168.204.12@tcp:700:mkdir.0 00000100:00100000:3.0:1783965056.355822:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715035648 00000100:00100000:3.0:1783965056.355827:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715035648 00000100:00100000:3.0:1783965056.355856:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 14 00000100:00100000:3.0:1783965056.355862:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e29a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9923189b-eb4a-470c-ab45-969435371000+7:2357:x1870622715035648:12345-192.168.204.12@tcp:41:mkdir.0 00000100:00100000:0.0:1783965056.355880:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e298380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:9923189b-eb4a-470c-ab45-969435371000+7:9654:x1870622715035776:12345-192.168.204.12@tcp:700:mkdir.0 Request processed in 84us (199us total) trans 0 rc 0/0 00000004:00000024:3.0:1783965056.356170:0:5813:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1783965056.356434:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e29a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9923189b-eb4a-470c-ab45-969435371000+7:2357:x1870622715035648:12345-192.168.204.12@tcp:41:mkdir.0 Request processed in 571us (843us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965056.356442:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 14 00000100:00100000:0.0:1783965056.357134:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 0 00000100:00100000:0.0:1783965056.368098:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965056.368263:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715036032 00000100:00100000:3.0:1783965056.368273:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715036032 00000100:00100000:3.0:1783965056.368326:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 15 00000100:00100000:3.0:1783965056.368335:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743715e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9923189b-eb4a-470c-ab45-969435371000+6:9654:x1870622715036032:12345-192.168.204.12@tcp:36:mkdir.0 00010000:00010000:3.0:1783965056.368393:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783965056.368461:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947425974000/0xe782b916994fd41a lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5efe75 expref: 6 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965056.368478:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff947402a2d500) 00010000:00010000:3.0:1783965056.368489:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783965056.370793:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27a00/0xe782b916994fd539 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965056.370832:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27a00/0xe782b916994fd539 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965056.370846:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27a00/0xe782b916994fd539 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965056.370899:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27800/0xe782b916994fd540 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965056.370908:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27800/0xe782b916994fd540 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965056.370914:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27800/0xe782b916994fd540 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783965056.372233:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00010000:00010000:3.0:1783965056.372250:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27a00/0xe782b916994fd539 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965056.372259:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27a00/0xe782b916994fd539 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965056.372266:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27a00/0xe782b916994fd539 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965056.372272:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947436f27a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1783965056.372276:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27a00/0xe782b916994fd539 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965056.372284:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27a00/0xe782b916994fd539 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965056.372309:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9474186e7a00) 00010000:00010000:3.0:1783965056.372313:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783965056.372318:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27a00/0xe782b916994fd539 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965056.372324:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27a00/0xe782b916994fd539 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783965056.372342:0:5811:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007649503b reply state 00000000134a3bb9 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27800/0xe782b916994fd540 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783965056.372350:0:5811:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783965056.372460:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743715e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9923189b-eb4a-470c-ab45-969435371000+7:9654:x1870622715036032:12345-192.168.204.12@tcp:36:mkdir.0 Request processed in 4122us (4369us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1783965056.372470:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 15 00010000:00010000:3.0:1783965056.374643:0:3308:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27800/0xe782b916994fd540 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965056.374658:0:3308:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27800/0xe782b916994fd540 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965056.374666:0:3308:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27800/0xe782b916994fd540 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965056.374673:0:3308:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947436f27800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1783965056.374678:0:3308:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27800/0xe782b916994fd540 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965056.374686:0:3308:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27800/0xe782b916994fd540 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965056.374716:0:3308:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9474186e7b00) 00010000:00010000:3.0:1783965056.374720:0:3308:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783965056.374724:0:3308:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27800/0xe782b916994fd540 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965056.374731:0:3308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27800/0xe782b916994fd540 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783965056.380540:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965056.382564:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715036160 00000100:00100000:1.0:1783965056.382925:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715036160 00000100:00100000:1.0:1783965056.383005:0:6632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 16 00000100:00100000:1.0:1783965056.383016:0:6632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743715dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9923189b-eb4a-470c-ab45-969435371000+6:9656:x1870622715036160:12345-192.168.204.12@tcp:101:chmod.0 00010000:00010000:1.0:1783965056.383039:0:6632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783965056.383064:0:6632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef000/0xe782b916994fd547 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5efefa expref: -99 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965056.383130:0:6632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994fd54e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965056.383158:0:6632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994fd54e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965056.383171:0:6632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994fd54e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783965056.383318:0:6632:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1783965056.383323:0:6632:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1783965056.383370:0:6632:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994fd54e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965056.383397:0:6632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef000/0xe782b916994fd547 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5efefa expref: 8 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965056.383421:0:6632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994fd54e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5efefa expref: 7 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965056.383430:0:6632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff947407b5c100) 00010000:00010000:1.0:1783965056.383433:0:6632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783965056.383436:0:6632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94743d9ee800, rc 0) 00000100:00100000:1.0:1783965056.383543:0:6632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743715dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9923189b-eb4a-470c-ab45-969435371000+7:9656:x1870622715036160:12345-192.168.204.12@tcp:101:chmod.0 Request processed in 528us (3014us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965056.383554:0:6632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 16 00000100:00100000:3.0:1783965056.388428:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783965056.388658:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715036416 00000100:00100000:0.0:1783965056.388668:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715036416 00000100:00100000:0.0:1783965056.388761:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 17 00000100:00100000:0.0:1783965056.388771:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436c3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9923189b-eb4a-470c-ab45-969435371000+7:9656:x1870622715036416:12345-192.168.204.12@tcp:36:chmod.0 00010000:00010000:0.0:1783965056.388824:0:5812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783965056.388853:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994fd54e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5efefa expref: 7 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965056.388878:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff947407b5c100) 00010000:00010000:0.0:1783965056.388945:0:5812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783965056.388973:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff947430c10a00/0xe782b916994fd555 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965056.388986:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947430c10a00/0xe782b916994fd555 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965056.388996:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947430c10a00/0xe782b916994fd555 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783965056.389465:0:5812:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c869b468 reply state 0000000006b60ebf transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff947430c10a00/0xe782b916994fd555 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783965056.389476:0:5812:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1783965056.389492:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:0.0:1783965056.389697:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436c3ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9923189b-eb4a-470c-ab45-969435371000+8:9656:x1870622715036416:12345-192.168.204.12@tcp:36:chmod.0 Request processed in 925us (1276us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1783965056.389705:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 17 00010000:00010000:3.0:1783965056.393160:0:3309:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff947430c10a00/0xe782b916994fd555 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965056.393185:0:3309:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff947430c10a00/0xe782b916994fd555 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965056.393194:0:3309:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff947430c10a00/0xe782b916994fd555 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965056.393230:0:3309:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947430c10a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1783965056.393238:0:3309:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947430c10a00/0xe782b916994fd555 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965056.393247:0:3309:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947430c10a00/0xe782b916994fd555 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965056.393270:0:3309:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94740a90cc00) 00010000:00010000:3.0:1783965056.393274:0:3309:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1783965056.393281:0:3309:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff947430c10a00/0xe782b916994fd555 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965056.393288:0:3309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947430c10a00/0xe782b916994fd555 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783965056.421653:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965056.421943:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715036544 00000100:00100000:1.0:1783965056.421961:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715036544 00000100:00100000:1.0:1783965056.422047:0:6632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 18 00000100:00100000:1.0:1783965056.422059:0:6632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436c3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9923189b-eb4a-470c-ab45-969435371000+7:9657:x1870622715036544:12345-192.168.204.12@tcp:101:chown.0 00010000:00010000:1.0:1783965056.422084:0:6632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783965056.422121:0:6632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef000/0xe782b916994fd55c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5eff01 expref: -99 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965056.422184:0:6632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee400/0xe782b916994fd563 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965056.422197:0:6632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee400/0xe782b916994fd563 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965056.422551:0:6632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee400/0xe782b916994fd563 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783965056.424903:0:6632:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1783965056.424913:0:6632:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1783965056.424971:0:6632:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee400/0xe782b916994fd563 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965056.425013:0:6632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef000/0xe782b916994fd55c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5eff01 expref: 9 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965056.425044:0:6632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee400/0xe782b916994fd563 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5eff01 expref: 8 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965056.425053:0:6632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff947407b5cf00) 00010000:00010000:2.0:1783965056.425056:0:6632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783965056.425060:0:6632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94743d9ee400, rc 0) 00000100:00100000:2.0:1783965056.425126:0:6632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436c3e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9923189b-eb4a-470c-ab45-969435371000+8:9657:x1870622715036544:12345-192.168.204.12@tcp:101:chown.0 Request processed in 3070us (3489us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965056.425135:0:6632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 18 00000100:00100000:0.0:1783965056.431449:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965056.431546:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715036672 00000100:00100000:3.0:1783965056.431557:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715036672 00000100:00100000:3.0:1783965056.431627:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 19 00000100:00100000:3.0:1783965056.431637:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743715c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9923189b-eb4a-470c-ab45-969435371000+8:9657:x1870622715036672:12345-192.168.204.12@tcp:101:chown.0 00010000:00010000:3.0:1783965056.431657:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783965056.431679:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27800/0xe782b916994fd56a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5eff08 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965056.431747:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27a00/0xe782b916994fd571 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965056.431762:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27a00/0xe782b916994fd571 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965056.431772:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27a00/0xe782b916994fd571 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965056.431788:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26c00/0xe782b916994fd578 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965056.431795:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26c00/0xe782b916994fd578 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965056.431802:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26c00/0xe782b916994fd578 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965056.431903:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27600/0xe782b916994fd57f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965056.431929:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27600/0xe782b916994fd57f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965056.431937:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27600/0xe782b916994fd57f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783965056.431977:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00000004:00200000:3.0:1783965056.431981:0:5811:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1783965056.432007:0:5811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27600/0xe782b916994fd57f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965056.432019:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27a00/0xe782b916994fd571 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965056.432025:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27a00/0xe782b916994fd571 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965056.432043:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27a00/0xe782b916994fd571 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965056.432049:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947436f27a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1783965056.432053:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27a00/0xe782b916994fd571 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965056.432060:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27a00/0xe782b916994fd571 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965056.432072:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff947407b5cf00) 00010000:00010000:3.0:1783965056.432076:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783965056.432080:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27a00/0xe782b916994fd571 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965056.432096:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27a00/0xe782b916994fd571 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965056.432113:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26c00/0xe782b916994fd578 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965056.432119:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26c00/0xe782b916994fd578 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965056.432125:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26c00/0xe782b916994fd578 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965056.432130:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947436f26c00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1783965056.432133:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26c00/0xe782b916994fd578 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965056.432139:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26c00/0xe782b916994fd578 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965056.432148:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9474186e7b00) 00010000:00010000:3.0:1783965056.432151:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783965056.432154:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26c00/0xe782b916994fd578 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965056.432160:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26c00/0xe782b916994fd578 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965056.432191:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27800/0xe782b916994fd56a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5eff08 expref: 10 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965056.432265:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27600/0xe782b916994fd57f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5eff08 expref: 9 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965056.432280:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9474186e7a00) 00010000:00010000:3.0:1783965056.432282:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783965056.432285:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff947436f27600, rc 0) 00000100:00100000:3.0:1783965056.432349:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743715c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9923189b-eb4a-470c-ab45-969435371000+9:9657:x1870622715036672:12345-192.168.204.12@tcp:101:chown.0 Request processed in 714us (909us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965056.432356:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 19 00000100:00100000:0.0:1783965056.444078:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965056.444197:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715036928 00000100:00100000:3.0:1783965056.444245:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715036928 00000100:00100000:3.0:1783965056.444314:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 20 00000100:00100000:3.0:1783965056.444324:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743715c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9923189b-eb4a-470c-ab45-969435371000+9:9657:x1870622715036928:12345-192.168.204.12@tcp:36:chown.0 00010000:00010000:3.0:1783965056.444385:0:5813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783965056.444415:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27600/0xe782b916994fd57f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5eff08 expref: 9 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965056.444435:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9474186e7a00) 00010000:00010000:3.0:1783965056.444447:0:5813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783965056.444472:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27800/0xe782b916994fd586 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965056.444486:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27800/0xe782b916994fd586 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965056.444495:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27800/0xe782b916994fd586 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783965056.505365:0:5835:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967298 is committed 00000001:00080000:0.0:1783965056.505397:0:5835:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00000004:00010000:2.0:1783965056.505539:0:5813:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000505a6c49 reply state 00000000476fbb6c transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27800/0xe782b916994fd586 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783965056.505555:0:5813:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1783965056.505716:0:5813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00080000:2.0:1783965056.505819:0:5813:0:(ldlm_lib.c:3454:target_send_reply()) Schedule reply immediately 00000100:00100000:2.0:1783965056.505836:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743715c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9923189b-eb4a-470c-ab45-969435371000+7:9657:x1870622715036928:12345-192.168.204.12@tcp:36:chown.0 Request processed in 61510us (61766us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1783965056.505845:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 20 00010000:00010000:3.0:1783965056.506003:0:3308:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27800/0xe782b916994fd586 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965056.506022:0:3308:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27800/0xe782b916994fd586 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965056.506040:0:3308:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27800/0xe782b916994fd586 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965056.506046:0:3308:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947436f27800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1783965056.506051:0:3308:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27800/0xe782b916994fd586 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965056.506058:0:3308:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27800/0xe782b916994fd586 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965056.506074:0:3308:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9474186e7b00) 00010000:00010000:3.0:1783965056.506077:0:3308:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1783965056.506082:0:3308:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27800/0xe782b916994fd586 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965056.506087:0:3308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27800/0xe782b916994fd586 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783965056.528097:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965056.528348:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715037056 00000100:00100000:3.0:1783965056.528368:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715037056 00000100:00100000:3.0:1783965056.528462:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 21 00000100:00100000:3.0:1783965056.528475:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9474368d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9923189b-eb4a-470c-ab45-969435371000+6:9658:x1870622715037056:12345-192.168.204.12@tcp:101:touch.500 00010000:00010000:3.0:1783965056.528510:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783965056.528539:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27800/0xe782b916994fd58d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5eff0f expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783965056.532530:0:5811:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 3920us 00010000:00010000:1.0:1783965056.567313:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994fd594 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965056.567339:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994fd594 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965056.567352:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994fd594 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965056.567369:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef400/0xe782b916994fd59b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965056.567377:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef400/0xe782b916994fd59b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965056.567384:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef400/0xe782b916994fd59b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965056.569564:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efe00/0xe782b916994fd5a2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965056.569588:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efe00/0xe782b916994fd5a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965056.569599:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efe00/0xe782b916994fd5a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783965056.569714:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1783965056.569719:0:5811:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1783965056.569821:0:5811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efe00/0xe782b916994fd5a2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965056.569835:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994fd594 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965056.569842:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994fd594 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965056.569848:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994fd594 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965056.569853:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743d9ee800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1783965056.569857:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994fd594 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965056.569989:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994fd594 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965056.570004:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff947407b5cf00) 00010000:00010000:1.0:1783965056.570007:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783965056.570011:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994fd594 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965056.570026:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994fd594 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965056.570042:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef400/0xe782b916994fd59b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965056.570047:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef400/0xe782b916994fd59b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965056.570051:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef400/0xe782b916994fd59b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965056.570056:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743d9ef400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1783965056.570058:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef400/0xe782b916994fd59b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965056.570063:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef400/0xe782b916994fd59b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965056.570070:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff947407b5ca00) 00010000:00010000:1.0:1783965056.570073:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783965056.570075:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef400/0xe782b916994fd59b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965056.570081:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef400/0xe782b916994fd59b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965056.570125:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27800/0xe782b916994fd58d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5eff0f expref: 8 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965056.570140:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efe00/0xe782b916994fd5a2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5eff0f expref: 7 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965056.570154:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff947407b5c800) 00010000:00010000:1.0:1783965056.570156:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1783965056.570158:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94743d9efe00, rc 0) 00000100:00100000:0.0:1783965056.570690:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9474368d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9923189b-eb4a-470c-ab45-969435371000+7:9658:x1870622715037056:12345-192.168.204.12@tcp:101:touch.500 Request processed in 42214us (42599us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965056.570699:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 21 00000100:00100000:1.0:1783965056.575327:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965056.575413:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715037312 00000100:00100000:2.0:1783965056.575422:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715037312 00000100:00100000:2.0:1783965056.575479:0:6632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 22 00000100:00100000:2.0:1783965056.575488:0:6632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e299c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9923189b-eb4a-470c-ab45-969435371000+7:9658:x1870622715037312:12345-192.168.204.12@tcp:101:touch.500 00010000:00010000:2.0:1783965056.575508:0:6632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783965056.575531:0:6632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947425975800/0xe782b916994fd5a9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5eff16 expref: -99 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965056.575860:0:6632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff947425974000/0xe782b916994fd5b0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965056.575888:0:6632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947425974000/0xe782b916994fd5b0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965056.575899:0:6632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947425974000/0xe782b916994fd5b0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965056.575951:0:6632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff947425974a00/0xe782b916994fd5b7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xc6b52abd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965056.575958:0:6632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947425974a00/0xe782b916994fd5b7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xc6b52abd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965056.575976:0:6632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947425974a00/0xe782b916994fd5b7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xc6b52abd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783965056.576733:0:6632:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:2.0:1783965056.576974:0:6632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff947425975a00/0xe782b916994fd5be lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965056.576986:0:6632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947425975a00/0xe782b916994fd5be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965056.576994:0:6632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947425975a00/0xe782b916994fd5be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965056.577025:0:6632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff947425974000/0xe782b916994fd5b0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965056.577047:0:6632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff947425974000/0xe782b916994fd5b0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965056.577054:0:6632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff947425974000/0xe782b916994fd5b0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965056.577060:0:6632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947425974000 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1783965056.577064:0:6632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947425974000/0xe782b916994fd5b0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965056.577070:0:6632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947425974000/0xe782b916994fd5b0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965056.577081:0:6632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff947407b5c800) 00010000:00010000:2.0:1783965056.577084:0:6632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783965056.577094:0:6632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff947425974000/0xe782b916994fd5b0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965056.577100:0:6632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947425974000/0xe782b916994fd5b0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783965056.577114:0:6632:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007a7f2093 reply state 000000005b5a1945 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff947425974a00/0xe782b916994fd5b7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xc6b52abd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783965056.577123:0:6632:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1783965056.577154:0:6632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947425975800/0xe782b916994fd5a9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5eff16 expref: 10 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965056.577168:0:6632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff947425975a00/0xe782b916994fd5be lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5eff16 expref: 9 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965056.577176:0:6632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff947402a2d900) 00010000:00010000:2.0:1783965056.577178:0:6632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783965056.577181:0:6632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff947425975a00, rc 0) 00000100:00100000:2.0:1783965056.577267:0:6632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e299c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9923189b-eb4a-470c-ab45-969435371000+10:9658:x1870622715037312:12345-192.168.204.12@tcp:101:touch.500 Request processed in 1779us (1948us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1783965056.577275:0:6632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 22 00010000:00010000:3.0:1783965056.581548:0:3308:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff947425974a00/0xe782b916994fd5b7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xc6b52abd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965056.581579:0:3308:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff947425974a00/0xe782b916994fd5b7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xc6b52abd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965056.581587:0:3308:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff947425974a00/0xe782b916994fd5b7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xc6b52abd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965056.581593:0:3308:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947425974a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1783965056.581598:0:3308:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947425974a00/0xe782b916994fd5b7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xc6b52abd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965056.581606:0:3308:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947425974a00/0xe782b916994fd5b7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xc6b52abd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965056.581631:0:3308:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xc6b52abd (ffff947402a2df00) 00010000:00010000:3.0:1783965056.581635:0:3308:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783965056.581639:0:3308:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff947425974a00/0xe782b916994fd5b7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xc6b52abd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965056.581645:0:3308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947425974a00/0xe782b916994fd5b7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xc6b52abd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783965056.587528:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783965056.587608:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715037568 00000100:00100000:0.0:1783965056.587629:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715037568 00000100:00100000:0.0:1783965056.587692:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 23 00000100:00100000:0.0:1783965056.587702:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e298a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9923189b-eb4a-470c-ab45-969435371000+9:9658:x1870622715037568:12345-192.168.204.12@tcp:36:touch.500 00010000:00010000:0.0:1783965056.587764:0:5812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783965056.587792:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947425975a00/0xe782b916994fd5be lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5eff16 expref: 9 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965056.587812:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff947402a2d900) 00010000:00010000:0.0:1783965056.587823:0:5812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783965056.587867:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff947430c11000/0xe782b916994fd5cc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965056.587881:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947430c11000/0xe782b916994fd5cc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965056.587890:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947430c11000/0xe782b916994fd5cc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783965056.588016:0:5812:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b2cac1af reply state 000000005f768125 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff947430c11000/0xe782b916994fd5cc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783965056.588025:0:5812:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783965056.588132:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e298a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9923189b-eb4a-470c-ab45-969435371000+10:9658:x1870622715037568:12345-192.168.204.12@tcp:36:touch.500 Request processed in 431us (616us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1783965056.588155:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 23 00010000:00010000:3.0:1783965056.594325:0:3309:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff947430c11000/0xe782b916994fd5cc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965056.594342:0:3309:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff947430c11000/0xe782b916994fd5cc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965056.594350:0:3309:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff947430c11000/0xe782b916994fd5cc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965056.594356:0:3309:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947430c11000 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1783965056.594375:0:3309:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947430c11000/0xe782b916994fd5cc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965056.594384:0:3309:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947430c11000/0xe782b916994fd5cc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965056.594400:0:3309:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff94740a90cd00) 00010000:00010000:3.0:1783965056.594403:0:3309:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783965056.594408:0:3309:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff947430c11000/0xe782b916994fd5cc lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965056.594414:0:3309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947430c11000/0xe782b916994fd5cc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783965056.597489:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965056.597569:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715037696 00000100:00100000:2.0:1783965056.597578:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715037696 00000100:00100000:2.0:1783965056.597645:0:6632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 24 00000100:00100000:2.0:1783965056.597656:0:6632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947425979500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9923189b-eb4a-470c-ab45-969435371000+9:9658:x1870622715037696:12345-192.168.204.12@tcp:101:touch.500 00010000:00010000:2.0:1783965056.597683:0:6632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783965056.597708:0:6632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947425974000/0xe782b916994fd5d3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5eff1d expref: -99 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965056.597794:0:6632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947425974000/0xe782b916994fd5d3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5eff1d expref: 10 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965056.597810:0:6632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff947425974000/0xe782b916994fd5d3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5eff1d expref: 10 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965056.597828:0:6632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff947402a2d700) 00010000:00010000:2.0:1783965056.597831:0:6632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783965056.597835:0:6632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff947425974000, rc 0) 00000100:00100000:2.0:1783965056.597900:0:6632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947425979500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9923189b-eb4a-470c-ab45-969435371000+10:9658:x1870622715037696:12345-192.168.204.12@tcp:101:touch.500 Request processed in 246us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965056.597908:0:6632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 24 00000100:00100000:0.0:1783965056.607788:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965056.607869:0:8738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715037824 00000100:00100000:2.0:1783965056.607879:0:8738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715037824 00000100:00100000:2.0:1783965056.607927:0:8738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 17 00000100:00100000:2.0:1783965056.607935:0:8738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9474368d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2356:x1870622715037824:12345-192.168.204.12@tcp:8:touch.500 00010000:00080000:2.0:1783965056.607970:0:8738:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 9923189b-eb4a-470c-ab45-969435371000@192.168.204.12@tcp t0 exp 0000000000000000 cur 290 last 0 00000020:00000080:2.0:1783965056.608004:0:8738:0:(genops.c:1406:class_connect()) connect: client 9923189b-eb4a-470c-ab45-969435371000, cookie 0xe782b916994fd5da 00002000:00100000:2.0:1783965056.608015:0:8738:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 9923189b-eb4a-470c-ab45-969435371000/ffff947429f77000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1783965056.608025:0:8738:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1783965056.608300:0:8738:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1783965056.608326:0:8738:0:(import.c:65:import_set_state_nolock()) ffff947429f76000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783965056.608400:0:8738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9474368d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9923189b-eb4a-470c-ab45-969435371000+6:2356:x1870622715037824:12345-192.168.204.12@tcp:8:touch.500 Request processed in 463us (621us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965056.608417:0:8738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 17 00000100:00100000:0.0:1783965056.618765:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965056.618871:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715037952 00000100:00100000:2.0:1783965056.618881:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715037952 00000100:00100000:2.0:1783965056.618960:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 18 00000100:00100000:2.0:1783965056.618972:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9474368d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9923189b-eb4a-470c-ab45-969435371000+6:0:x1870622715037952:12345-192.168.204.12@tcp:2:touch.500 00000100:00080000:1.0:1783965056.621485:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:0.0:1783965056.668465:0:7523:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00100000:0.0:1783965056.668482:0:7523:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 9923189b-eb4a-470c-ab45-969435371000 00000100:00100000:3.0:1783965056.668760:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9474368d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9923189b-eb4a-470c-ab45-969435371000+5:0:x1870622715037952:12345-192.168.204.12@tcp:2:touch.500 Request processed in 49786us (50001us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1783965056.668771:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 18 00000100:00100000:3.0:1783965056.675045:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965056.675166:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715038208 00000100:00100000:2.0:1783965056.675177:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715038208 00000100:00100000:2.0:1783965056.675265:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 2 00000100:00100000:2.0:1783965056.675276:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436c3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9923189b-eb4a-470c-ab45-969435371000+10:9658:x1870622715038208:12345-192.168.204.12@tcp:35:touch.500 00000100:00100000:2.0:1783965056.675752:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436c3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9923189b-eb4a-470c-ab45-969435371000+11:9658:x1870622715038208:12345-192.168.204.12@tcp:35:touch.500 Request processed in 476us (723us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1783965056.675765:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 2 00010000:00010000:3.0:1783965056.683430:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783965056.691485:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965056.691673:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715038336 00000100:00100000:2.0:1783965056.691683:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715038336 00000100:00100000:2.0:1783965056.691746:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 25 00000100:00100000:2.0:1783965056.691756:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9474368d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9923189b-eb4a-470c-ab45-969435371000+11:9659:x1870622715038336:12345-192.168.204.12@tcp:101:rm.0 00010000:00010000:2.0:1783965056.691781:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783965056.691801:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947425975600/0xe782b916994fd5e1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5eff24 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965056.691866:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff947425975a00/0xe782b916994fd5e8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965056.691880:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947425975a00/0xe782b916994fd5e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965056.691891:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947425975a00/0xe782b916994fd5e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783965056.691970:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1783965056.691974:0:5812:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1783965056.692019:0:5812:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff947425975a00/0xe782b916994fd5e8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965056.692046:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947425975600/0xe782b916994fd5e1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5eff24 expref: 13 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965056.692067:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff947425975a00/0xe782b916994fd5e8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5eff24 expref: 12 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965056.692076:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff947407b5c800) 00010000:00010000:2.0:1783965056.692079:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783965056.692082:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff947425975a00, rc 0) 00000100:00100000:2.0:1783965056.692252:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9474368d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9923189b-eb4a-470c-ab45-969435371000+12:9659:x1870622715038336:12345-192.168.204.12@tcp:101:rm.0 Request processed in 497us (776us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965056.692260:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 25 00000100:00100000:2.0:1783965056.697885:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965056.697977:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715038592 00000100:00100000:1.0:1783965056.697989:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715038592 00000100:00100000:1.0:1783965056.698055:0:6632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 26 00000100:00100000:1.0:1783965056.698065:0:6632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947407294380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9923189b-eb4a-470c-ab45-969435371000+12:9659:x1870622715038592:12345-192.168.204.12@tcp:101:rm.0 00010000:00010000:1.0:1783965056.698088:0:6632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783965056.698117:0:6632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef400/0xe782b916994fd5ef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5eff2b expref: -99 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783965056.698293:0:6632:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:1.0:1783965056.698479:0:6632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef400/0xe782b916994fd5ef lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5eff2b expref: 14 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965056.698494:0:6632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff947407b5cf00) 00010000:00010000:1.0:1783965056.698496:0:6632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783965056.698506:0:6632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef400/0xe782b916994fd5ef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5eff2b expref: 14 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965056.698526:0:6632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94743d9ef400, rc 0) 00000100:00100000:1.0:1783965056.698593:0:6632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947407294380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9923189b-eb4a-470c-ab45-969435371000+13:9659:x1870622715038592:12345-192.168.204.12@tcp:101:rm.0 Request processed in 529us (716us total) trans 4294967303 rc 301/301 00000100:00100000:1.0:1783965056.698607:0:6632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 26 00000100:00100000:3.0:1783965056.707825:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783965056.712828:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715038720 00000100:00100000:0.0:1783965056.712845:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715038720 00000100:00100000:0.0:1783965056.712921:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 3 00000100:00100000:0.0:1783965056.712932:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436c3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9923189b-eb4a-470c-ab45-969435371000+13:9659:x1870622715038720:12345-192.168.204.12@tcp:37:rm.0 00000100:00100000:2.0:1783965056.722182:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436c3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9923189b-eb4a-470c-ab45-969435371000+13:9659:x1870622715038720:12345-192.168.204.12@tcp:37:rm.0 Request processed in 9237us (14352us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965056.722226:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 3 00000100:00100000:2.0:1783965056.726434:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965056.726619:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715038976 00000100:00100000:1.0:1783965056.726629:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715038976 00000100:00100000:1.0:1783965056.726874:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 4 00000100:00100000:1.0:1783965056.726886:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94740638dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9923189b-eb4a-470c-ab45-969435371000+13:9659:x1870622715038976:12345-192.168.204.12@tcp:35:rm.0 00000100:00100000:1.0:1783965056.727399:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94740638dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9923189b-eb4a-470c-ab45-969435371000+14:9659:x1870622715038976:12345-192.168.204.12@tcp:35:rm.0 Request processed in 514us (973us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1783965056.727408:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 4 00000100:00100000:3.0:1783965056.731428:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783965056.731498:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715039232 00000100:00100000:0.0:1783965056.731507:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715039232 00000100:00100000:0.0:1783965056.731662:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 27 00000100:00100000:0.0:1783965056.731673:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436c3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9923189b-eb4a-470c-ab45-969435371000+14:9659:x1870622715039232:12345-192.168.204.12@tcp:101:rm.0 00010000:00010000:0.0:1783965056.731698:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783965056.731719:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947430c10a00/0xe782b916994fd5fd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5eff32 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965056.731845:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff947430c10e00/0xe782b916994fd604 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965056.731863:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947430c10e00/0xe782b916994fd604 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965056.731875:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947430c10e00/0xe782b916994fd604 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783965056.731887:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:0.0:1783965056.732959:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947430c10a00/0xe782b916994fd5fd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5eff32 expref: 17 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965056.732988:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff947430c10e00/0xe782b916994fd604 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5eff32 expref: 16 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965056.732997:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff947407b5c800) 00010000:00010000:0.0:1783965056.733000:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1783965056.733003:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff947430c10e00, rc 0) 00000100:00100000:1.0:1783965056.734402:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436c3d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9923189b-eb4a-470c-ab45-969435371000+16:9659:x1870622715039232:12345-192.168.204.12@tcp:101:rm.0 Request processed in 2723us (2977us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1783965056.734413:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 27 00000100:00100000:0.0:1783965056.737765:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965056.737923:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715039360 00000100:00100000:3.0:1783965056.737934:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715039360 00000100:00100000:3.0:1783965056.737996:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 28 00000100:00100000:3.0:1783965056.738006:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743706c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9923189b-eb4a-470c-ab45-969435371000+16:9659:x1870622715039360:12345-192.168.204.12@tcp:41:rm.0 00000004:00000024:3.0:1783965056.738067:0:5813:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:3.0:1783965056.738276:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743706c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9923189b-eb4a-470c-ab45-969435371000+16:9659:x1870622715039360:12345-192.168.204.12@tcp:41:rm.0 Request processed in 270us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965056.738284:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 28 00000100:00100000:0.0:1783965056.742321:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965056.742535:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715039488 00000100:00100000:1.0:1783965056.742545:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715039488 00000100:00100000:1.0:1783965056.742620:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 29 00000100:00100000:1.0:1783965056.742629:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743706fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9923189b-eb4a-470c-ab45-969435371000+16:9659:x1870622715039488:12345-192.168.204.12@tcp:101:rm.0 00010000:00010000:1.0:1783965056.742648:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783965056.742669:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994fd612 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5eff39 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965056.742734:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef200/0xe782b916994fd619 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965056.742749:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef200/0xe782b916994fd619 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965056.742762:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef200/0xe782b916994fd619 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965056.742793:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee000/0xe782b916994fd620 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0xc6b52abd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965056.742801:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee000/0xe782b916994fd620 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xc6b52abd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965056.742809:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee000/0xe782b916994fd620 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xc6b52abd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965056.743337:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eea00/0xe782b916994fd627 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965056.743347:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eea00/0xe782b916994fd627 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965056.743355:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eea00/0xe782b916994fd627 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783965056.743384:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:1.0:1783965056.743389:0:5812:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1783965056.743404:0:5812:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eea00/0xe782b916994fd627 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965056.743414:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eea00/0xe782b916994fd627 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965056.743422:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef200/0xe782b916994fd619 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965056.743428:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef200/0xe782b916994fd619 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965056.743448:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef200/0xe782b916994fd619 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965056.743454:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743d9ef200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1783965056.743458:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef200/0xe782b916994fd619 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965056.743466:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef200/0xe782b916994fd619 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965056.743477:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff947407b5c800) 00010000:00010000:1.0:1783965056.743480:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783965056.743484:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef200/0xe782b916994fd619 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965056.743490:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef200/0xe782b916994fd619 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965056.743504:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee000/0xe782b916994fd620 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xc6b52abd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965056.743509:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee000/0xe782b916994fd620 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xc6b52abd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965056.743514:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee000/0xe782b916994fd620 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xc6b52abd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965056.743518:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743d9ee000 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1783965056.743521:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee000/0xe782b916994fd620 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xc6b52abd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965056.743535:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee000/0xe782b916994fd620 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xc6b52abd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965056.743543:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xc6b52abd (ffff947407b5ce00) 00010000:00010000:1.0:1783965056.743545:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783965056.743548:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee000/0xe782b916994fd620 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xc6b52abd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965056.743554:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee000/0xe782b916994fd620 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xc6b52abd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965056.743669:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994fd612 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5eff39 expref: 18 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965056.743684:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eea00/0xe782b916994fd627 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5eff39 expref: 17 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965056.743692:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff947402a2d700) 00010000:00010000:1.0:1783965056.743694:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783965056.743696:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94743d9eea00, rc 0) 00000100:00100000:1.0:1783965056.743807:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743706fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9923189b-eb4a-470c-ab45-969435371000+17:9659:x1870622715039488:12345-192.168.204.12@tcp:101:rm.0 Request processed in 1178us (1497us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965056.743815:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 29 00000100:00100000:1.0:1783965056.748837:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965056.749034:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715039744 00000100:00100000:2.0:1783965056.749044:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715039744 00000100:00100000:2.0:1783965056.749105:0:6632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 30 00000100:00100000:2.0:1783965056.749116:0:6632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94742597b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9923189b-eb4a-470c-ab45-969435371000+17:9659:x1870622715039744:12345-192.168.204.12@tcp:36:rm.0 00010000:00010000:2.0:1783965056.749172:0:6632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1783965056.749249:0:6632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eea00/0xe782b916994fd627 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5eff39 expref: 17 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965056.749278:0:6632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947425974000/0xe782b916994fd5d3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5eff1d expref: 16 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965056.749291:0:6632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff947402a2d700) 00010000:00010000:2.0:1783965056.749309:0:6632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947425975a00/0xe782b916994fd5e8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5eff24 expref: 15 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965056.749318:0:6632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff947407b5c800) 00010000:00010000:2.0:1783965056.749322:0:6632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783965056.749343:0:6632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff947425975800/0xe782b916994fd62e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965056.749357:0:6632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947425975800/0xe782b916994fd62e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965056.749367:0:6632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947425975800/0xe782b916994fd62e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965056.749381:0:6632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff947425974a00/0xe782b916994fd635 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xc6b52abd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965056.749388:0:6632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947425974a00/0xe782b916994fd635 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xc6b52abd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965056.749406:0:6632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947425974a00/0xe782b916994fd635 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xc6b52abd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965056.749533:0:6632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff947425975600/0xe782b916994fd63c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965056.749546:0:6632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947425975600/0xe782b916994fd63c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965056.749553:0:6632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947425975600/0xe782b916994fd63c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783965056.751159:0:6632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:2.0:1783965056.751175:0:6632:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 290979973229ns, next at 291979970458ns, rc = 0 00010000:00010000:2.0:1783965056.751355:0:6632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e800/0xe782b916994fd643 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965056.751370:0:6632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e800/0xe782b916994fd643 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965056.751381:0:6632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e800/0xe782b916994fd643 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965056.752092:0:6632:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e800/0xe782b916994fd643 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965056.752100:0:6632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e800/0xe782b916994fd643 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965056.752107:0:6632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e800/0xe782b916994fd643 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965056.752193:0:6632:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783965056.752255:0:6632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff947425975600/0xe782b916994fd63c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965056.752262:0:6632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff947425975600/0xe782b916994fd63c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965056.752281:0:6632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff947425975600/0xe782b916994fd63c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965056.752289:0:6632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947425975600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1783965056.752294:0:6632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947425975600/0xe782b916994fd63c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965056.752303:0:6632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947425975600/0xe782b916994fd63c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965056.752320:0:6632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff947402a2da00) 00010000:00010000:2.0:1783965056.752323:0:6632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1783965056.752328:0:6632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff947425975600/0xe782b916994fd63c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965056.752335:0:6632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947425975600/0xe782b916994fd63c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965056.752373:0:6632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff947425975800/0xe782b916994fd62e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965056.752381:0:6632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff947425975800/0xe782b916994fd62e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965056.752388:0:6632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff947425975800/0xe782b916994fd62e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965056.752393:0:6632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947425975800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1783965056.752396:0:6632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947425975800/0xe782b916994fd62e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965056.752411:0:6632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947425975800/0xe782b916994fd62e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965056.752420:0:6632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff947407b5c800) 00010000:00010000:2.0:1783965056.752422:0:6632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783965056.752426:0:6632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff947425975800/0xe782b916994fd62e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965056.752431:0:6632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947425975800/0xe782b916994fd62e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783965056.752442:0:6632:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000002c3ffd6 reply state 00000000b3b3c1ce transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff947425974a00/0xe782b916994fd635 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xc6b52abd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783965056.752453:0:6632:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783965056.752573:0:6632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94742597b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9923189b-eb4a-470c-ab45-969435371000+16:9659:x1870622715039744:12345-192.168.204.12@tcp:36:rm.0 Request processed in 3452us (3740us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1783965056.752584:0:6632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 30 00010000:00010000:0.0:1783965056.753566:0:5801:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783965056.753577:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e800/0xe782b916994fd643 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965056.753585:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743fb8e800 already unused, calling callback (ffffffffc168d230) 00010000:00010000:0.0:1783965056.753589:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e800/0xe782b916994fd643 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965056.753599:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e800/0xe782b916994fd643 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965056.753622:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff947402a2da00) 00010000:00010000:0.0:1783965056.753625:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1783965056.753628:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e800/0xe782b916994fd643 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965056.753635:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e800/0xe782b916994fd643 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965056.753656:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783965056.753672:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783965056.753674:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783965056.756303:0:3308:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff947425974a00/0xe782b916994fd635 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xc6b52abd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965056.756321:0:3308:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff947425974a00/0xe782b916994fd635 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xc6b52abd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965056.756329:0:3308:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff947425974a00/0xe782b916994fd635 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xc6b52abd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965056.756336:0:3308:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947425974a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1783965056.756341:0:3308:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947425974a00/0xe782b916994fd635 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xc6b52abd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965056.756349:0:3308:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947425974a00/0xe782b916994fd635 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xc6b52abd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965056.756366:0:3308:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xc6b52abd (ffff947402a2d200) 00010000:00010000:3.0:1783965056.756370:0:3308:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783965056.756375:0:3308:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff947425974a00/0xe782b916994fd635 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xc6b52abd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965056.756382:0:3308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947425974a00/0xe782b916994fd635 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xc6b52abd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783965056.759719:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783965056.760051:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715040000 00000100:00100000:0.0:1783965056.760061:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715040000 00000100:00100000:0.0:1783965056.760967:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 5 00000100:00100000:0.0:1783965056.760981:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947425979c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9923189b-eb4a-470c-ab45-969435371000+15:9659:x1870622715040000:12345-192.168.204.12@tcp:35:rm.0 00000100:00100000:0.0:1783965056.761271:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947425979c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9923189b-eb4a-470c-ab45-969435371000+16:9659:x1870622715040000:12345-192.168.204.12@tcp:35:rm.0 Request processed in 292us (1563us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1783965056.761279:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 5 00000100:00100000:1.0:1783965056.773000:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965056.773093:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715040256 00000100:00100000:3.0:1783965056.773104:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715040256 00000100:00100000:3.0:1783965056.773170:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 31 00000100:00100000:3.0:1783965056.773181:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947425979180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9923189b-eb4a-470c-ab45-969435371000+16:9659:x1870622715040256:12345-192.168.204.12@tcp:36:rm.0 00010000:00010000:3.0:1783965056.773289:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1783965056.773323:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947430c10e00/0xe782b916994fd604 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5eff32 expref: 16 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965056.773366:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efe00/0xe782b916994fd5a2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5eff0f expref: 15 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965056.773581:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff947407b5c800) 00010000:00010000:3.0:1783965056.773605:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee400/0xe782b916994fd563 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5eff01 expref: 14 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965056.773629:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff947407b5cf00) 00010000:00010000:3.0:1783965056.773635:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783965056.774342:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff947430c11000/0xe782b916994fd64a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965056.774729:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947430c11000/0xe782b916994fd64a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965056.774741:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947430c11000/0xe782b916994fd64a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965056.774757:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff947430c10000/0xe782b916994fd651 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965056.774763:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947430c10000/0xe782b916994fd651 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965056.774769:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947430c10000/0xe782b916994fd651 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965056.776915:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff947430c10a00/0xe782b916994fd658 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965056.777339:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947430c10a00/0xe782b916994fd658 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965056.777422:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947430c10a00/0xe782b916994fd658 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783965056.778578:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:0.0:1783965056.778599:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff947430c10a00/0xe782b916994fd658 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965056.778619:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff947430c10a00/0xe782b916994fd658 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965056.778627:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff947430c10a00/0xe782b916994fd658 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965056.778632:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947430c10a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1783965056.778637:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947430c10a00/0xe782b916994fd658 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965056.778644:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947430c10a00/0xe782b916994fd658 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965056.778658:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff94740a90c700) 00010000:00010000:0.0:1783965056.778661:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1783965056.778665:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff947430c10a00/0xe782b916994fd658 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965056.778671:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947430c10a00/0xe782b916994fd658 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965056.778694:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff947430c11000/0xe782b916994fd64a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965056.778699:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff947430c11000/0xe782b916994fd64a lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965056.778714:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff947430c11000/0xe782b916994fd64a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965056.778719:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947430c11000 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1783965056.778721:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947430c11000/0xe782b916994fd64a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965056.778726:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947430c11000/0xe782b916994fd64a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965056.778734:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94740a90c000) 00010000:00010000:0.0:1783965056.778736:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783965056.778738:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff947430c11000/0xe782b916994fd64a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965056.778744:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947430c11000/0xe782b916994fd64a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783965056.778755:0:5811:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007f032a8b reply state 000000005a089eeb transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff947430c10000/0xe782b916994fd651 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783965056.778763:0:5811:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783965056.779496:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947425979180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9923189b-eb4a-470c-ab45-969435371000+15:9659:x1870622715040256:12345-192.168.204.12@tcp:36:rm.0 Request processed in 6311us (6502us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1783965056.779518:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 31 00010000:00010000:3.0:1783965056.785635:0:3309:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff947430c10000/0xe782b916994fd651 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965056.785653:0:3309:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff947430c10000/0xe782b916994fd651 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965056.785661:0:3309:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff947430c10000/0xe782b916994fd651 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965056.785668:0:3309:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947430c10000 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1783965056.785673:0:3309:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947430c10000/0xe782b916994fd651 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965056.785681:0:3309:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947430c10000/0xe782b916994fd651 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965056.785698:0:3309:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff94740a90ca00) 00010000:00010000:3.0:1783965056.785701:0:3309:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783965056.785706:0:3309:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff947430c10000/0xe782b916994fd651 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965056.785729:0:3309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947430c10000/0xe782b916994fd651 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783965057.579369:0:3325:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783965057.579394:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947407297100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3325:1870622732897152:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783965057.579468:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783965057.579554:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732897152 00000100:00100000:2.0:1783965057.579561:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732897152 00000100:00100000:2.0:1783965057.579647:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1783965057.579664:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947407295500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3325:x1870622732897152:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783965057.579702:0:6611:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783965057.579755:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947407295500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3325:x1870622732897152:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965057.579780:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:2.0:1783965057.579833:0:3325:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff947407297100 x1870622732897152/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783965073 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783965057.579855:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947407297100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3325:1870622732897152:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1783965057.579992:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1783965057.708010:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783965057.912514:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965057.912541:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965057.912567:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965057.912606:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965057.912637:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715040384 00000100:00100000:1.0:1783965057.912646:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715040384 00000100:00100000:1.0:1783965057.912705:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 246 00000100:00100000:1.0:1783965057.912715:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947405a4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+13:2358:x1870622715040384:12345-192.168.204.12@tcp:400:kworker.0 00000100:00100000:1.0:1783965057.912802:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947405a4d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+13:2358:x1870622715040384:12345-192.168.204.12@tcp:400:kworker.0 Request processed in 89us (233us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965057.912811:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 246 00000100:00100000:1.0:1783965057.912857:0:8738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715040640 00000100:00100000:1.0:1783965057.912862:0:8738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715040640 00000100:00100000:1.0:1783965057.912891:0:8738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 47 00000100:00100000:1.0:1783965057.912897:0:8738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9474057dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9923189b-eb4a-470c-ab45-969435371000+5:2358:x1870622715040640:12345-192.168.204.12@tcp:400:kworker.0 00000100:00100000:1.0:1783965057.912926:0:8738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9474057dbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9923189b-eb4a-470c-ab45-969435371000+5:2358:x1870622715040640:12345-192.168.204.12@tcp:400:kworker.0 Request processed in 29us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965057.912932:0:8738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 47 00000100:00100000:3.0:1783965057.914512:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715040512 00000100:00100000:3.0:1783965057.914526:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715040512 00000100:00100000:3.0:1783965057.914582:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715040768 00000100:00100000:3.0:1783965057.914594:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715040768 00000100:00100000:3.0:1783965057.914630:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 95 00000100:00100000:3.0:1783965057.914639:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743715d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9923189b-eb4a-470c-ab45-969435371000+14:2358:x1870622715040512:12345-192.168.204.12@tcp:400:kworker.0 00000100:00100000:3.0:1783965057.914729:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743715d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9923189b-eb4a-470c-ab45-969435371000+14:2358:x1870622715040512:12345-192.168.204.12@tcp:400:kworker.0 Request processed in 92us (2223us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965057.914735:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 95 00000100:00100000:3.0:1783965057.914753:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 96 00000100:00100000:3.0:1783965057.914759:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9474057d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49bbacc1-b013-4591-8d15-02f4f0d1884e+5:2358:x1870622715040768:12345-192.168.204.12@tcp:400:kworker.0 00000100:00100000:3.0:1783965057.914783:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9474057d9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49bbacc1-b013-4591-8d15-02f4f0d1884e+5:2358:x1870622715040768:12345-192.168.204.12@tcp:400:kworker.0 Request processed in 25us (2242us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965057.914788:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 96 00000100:00080000:1.0:1783965057.915069:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1783965058.742724:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783965059.756331:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1783965060.651739:0:7973:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 294880534624ns, next at 295880532222ns, rc = 0 00000100:00100000:1.0:1783965060.651782:0:3324:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783965060.651809:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947436336680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3324:1870622732897280:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783965060.651908:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783965060.651976:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732897280 00000100:00100000:1.0:1783965060.651984:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732897280 00000100:00100000:1.0:1783965060.652038:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1783965060.652048:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436334380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3324:x1870622732897280:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783965060.652090:0:6611:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783965060.652136:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436334380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3324:x1870622732897280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (228us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965060.652144:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00080000:1.0:1783965060.652167:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1783965060.652196:0:3324:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff947436336680 x1870622732897280/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783965076 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783965060.652237:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947436336680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3324:1870622732897280:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783965060.655222:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947436337100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3323:1870622732897536:0@lo:400:kworker.0 00000100:00100000:1.0:1783965060.655288:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783965060.655322:0:3323:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1783965060.655328:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947436336680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ae0997f7-3a15-4fc6-865a-35b2f101956e:3323:1870622732897408:0@lo:400:kworker.0 00000100:00100000:1.0:1783965060.655353:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783965060.655373:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947436335180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3323:1870622732897920:0@lo:400:kworker.0 00000100:00100000:1.0:1783965060.655391:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783965060.655418:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732897536 00000100:00100000:1.0:1783965060.655424:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732897536 00000100:00100000:1.0:1783965060.655459:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732897920 00000100:00100000:1.0:1783965060.655462:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732897920 00000100:00100000:1.0:1783965060.655486:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1783965060.655493:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947429f9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3323:x1870622732897536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783965060.655563:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947429f9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3323:x1870622732897536:12345-0@lo:400:kworker.0 Request processed in 69us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965060.655571:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1783965060.655586:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1783965060.655592:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947429f9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3323:x1870622732897920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783965060.655617:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947429f9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3323:x1870622732897920:12345-0@lo:400:kworker.0 Request processed in 25us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965060.655622:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00080000:1.0:1783965060.655641:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783965060.655669:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947436335180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3323:1870622732897920:0@lo:400:kworker.0 00000100:00100000:1.0:1783965060.655678:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947436337100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3323:1870622732897536:0@lo:400:kworker.0 00000100:00100000:1.0:1783965060.655709:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947436334700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3324:1870622732897664:0@lo:400:kworker.0 00000100:00100000:1.0:1783965060.655732:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783965060.655748:0:3324:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783965060.655753:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947436334000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3324:1870622732897792:0@lo:400:kworker.0 00000100:00100000:1.0:1783965060.655773:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783965060.656776:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732897408 00000100:00100000:0.0:1783965060.656786:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732897408 00000100:00100000:0.0:1783965060.656833:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:0.0:1783965060.656841:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947405a4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+19:3323:x1870622732897408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783965060.656894:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947405a4e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+19:3323:x1870622732897408:12345-0@lo:400:kworker.0 Request processed in 55us (1540us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965060.656901:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:2.0:1783965060.657052:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732897664 00000100:00100000:2.0:1783965060.657058:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732897664 00000100:00100000:2.0:1783965060.657104:0:6632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:2.0:1783965060.657111:0:6632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947429f98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3324:x1870622732897664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783965060.657151:0:6632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947429f98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3324:x1870622732897664:12345-0@lo:400:kworker.0 Request processed in 41us (1418us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965060.657156:0:6632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00080000:2.0:1783965060.657178:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783965060.657358:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947436336680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ae0997f7-3a15-4fc6-865a-35b2f101956e:3323:1870622732897408:0@lo:400:kworker.0 00000100:00100000:1.0:1783965060.657732:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947436334700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3324:1870622732897664:0@lo:400:kworker.0 00000100:00100000:3.0:1783965060.658166:0:6609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732897792 00000100:00100000:3.0:1783965060.658173:0:6609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732897792 00000100:00100000:3.0:1783965060.658255:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1783965060.658264:0:6609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947429f99180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3324:x1870622732897792:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783965060.658320:0:6609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947429f99180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3324:x1870622732897792:12345-0@lo:400:kworker.0 Request processed in 58us (2545us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965060.658328:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:3.0:1783965060.658362:0:3324:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff947436334000 x1870622732897792/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783965076 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783965060.658382:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947436334000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3324:1870622732897792:0@lo:400:kworker.0 00000100:00080000:2.0:1783965060.658835:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1783965060.782637:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1783965061.159762:0:11495:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000001:00080000:1.0:1783965061.728877:0:5835:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:1.0:1783965061.728901:0:5835:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000004:00080000:1.0:1783965061.729115:0:5835:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:0.0:1783965061.730452:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783965061.730483:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743706dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3322:1870622732898048:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1783965061.730577:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783965061.730648:0:8738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732898048 00000100:00100000:0.0:1783965061.730657:0:8738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732898048 00000100:00100000:1.0:1783965061.733534:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1783965061.733559:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743706ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3322:x1870622732898048:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1783965061.733594:0:6608:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:1.0:1783965061.733633:0:6608:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a552580, atime: 0x6a552580, ctime: 0x6a552580, blocks: 0x1 00010000:00010000:1.0:1783965061.733655:0:6608:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001c82bdd1/0xe782b916994fd65f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965061.733745:0:6608:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=295s v=(0 0) 00010000:00010000:1.0:1783965061.733749:0:6608:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783965061.733756:0:6608:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001c82bdd1/0xe782b916994fd65f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965061.733775:0:6608:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001c82bdd1/0xe782b916994fd65f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965061.733785:0:6608:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001c82bdd1/0xe782b916994fd65f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965061.733792:0:6608:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001c82bdd1/0xe782b916994fd65f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965061.733809:0:6608:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1783965061.737641:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743706ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3322:x1870622732898048:12345-0@lo:6:osp-syn-1-0.0 Request processed in 4086us (7056us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1783965061.737655:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00010000:1.0:1783965061.737772:0:5800:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783965061.737780:0:5800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001c82bdd1/0xe782b916994fd65f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965061.737793:0:5800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743d9eea00 already unused, calling callback (ffffffffc168d230) 00010000:00010000:1.0:1783965061.737798:0:5800:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001c82bdd1/0xe782b916994fd65f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965061.737818:0:5800:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001c82bdd1/0xe782b916994fd65f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965061.737839:0:5800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001c82bdd1/0xe782b916994fd65f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965061.737846:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001c82bdd1/0xe782b916994fd65f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965061.737893:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783965061.737895:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783965061.737897:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1783965061.739247:0:3322:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94743706dc00/2, rc 0, transno 4294967300 00000100:00100000:0.0:1783965061.739261:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743706dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3322:1870622732898048:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1783965061.803446:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1783965062.316832:0:11544:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc4c2deb10 20000000:00000080:3.0:1783965062.317039:0:11544:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff947305c12c00 uarg=0000000000000000 20000000:01000000:3.0:1783965062.317073:0:11544:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1783965062.317079:0:11544:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:3.0:1783965062.317085:0:11544:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:3.0:1783965062.320104:0:11545:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:2.0:1783965062.321450:0:11544:0:(mgs_llog.c:4116:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:3.0:1783965062.338729:0:11544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:3.0:1783965062.338792:0:11544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:3.0:1783965062.338853:0:11544:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:3.0:1783965062.338873:0:11544:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1783965062.338893:0:11544:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff947436f27600/0xe782b916994fd666 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965062.338913:0:11544:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff947425974400/0xe782b916994fd501 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5efeec expref: 12 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965062.345026:0:11544:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff947430c10200/0xe782b916994fd508 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5efef3 expref: 12 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965062.345039:0:11544:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff947425974e00/0xe782b916994fd516 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe782b916994fd50f expref: 18 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965062.345046:0:11544:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff947425974600/0xe782b916994fd524 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe782b916994fd51d expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965062.345053:0:11544:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff947425974c00/0xe782b916994fd532 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe782b916994fd52b expref: 18 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965062.345085:0:11544:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff947436f27600/0xe782b916994fd666 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965062.345132:0:11544:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff947425974c00/0xe782b916994fd532 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe782b916994fd52b expref: 18 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965062.345147:0:11544:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff947425974c00/0xe782b916994fd532 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe782b916994fd52b expref: 18 pid: 5807 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783965062.345164:0:11544:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947436c3f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11544:1870622732898176:0@lo:104: 00000100:00100000:3.0:1783965062.345258:0:11544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783965062.345331:0:11544:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff947425974600/0xe782b916994fd524 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe782b916994fd51d expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965062.345339:0:11544:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff947425974600/0xe782b916994fd524 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe782b916994fd51d expref: 18 pid: 5805 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783965062.345347:0:11544:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947436c3c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11544:1870622732898304:0@lo:104: 00000100:00100000:3.0:1783965062.345369:0:11544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1783965062.345390:0:11544:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff947425974e00/0xe782b916994fd516 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe782b916994fd50f expref: 18 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965062.345397:0:11544:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff947425974e00/0xe782b916994fd516 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe782b916994fd50f expref: 18 pid: 5807 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783965062.345405:0:11544:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947436c3dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11544:1870622732898432:0@lo:104: 00000100:00100000:3.0:1783965062.345432:0:11544:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783965062.345473:0:8329:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1783965062.345486:0:8329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732898176 00000100:00100000:3.0:1783965062.345498:0:8329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732898176 00000100:00100000:3.0:1783965062.345552:0:8329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732898304 00000100:00100000:3.0:1783965062.345556:0:8329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732898304 00000100:00100000:3.0:1783965062.345565:0:8329:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732898432 00000100:00100000:3.0:1783965062.345568:0:8329:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732898432 00000100:00100000:3.0:1783965062.345582:0:8329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1783965062.345590:0:8329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436c3d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:ae0997f7-3a15-4fc6-865a-35b2f101956e+5:11544:x1870622732898176:12345-0@lo:104: 00010000:00010000:3.0:1783965062.345602:0:8329:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.112@tcp lock: ffff94743d9efa00/0xe782b916994fd52b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe782b916994fd532 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965062.345647:0:8329:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1783965062.345654:0:8329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436c3d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:ae0997f7-3a15-4fc6-865a-35b2f101956e+5:11544:x1870622732898176:12345-0@lo:104: Request processed in 65us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965062.345660:0:8329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1783965062.345678:0:8329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1783965062.345685:0:8329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436c3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:ae0997f7-3a15-4fc6-865a-35b2f101956e+4:11544:x1870622732898304:12345-0@lo:104: 00010000:00010000:3.0:1783965062.345692:0:8329:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.112@tcp lock: ffff947436f27000/0xe782b916994fd51d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe782b916994fd524 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965062.345721:0:8329:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1783965062.345725:0:8329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436c3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:ae0997f7-3a15-4fc6-865a-35b2f101956e+4:11544:x1870622732898304:12345-0@lo:104: Request processed in 43us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965062.345731:0:8329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1783965062.345743:0:8329:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1783965062.345748:0:8329:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743fb2d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:ae0997f7-3a15-4fc6-865a-35b2f101956e+3:11544:x1870622732898432:12345-0@lo:104: 00010000:00010000:3.0:1783965062.345755:0:8329:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.112@tcp lock: ffff947436f26400/0xe782b916994fd50f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe782b916994fd516 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965062.345780:0:8329:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1783965062.345791:0:8329:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743fb2d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_003:ae0997f7-3a15-4fc6-865a-35b2f101956e+3:11544:x1870622732898432:12345-0@lo:104: Request processed in 43us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965062.345797:0:8329:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:3.0:1783965062.345854:0:11544:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff947430c10200/0xe782b916994fd508 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5efef3 expref: 12 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965062.345865:0:11544:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff947430c10200/0xe782b916994fd508 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5efef3 expref: 12 pid: 5807 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783965062.345875:0:11544:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947436c3d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11544:1870622732898560:192.168.204.12@tcp:104: 00010000:00010000:3.0:1783965062.345928:0:11544:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff947425974400/0xe782b916994fd501 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5efeec expref: 12 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965062.345937:0:11544:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff947425974400/0xe782b916994fd501 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5efeec expref: 12 pid: 5807 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783965062.345946:0:11544:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947436c3fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11544:1870622732898688:192.168.204.12@tcp:104: 00000100:00100000:3.0:1783965062.345988:0:11544:0:(client.c:2702:ptlrpc_set_wait()) set ffff9474400a3780 going to sleep for 11 seconds 00000100:00100000:3.0:1783965062.346009:0:11544:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947436c3f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11544:1870622732898176:0@lo:104: 00000100:00100000:3.0:1783965062.346018:0:11544:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947436c3c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11544:1870622732898304:0@lo:104: 00000100:00100000:3.0:1783965062.346024:0:11544:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947436c3dc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11544:1870622732898432:0@lo:104: 00010000:00010000:0.0:1783965062.346103:0:5801:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1783965062.346110:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.112@tcp lock: ffff94743d9efa00/0xe782b916994fd52b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe782b916994fd532 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965062.346118:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743d9efa00 already unused, calling callback (ffffffffc1ca8c20) 10000000:00010000:0.0:1783965062.346122:0:5801:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.112@tcp lock: ffff94743d9efa00/0xe782b916994fd52b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xe782b916994fd532 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965062.346130:0:5801:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.112@tcp lock: ffff94743d9efa00/0xe782b916994fd52b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xe782b916994fd532 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783965062.346137:0:5801:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.112@tcp lock: ffff94743d9efa00/0xe782b916994fd52b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xe782b916994fd532 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783965062.346142:0:5801:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1783965062.346178:0:5801:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.112@tcp lock: ffff94743d9efa00/0xe782b916994fd52b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe782b916994fd532 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965062.346184:0:5801:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783965062.346225:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.112@tcp lock: ffff94743d9efa00/0xe782b916994fd52b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe782b916994fd532 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965062.346242:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.112@tcp lock: ffff94743d9efa00/0xe782b916994fd52b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe782b916994fd532 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965062.346261:0:5801:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783965062.346264:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.112@tcp lock: ffff947436f27000/0xe782b916994fd51d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe782b916994fd524 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965062.346269:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947436f27000 already unused, calling callback (ffffffffc1ca8c20) 10000000:00010000:0.0:1783965062.346272:0:5801:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.112@tcp lock: ffff947436f27000/0xe782b916994fd51d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xe782b916994fd524 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965062.346278:0:5801:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.112@tcp lock: ffff947436f27000/0xe782b916994fd51d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xe782b916994fd524 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783965062.346284:0:5801:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.112@tcp lock: ffff947436f27000/0xe782b916994fd51d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xe782b916994fd524 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783965062.346289:0:5801:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1783965062.346302:0:5801:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.112@tcp lock: ffff947436f27000/0xe782b916994fd51d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe782b916994fd524 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965062.346308:0:5801:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783965062.346314:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.112@tcp lock: ffff947436f27000/0xe782b916994fd51d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe782b916994fd524 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965062.346321:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.112@tcp lock: ffff947436f27000/0xe782b916994fd51d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe782b916994fd524 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965062.346329:0:5801:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783965062.346337:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.112@tcp lock: ffff947436f26400/0xe782b916994fd50f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe782b916994fd516 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965062.346343:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947436f26400 already unused, calling callback (ffffffffc1ca8c20) 10000000:00010000:0.0:1783965062.346346:0:5801:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.112@tcp lock: ffff947436f26400/0xe782b916994fd50f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe782b916994fd516 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965062.346353:0:5801:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.112@tcp lock: ffff947436f26400/0xe782b916994fd50f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe782b916994fd516 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783965062.346359:0:5801:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.112@tcp lock: ffff947436f26400/0xe782b916994fd50f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe782b916994fd516 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783965062.346364:0:5801:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1783965062.346378:0:5801:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.112@tcp lock: ffff947436f26400/0xe782b916994fd50f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe782b916994fd516 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965062.346383:0:5801:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783965062.346399:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.112@tcp lock: ffff947436f26400/0xe782b916994fd50f lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe782b916994fd516 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965062.346405:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.112@tcp lock: ffff947436f26400/0xe782b916994fd50f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe782b916994fd516 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965062.346419:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783965062.346421:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783965062.346422:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783965062.346435:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743706ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ae0997f7-3a15-4fc6-865a-35b2f101956e:3324:1870622732898816:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783965062.346466:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783965062.346494:0:3324:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783965062.346514:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743706c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ae0997f7-3a15-4fc6-865a-35b2f101956e:3324:1870622732898944:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783965062.346543:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783965062.346569:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743706df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ae0997f7-3a15-4fc6-865a-35b2f101956e:3322:1870622732899072:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783965062.346597:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783965062.346628:0:8330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732898816 00000100:00100000:0.0:1783965062.346632:0:8330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732898816 00010000:00010000:0.0:1783965062.346651:0:8330:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff947425974c00/0xe782b916994fd532 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe782b916994fd52b expref: 19 pid: 5807 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783965062.346667:0:8330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732898944 00000100:00100000:0.0:1783965062.346669:0:8330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732898944 00010000:00010000:0.0:1783965062.346678:0:8330:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff947425974600/0xe782b916994fd524 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe782b916994fd51d expref: 20 pid: 5805 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783965062.346687:0:8330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732899072 00000100:00100000:0.0:1783965062.346689:0:8330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732899072 00010000:00010000:0.0:1783965062.346699:0:8330:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff947425974e00/0xe782b916994fd516 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe782b916994fd50f expref: 21 pid: 5807 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783965062.346709:0:8330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1783965062.346715:0:8330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743706c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ae0997f7-3a15-4fc6-865a-35b2f101956e+21:3324:x1870622732898816:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783965062.346723:0:8330:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783965062.346728:0:8330:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff947425974c00/0xe782b916994fd532 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe782b916994fd52b expref: 21 pid: 5807 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965062.346738:0:8330:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff947425974c00/0xe782b916994fd532 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe782b916994fd52b expref: 21 pid: 5807 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965062.346750:0:8330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff947425974c00/0xe782b916994fd532 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe782b916994fd52b expref: 21 pid: 5807 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965062.346771:0:8330:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783965062.346799:0:8330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743706c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ae0997f7-3a15-4fc6-865a-35b2f101956e+20:3324:x1870622732898816:12345-0@lo:103:ldlm_bl.0 Request processed in 84us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965062.346805:0:8330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1783965062.346819:0:8330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1783965062.346825:0:8330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743706e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ae0997f7-3a15-4fc6-865a-35b2f101956e+19:3324:x1870622732898944:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783965062.346832:0:8330:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783965062.346836:0:8330:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff947425974600/0xe782b916994fd524 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe782b916994fd51d expref: 19 pid: 5805 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965062.346845:0:8330:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff947425974600/0xe782b916994fd524 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe782b916994fd51d expref: 19 pid: 5805 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965062.346855:0:8330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff947425974600/0xe782b916994fd524 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe782b916994fd51d expref: 19 pid: 5805 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965062.346862:0:8330:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783965062.346882:0:8330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743706e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ae0997f7-3a15-4fc6-865a-35b2f101956e+18:3324:x1870622732898944:12345-0@lo:103:ldlm_bl.0 Request processed in 58us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965062.346888:0:8330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1783965062.346900:0:8330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1783965062.346905:0:8330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94741843fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ae0997f7-3a15-4fc6-865a-35b2f101956e+17:3322:x1870622732899072:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783965062.346912:0:8330:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783965062.346916:0:8330:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff947425974e00/0xe782b916994fd516 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe782b916994fd50f expref: 17 pid: 5807 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965062.346925:0:8330:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff947425974e00/0xe782b916994fd516 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe782b916994fd50f expref: 17 pid: 5807 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965062.346943:0:8330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff947425974e00/0xe782b916994fd516 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe782b916994fd50f expref: 17 pid: 5807 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965062.346951:0:8330:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783965062.346978:0:8330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94741843fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:ae0997f7-3a15-4fc6-865a-35b2f101956e+16:3322:x1870622732899072:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (379us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965062.346985:0:8330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1783965062.347036:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743706df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ae0997f7-3a15-4fc6-865a-35b2f101956e:3322:1870622732899072:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783965062.347059:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743706c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ae0997f7-3a15-4fc6-865a-35b2f101956e:3324:1870622732898944:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783965062.347066:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743706ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ae0997f7-3a15-4fc6-865a-35b2f101956e:3324:1870622732898816:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1783965062.347298:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783965062.352782:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965062.352973:0:8330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715040896 00000100:00100000:2.0:1783965062.352982:0:8330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715040896 00010000:00010000:2.0:1783965062.353021:0:8330:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff947430c10200/0xe782b916994fd508 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5efef3 expref: 13 pid: 5807 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783965062.353063:0:8330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 33 00000100:00100000:2.0:1783965062.353073:0:8330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947429f99500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+13:2359:x1870622715040896:12345-192.168.204.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783965062.353088:0:8330:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783965062.353095:0:8330:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff947430c10200/0xe782b916994fd508 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5efef3 expref: 13 pid: 5807 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965062.353123:0:8330:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff947430c10200/0xe782b916994fd508 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5efef3 expref: 13 pid: 5807 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965062.353143:0:8330:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783965062.353230:0:8330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947429f99500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+13:2359:x1870622715040896:12345-192.168.204.12@tcp:103:ldlm_bl.0 Request processed in 128us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965062.353239:0:8330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 33 00010000:00010000:3.0:1783965062.353692:0:11544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff947430c10200/0xe782b916994fd508 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5efef3 expref: 12 pid: 5807 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783965062.353708:0:11544:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947436c3d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11544:1870622732898560:192.168.204.12@tcp:104: 00000100:00100000:3.0:1783965062.353720:0:11544:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947436c3fb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11544:1870622732898688:192.168.204.12@tcp:104: 00010000:00010000:3.0:1783965062.353754:0:11544:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff947436f27600/0xe782b916994fd666 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783965062.353961:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965062.354068:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715041024 00000100:00100000:1.0:1783965062.354073:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715041024 00010000:00010000:1.0:1783965062.354097:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff947425974400/0xe782b916994fd501 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5efeec expref: 12 pid: 5807 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783965062.354128:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 34 00000100:00100000:1.0:1783965062.354136:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947407297100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+12:2357:x1870622715041024:12345-192.168.204.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783965062.354147:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783965062.354153:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff947425974400/0xe782b916994fd501 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5efeec expref: 12 pid: 5807 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965062.354162:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff947425974400/0xe782b916994fd501 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5efeec expref: 12 pid: 5807 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965062.354181:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff947425974400/0xe782b916994fd501 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5efeec expref: 12 pid: 5807 timeout: 396 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965062.354195:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff947436f27600/0xe782b916994fd666 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965062.354239:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff947436f27600/0xe782b916994fd666 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965062.354254:0:5797:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff947436f27600/0xe782b916994fd666 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965062.354261:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff947436f27600/0xe782b916994fd666 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965062.354267:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff947436f27600/0xe782b916994fd666 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965062.354274:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff947436f27600/0xe782b916994fd666 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965062.354280:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947436f27600 already unused, calling callback (ffffffffc168d230) 00010000:00010000:1.0:1783965062.354284:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff947436f27600/0xe782b916994fd666 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965062.354291:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff947436f27600/0xe782b916994fd666 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965062.354306:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff947436f27600/0xe782b916994fd666 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965062.354326:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783965062.354366:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947407297100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+11:2357:x1870622715041024:12345-192.168.204.12@tcp:103:ldlm_bl.0 Request processed in 230us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965062.354373:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 34 00010000:00010000:0.0:1783965062.357126:0:11544:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff947436f27600/0xe782b916994fd666 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965062.357146:0:11544:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff947436f27600/0xe782b916994fd666 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965062.357153:0:11544:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff947436f27600/0xe782b916994fd666 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11544 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783965062.699475:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783965062.699568:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947407296300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3322:1870622732899200:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783965062.699637:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783965062.701309:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732899200 00000100:00100000:2.0:1783965062.701322:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732899200 00000100:00100000:2.0:1783965062.701415:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1783965062.701426:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436c3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1870622732899200:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783965062.701464:0:6611:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783965062.701558:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436c3fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1870622732899200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 134us (1919us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965062.701565:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:0.0:1783965062.701649:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff947407296300 x1870622732899200/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783965078 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783965062.701668:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947407296300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3322:1870622732899200:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1783965062.701729:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1783965062.829730:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783965063.037240:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965063.037303:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783965063.037321:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715041280 00000100:00100000:0.0:1783965063.037331:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715041280 00000100:00100000:2.0:1783965063.037334:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965063.038599:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715041152 00000100:00100000:1.0:1783965063.038608:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715041152 00000100:00100000:1.0:1783965063.038663:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 248 00000100:00100000:1.0:1783965063.038673:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947405a4e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+11:2360:x1870622715041152:12345-192.168.204.12@tcp:400:kworker.0 00000100:00100000:1.0:1783965063.039286:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947405a4e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+11:2360:x1870622715041152:12345-192.168.204.12@tcp:400:kworker.0 Request processed in 612us (1980us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965063.039296:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 248 00000100:00080000:1.0:1783965063.039335:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783965063.039868:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715041536 00000100:00100000:0.0:1783965063.039888:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715041536 00000100:00100000:0.0:1783965063.039933:0:6632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 100 00000100:00100000:0.0:1783965063.039942:0:6632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947407295880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9923189b-eb4a-470c-ab45-969435371000+5:2359:x1870622715041280:12345-192.168.204.12@tcp:400:kworker.0 00000100:00100000:0.0:1783965063.039994:0:6632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947407295880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9923189b-eb4a-470c-ab45-969435371000+5:2359:x1870622715041280:12345-192.168.204.12@tcp:400:kworker.0 Request processed in 54us (3126us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965063.040001:0:6632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 100 00000100:00100000:0.0:1783965063.040015:0:6632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 101 00000100:00100000:0.0:1783965063.040023:0:6632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947407295c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49bbacc1-b013-4591-8d15-02f4f0d1884e+5:2359:x1870622715041536:12345-192.168.204.12@tcp:400:kworker.0 00000100:00100000:0.0:1783965063.040051:0:6632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947407295c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49bbacc1-b013-4591-8d15-02f4f0d1884e+5:2359:x1870622715041536:12345-192.168.204.12@tcp:400:kworker.0 Request processed in 29us (2715us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965063.040058:0:6632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 101 00000100:00100000:2.0:1783965063.040192:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965063.040236:0:6609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715041408 00000100:00100000:2.0:1783965063.040241:0:6609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715041408 00000100:00100000:2.0:1783965063.040276:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 49 00000100:00100000:2.0:1783965063.040283:0:6609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947407294a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9923189b-eb4a-470c-ab45-969435371000+5:2360:x1870622715041408:12345-192.168.204.12@tcp:400:kworker.0 00000100:00100000:2.0:1783965063.040312:0:6609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947407294a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9923189b-eb4a-470c-ab45-969435371000+5:2360:x1870622715041408:12345-192.168.204.12@tcp:400:kworker.0 Request processed in 29us (1406us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965063.040329:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 49 00000100:00080000:1.0:1783965063.040562:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783965063.040567:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783965063.544455:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965063.544599:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715041664 00000100:00100000:2.0:1783965063.544609:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715041664 00000100:00100000:2.0:1783965063.544671:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 249 00000100:00100000:2.0:1783965063.544682:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947405a4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+11:5573:x1870622715041664:12345-192.168.204.12@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783965063.544701:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783965063.544724:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94743fb8f200/0xe782b916994fd66d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5eff40 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965063.544754:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94743fb8f200/0xe782b916994fd66d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5eff40 expref: 12 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965063.544766:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94743fb8f200/0xe782b916994fd66d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5eff40 expref: 12 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965063.544774:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94743fb8f200, rc 0) 00000100:00100000:2.0:1783965063.544840:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947405a4c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+12:5573:x1870622715041664:12345-192.168.204.12@tcp:101:ll_cfg_requeue.0 Request processed in 160us (395us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965063.544848:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 249 00000100:00100000:2.0:1783965063.547132:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965063.552037:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715041792 00000100:00100000:1.0:1783965063.552054:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715041792 00000100:00100000:1.0:1783965063.552133:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 250 00000100:00100000:1.0:1783965063.552143:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947405a4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+12:5573:x1870622715041792:12345-192.168.204.12@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783965063.552513:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947405a4d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+12:5573:x1870622715041792:12345-192.168.204.12@tcp:501:ll_cfg_requeue.0 Request processed in 370us (5644us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965063.552521:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 250 00000100:00100000:0.0:1783965063.554774:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965063.555013:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715041920 00000100:00100000:1.0:1783965063.555024:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715041920 00000100:00100000:1.0:1783965063.555189:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 251 00000100:00100000:1.0:1783965063.555252:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947405a4e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+12:5573:x1870622715041920:12345-192.168.204.12@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783965063.555448:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947405a4e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+12:5573:x1870622715041920:12345-192.168.204.12@tcp:503:ll_cfg_requeue.0 Request processed in 199us (683us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965063.555456:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 251 00000100:00100000:3.0:1783965063.559811:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783965063.566836:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715042048 00000100:00100000:0.0:1783965063.566851:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715042048 00000100:00100000:0.0:1783965063.567294:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 252 00000100:00100000:0.0:1783965063.567305:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947405a4c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+12:9930:x1870622715042048:12345-192.168.204.12@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783965063.567570:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947405a4c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+12:9930:x1870622715042048:12345-192.168.204.12@tcp:502:llog_process_th.0 Request processed in 265us (7775us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965063.567577:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 252 00000100:00100000:2.0:1783965063.582147:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783965063.582308:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715042176 00000100:00100000:0.0:1783965063.582318:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715042176 00000100:00100000:0.0:1783965063.582380:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 253 00000100:00100000:0.0:1783965063.582389:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947405adec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+12:9930:x1870622715042176:12345-192.168.204.12@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783965063.582663:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947405adec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+12:9930:x1870622715042176:12345-192.168.204.12@tcp:502:llog_process_th.0 Request processed in 273us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965063.582682:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 253 00000100:00100000:3.0:1783965063.586968:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965063.587072:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715042304 00000100:00100000:2.0:1783965063.587082:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715042304 00000100:00100000:2.0:1783965063.587137:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 254 00000100:00100000:2.0:1783965063.587146:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947405a4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+12:5573:x1870622715042304:12345-192.168.204.12@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783965063.587161:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783965063.587192:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94743fb8ea00/0xe782b916994fd674 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5eff47 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965063.587267:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94743fb8ea00/0xe782b916994fd674 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5eff47 expref: 13 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965063.587278:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94743fb8ea00/0xe782b916994fd674 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5eff47 expref: 13 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965063.587287:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94743fb8ea00, rc 0) 00000100:00100000:2.0:1783965063.587342:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947405a4c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+13:5573:x1870622715042304:12345-192.168.204.12@tcp:101:ll_cfg_requeue.0 Request processed in 198us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965063.587348:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 254 00000100:00100000:3.0:1783965063.599426:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965063.599594:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715042432 00000100:00100000:1.0:1783965063.599606:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715042432 00000100:00100000:1.0:1783965063.599671:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 255 00000100:00100000:1.0:1783965063.599682:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947405a4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+13:5573:x1870622715042432:12345-192.168.204.12@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783965063.600013:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947405a4ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+13:5573:x1870622715042432:12345-192.168.204.12@tcp:501:ll_cfg_requeue.0 Request processed in 332us (597us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965063.600023:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 255 00000100:00100000:3.0:1783965063.610281:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783965063.610443:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715042560 00000100:00100000:0.0:1783965063.610454:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715042560 00000100:00100000:0.0:1783965063.610535:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 256 00000100:00100000:0.0:1783965063.610546:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94740951d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+13:5573:x1870622715042560:12345-192.168.204.12@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783965063.610772:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94740951d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+13:5573:x1870622715042560:12345-192.168.204.12@tcp:503:ll_cfg_requeue.0 Request processed in 227us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965063.610781:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 256 00000100:00100000:3.0:1783965063.620551:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965063.621313:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715042688 00000100:00100000:2.0:1783965063.621326:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715042688 00000100:00100000:2.0:1783965063.621428:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 257 00000100:00100000:2.0:1783965063.621439:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94740951e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+13:9933:x1870622715042688:12345-192.168.204.12@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783965063.622309:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94740951e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+13:9933:x1870622715042688:12345-192.168.204.12@tcp:502:llog_process_th.0 Request processed in 284us (1179us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965063.622322:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 257 00000100:00100000:3.0:1783965063.641287:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965063.641435:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715042816 00000100:00100000:1.0:1783965063.641445:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715042816 00000100:00100000:1.0:1783965063.641503:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 258 00000100:00100000:1.0:1783965063.641515:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94740951c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+13:9933:x1870622715042816:12345-192.168.204.12@tcp:502:llog_process_th.0 00000100:00100000:1.0:1783965063.641775:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94740951c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+13:9933:x1870622715042816:12345-192.168.204.12@tcp:502:llog_process_th.0 Request processed in 261us (497us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965063.641783:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 258 00010000:00010000:1.0:1783965063.852456:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1783965064.299298:0:5809:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1783965064.299306:0:5809:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff9474369fb000 from 7 10000000:01000000:3.0:1783965064.299312:0:5809:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783965064.299361:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.112@tcp lock: ffff947436f26c00/0xe782b916994fd67b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965064.299372:0:5809:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.112@tcp lock: ffff947436f26c00/0xe782b916994fd67b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965064.299384:0:5809:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.112@tcp lock: ffff947436f26c00/0xe782b916994fd67b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783965064.299411:0:5809:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947436c3d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae0997f7-3a15-4fc6-865a-35b2f101956e:5809:1870622732899328:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1783965064.299493:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783965064.299574:0:5809:0:(client.c:2702:ptlrpc_set_wait()) set ffff9474400a3300 going to sleep for 11 seconds 00000100:00100000:2.0:1783965064.299694:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732899328 00000100:00100000:2.0:1783965064.299703:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732899328 00000100:00100000:2.0:1783965064.299820:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:2.0:1783965064.299830:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94740951c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae0997f7-3a15-4fc6-865a-35b2f101956e+16:5809:x1870622732899328:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783965064.299844:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783965064.299857:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94743fb8ee00/0xe782b916994fd682 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe782b916994fd67b expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965064.299901:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94743fb8ee00/0xe782b916994fd682 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe782b916994fd67b expref: 17 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965064.299911:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94743fb8ee00/0xe782b916994fd682 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe782b916994fd67b expref: 17 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965064.299934:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94743fb8ee00, rc 0) 00000100:00100000:2.0:1783965064.299983:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94740951c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae0997f7-3a15-4fc6-865a-35b2f101956e+17:5809:x1870622732899328:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 155us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965064.299990:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1783965064.300067:0:5809:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947436c3d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae0997f7-3a15-4fc6-865a-35b2f101956e:5809:1870622732899328:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783965064.300082:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.112@tcp lock: ffff947436f26c00/0xe782b916994fd67b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fd682 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965064.300101:0:5809:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.112@tcp lock: ffff947436f26c00/0xe782b916994fd67b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe782b916994fd682 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783965064.300158:0:5809:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947436c3d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae0997f7-3a15-4fc6-865a-35b2f101956e:5809:1870622732899456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783965064.300183:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783965064.306304:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732899456 00000100:00100000:1.0:1783965064.306320:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732899456 00000100:00100000:3.0:1783965064.306362:0:5809:0:(client.c:2702:ptlrpc_set_wait()) set ffff9474400a3300 going to sleep for 11 seconds 00000100:00100000:0.0:1783965064.308244:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1783965064.308267:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94740951ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+17:5809:x1870622732899456:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783965064.308803:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94740951ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+17:5809:x1870622732899456:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 546us (8617us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965064.308813:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1783965064.309329:0:5809:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947436c3d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae0997f7-3a15-4fc6-865a-35b2f101956e:5809:1870622732899456:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783965064.309585:0:5809:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947436c3d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae0997f7-3a15-4fc6-865a-35b2f101956e:5809:1870622732899584:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783965064.309645:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783965064.309725:0:5809:0:(client.c:2702:ptlrpc_set_wait()) set ffff9474400a3300 going to sleep for 11 seconds 00000100:00100000:0.0:1783965064.310051:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732899584 00000100:00100000:0.0:1783965064.310059:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732899584 00000100:00100000:0.0:1783965064.310098:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1783965064.310106:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94740951dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+17:5809:x1870622732899584:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783965064.310516:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94740951dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+17:5809:x1870622732899584:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 410us (869us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965064.310523:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:2.0:1783965064.313122:0:5809:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947436c3d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae0997f7-3a15-4fc6-865a-35b2f101956e:5809:1870622732899584:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783965064.315120:0:11557:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947407296300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae0997f7-3a15-4fc6-865a-35b2f101956e:11557:1870622732899712:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783965064.319400:0:11557:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783965064.319457:0:11557:0:(client.c:2702:ptlrpc_set_wait()) set ffff947436d0f3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783965064.319558:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732899712 00000100:00100000:0.0:1783965064.319579:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732899712 00000100:00100000:0.0:1783965064.319642:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1783965064.319652:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94740951fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+17:11557:x1870622732899712:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783965064.320400:0:11557:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947407296300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae0997f7-3a15-4fc6-865a-35b2f101956e:11557:1870622732899712:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783965064.320441:0:11557:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783965064.320452:0:11557:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783965064.320454:0:11557:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1783965064.320462:0:11557:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9474369fb000 00000020:00000080:3.0:1783965064.320474:0:11557:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1783965064.320569:0:11557:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947436c3dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae0997f7-3a15-4fc6-865a-35b2f101956e:11557:1870622732899840:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783965064.329433:0:11557:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783965064.329876:0:11557:0:(client.c:2702:ptlrpc_set_wait()) set ffff9474400a3e40 going to sleep for 11 seconds 00000100:00100000:2.0:1783965064.330700:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732899840 00000100:00100000:2.0:1783965064.330712:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732899840 00000100:00100000:2.0:1783965064.330765:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:2.0:1783965064.330774:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94741cee0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae0997f7-3a15-4fc6-865a-35b2f101956e+18:11557:x1870622732899840:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783965064.331046:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94741cee0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae0997f7-3a15-4fc6-865a-35b2f101956e+18:11557:x1870622732899840:12345-0@lo:502:llog_process_th.0 Request processed in 273us (1620us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965064.331362:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:3.0:1783965064.333234:0:11557:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947436c3dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae0997f7-3a15-4fc6-865a-35b2f101956e:11557:1870622732899840:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783965064.333290:0:11557:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783965064.333299:0:11557:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783965064.333301:0:11557:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1783965064.333315:0:11557:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1783965064.333544:0:5809:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1783965064.333577:0:5809:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1783965064.333588:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.112@tcp lock: ffff947436f26c00/0xe782b916994fd67b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fd682 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965064.333599:0:5809:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.112@tcp lock: ffff947436f26c00/0xe782b916994fd67b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fd682 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783965064.333617:0:5809:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1783965064.333619:0:5809:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff94743e519000 from 7 10000000:01000000:2.0:1783965064.333622:0:5809:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783965064.333657:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.112@tcp lock: ffff94743fb8e600/0xe782b916994fd689 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965064.333664:0:5809:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.112@tcp lock: ffff94743fb8e600/0xe782b916994fd689 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965064.333674:0:5809:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.112@tcp lock: ffff94743fb8e600/0xe782b916994fd689 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783965064.333703:0:5809:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947407296300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae0997f7-3a15-4fc6-865a-35b2f101956e:5809:1870622732899968:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783965064.333762:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783965064.333818:0:5809:0:(client.c:2702:ptlrpc_set_wait()) set ffff947436d0f3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783965064.334229:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94740951fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+17:11557:x1870622732899712:12345-0@lo:502:llog_process_th.0 Request processed in 14575us (14833us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965064.334241:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1783965064.334284:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732899968 00000100:00100000:0.0:1783965064.334290:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732899968 00000100:00100000:0.0:1783965064.334327:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1783965064.334335:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94741cee1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+17:5809:x1870622732899968:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783965064.334347:0:5805:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783965064.334359:0:5805:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff947430c10000/0xe782b916994fd690 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe782b916994fd689 expref: -99 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965064.334384:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff947430c10000/0xe782b916994fd690 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe782b916994fd689 expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965064.334394:0:5805:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff947430c10000/0xe782b916994fd690 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe782b916994fd689 expref: 18 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965064.334403:0:5805:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff947430c10000, rc 0) 00000100:00100000:0.0:1783965064.334442:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94741cee1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+18:5809:x1870622732899968:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 108us (678us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965064.334448:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:2.0:1783965064.334626:0:5809:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947407296300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae0997f7-3a15-4fc6-865a-35b2f101956e:5809:1870622732899968:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783965064.334642:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.112@tcp lock: ffff94743fb8e600/0xe782b916994fd689 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fd690 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965064.334651:0:5809:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.112@tcp lock: ffff94743fb8e600/0xe782b916994fd689 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe782b916994fd690 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783965064.334707:0:5809:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947407296300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae0997f7-3a15-4fc6-865a-35b2f101956e:5809:1870622732900096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783965064.334737:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783965064.334755:0:5809:0:(client.c:2702:ptlrpc_set_wait()) set ffff947436d0f3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783965064.335038:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732900096 00000100:00100000:3.0:1783965064.335045:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732900096 00000100:00100000:3.0:1783965064.335330:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:3.0:1783965064.335341:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94741cee2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae0997f7-3a15-4fc6-865a-35b2f101956e+18:5809:x1870622732900096:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783965064.335652:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94741cee2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae0997f7-3a15-4fc6-865a-35b2f101956e+18:5809:x1870622732900096:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 314us (913us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965064.335660:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:2.0:1783965064.337125:0:5809:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947407296300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae0997f7-3a15-4fc6-865a-35b2f101956e:5809:1870622732900096:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783965064.345174:0:5809:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947407296300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae0997f7-3a15-4fc6-865a-35b2f101956e:5809:1870622732900224:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783965064.345288:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783965064.345328:0:5809:0:(client.c:2702:ptlrpc_set_wait()) set ffff947436d0f3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783965064.346284:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732900224 00000100:00100000:0.0:1783965064.346296:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732900224 00000100:00100000:0.0:1783965064.346356:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1783965064.346367:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94741cee0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae0997f7-3a15-4fc6-865a-35b2f101956e+18:5809:x1870622732900224:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783965064.346623:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94741cee0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae0997f7-3a15-4fc6-865a-35b2f101956e+18:5809:x1870622732900224:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 258us (1334us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965064.346640:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1783965064.347072:0:5809:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947407296300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae0997f7-3a15-4fc6-865a-35b2f101956e:5809:1870622732900224:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783965064.348031:0:11560:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947407296300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae0997f7-3a15-4fc6-865a-35b2f101956e:11560:1870622732900352:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783965064.348110:0:11560:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783965064.348151:0:11560:0:(client.c:2702:ptlrpc_set_wait()) set ffff9474057dd240 going to sleep for 11 seconds 00000100:00100000:0.0:1783965064.348152:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732900352 00000100:00100000:0.0:1783965064.348159:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732900352 00000100:00100000:0.0:1783965064.348224:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1783965064.348233:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94741cee0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+18:11560:x1870622732900352:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783965064.348436:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94741cee0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+18:11560:x1870622732900352:12345-0@lo:502:llog_process_th.0 Request processed in 204us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965064.348443:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1783965064.348581:0:11560:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947407296300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae0997f7-3a15-4fc6-865a-35b2f101956e:11560:1870622732900352:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783965064.348608:0:11560:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783965064.348622:0:11560:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783965064.348625:0:11560:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1783965064.348631:0:11560:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff94743e519000 00000020:00000080:1.0:1783965064.348633:0:11560:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1783965064.348717:0:11560:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947436334000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae0997f7-3a15-4fc6-865a-35b2f101956e:11560:1870622732900480:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783965064.348752:0:11560:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783965064.348766:0:11560:0:(client.c:2702:ptlrpc_set_wait()) set ffff94741cca0e40 going to sleep for 11 seconds 00000100:00100000:2.0:1783965064.348892:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732900480 00000100:00100000:2.0:1783965064.348896:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732900480 00000100:00100000:2.0:1783965064.348931:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1783965064.348938:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94741cee2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae0997f7-3a15-4fc6-865a-35b2f101956e+18:11560:x1870622732900480:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783965064.349076:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94741cee2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae0997f7-3a15-4fc6-865a-35b2f101956e+18:11560:x1870622732900480:12345-0@lo:502:llog_process_th.0 Request processed in 138us (322us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965064.349083:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:1.0:1783965064.349320:0:11560:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947436334000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae0997f7-3a15-4fc6-865a-35b2f101956e:11560:1870622732900480:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783965064.349341:0:11560:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783965064.349346:0:11560:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783965064.349357:0:11560:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1783965064.349361:0:11560:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1783965064.350183:0:5809:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1783965064.350229:0:5809:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1783965064.350241:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.112@tcp lock: ffff94743fb8e600/0xe782b916994fd689 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fd690 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965064.350255:0:5809:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.112@tcp lock: ffff94743fb8e600/0xe782b916994fd689 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fd690 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783965064.350266:0:5809:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1783965064.350268:0:5809:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff947403dc3000 from 7 10000000:01000000:2.0:1783965064.350272:0:5809:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783965064.350303:0:5809:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.112@tcp lock: ffff94743fb8e200/0xe782b916994fd697 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965064.350311:0:5809:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.112@tcp lock: ffff94743fb8e200/0xe782b916994fd697 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965064.350333:0:5809:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.112@tcp lock: ffff94743fb8e200/0xe782b916994fd697 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783965064.350364:0:5809:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947407296300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae0997f7-3a15-4fc6-865a-35b2f101956e:5809:1870622732900608:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783965064.350409:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783965064.350442:0:5809:0:(client.c:2702:ptlrpc_set_wait()) set ffff9474057dd780 going to sleep for 11 seconds 00000100:00100000:0.0:1783965064.350881:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732900608 00000100:00100000:0.0:1783965064.350888:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732900608 00000100:00100000:0.0:1783965064.350936:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1783965064.350944:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94741cee1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae0997f7-3a15-4fc6-865a-35b2f101956e+18:5809:x1870622732900608:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783965064.350965:0:5807:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783965064.350980:0:5807:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff947430c10200/0xe782b916994fd69e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xe782b916994fd697 expref: -99 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965064.351003:0:5807:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff947430c10200/0xe782b916994fd69e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe782b916994fd697 expref: 19 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965064.351012:0:5807:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff947430c10200/0xe782b916994fd69e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe782b916994fd697 expref: 19 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965064.351020:0:5807:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff947430c10200, rc 0) 00000100:00100000:0.0:1783965064.351071:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94741cee1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae0997f7-3a15-4fc6-865a-35b2f101956e+19:5809:x1870622732900608:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 127us (660us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965064.351077:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:1.0:1783965064.351232:0:5809:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947407296300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae0997f7-3a15-4fc6-865a-35b2f101956e:5809:1870622732900608:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783965064.351248:0:5809:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.112@tcp lock: ffff94743fb8e200/0xe782b916994fd697 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fd69e expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965064.351257:0:5809:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.112@tcp lock: ffff94743fb8e200/0xe782b916994fd697 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe782b916994fd69e expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783965064.351308:0:5809:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947436334000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae0997f7-3a15-4fc6-865a-35b2f101956e:5809:1870622732900736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783965064.351336:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783965064.351368:0:5809:0:(client.c:2702:ptlrpc_set_wait()) set ffff94741cca0e40 going to sleep for 11 seconds 00000100:00100000:0.0:1783965064.351472:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732900736 00000100:00100000:0.0:1783965064.351483:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732900736 00000100:00100000:0.0:1783965064.351593:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1783965064.351601:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94741cee3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+19:5809:x1870622732900736:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783965064.351842:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94741cee3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+19:5809:x1870622732900736:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 242us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965064.351849:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:1.0:1783965064.355549:0:5809:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947436334000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae0997f7-3a15-4fc6-865a-35b2f101956e:5809:1870622732900736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783965064.355621:0:5809:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947436334000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae0997f7-3a15-4fc6-865a-35b2f101956e:5809:1870622732900864:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783965064.355705:0:5809:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783965064.355753:0:5809:0:(client.c:2702:ptlrpc_set_wait()) set ffff94741cca0e40 going to sleep for 11 seconds 00000100:00100000:2.0:1783965064.356007:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732900864 00000100:00100000:2.0:1783965064.356014:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732900864 00000100:00100000:2.0:1783965064.356055:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1783965064.356064:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94741cee1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae0997f7-3a15-4fc6-865a-35b2f101956e+19:5809:x1870622732900864:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783965064.356291:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94741cee1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae0997f7-3a15-4fc6-865a-35b2f101956e+19:5809:x1870622732900864:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 228us (586us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965064.356299:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:1.0:1783965064.356691:0:5809:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947436334000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:ae0997f7-3a15-4fc6-865a-35b2f101956e:5809:1870622732900864:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1783965064.357301:0:11561:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1783965064.358891:0:11562:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947436c3dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae0997f7-3a15-4fc6-865a-35b2f101956e:11562:1870622732900992:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783965064.359651:0:11562:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783965064.359703:0:11562:0:(client.c:2702:ptlrpc_set_wait()) set ffff9474400a3f00 going to sleep for 11 seconds 00000100:00100000:2.0:1783965064.360005:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732900992 00000100:00100000:2.0:1783965064.360013:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732900992 00000100:00100000:2.0:1783965064.360066:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:2.0:1783965064.360076:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94741cee3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae0997f7-3a15-4fc6-865a-35b2f101956e+19:11562:x1870622732900992:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783965064.360356:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94741cee3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae0997f7-3a15-4fc6-865a-35b2f101956e+19:11562:x1870622732900992:12345-0@lo:502:llog_process_th.0 Request processed in 282us (706us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965064.360364:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1783965064.360827:0:11562:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947436c3dc00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae0997f7-3a15-4fc6-865a-35b2f101956e:11562:1870622732900992:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783965064.360862:0:11562:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783965064.360871:0:11562:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783965064.360873:0:11562:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1783965064.360882:0:11562:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff947403dc3000 00000020:00000080:3.0:1783965064.360884:0:11562:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1783965064.362291:0:11562:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947407296300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae0997f7-3a15-4fc6-865a-35b2f101956e:11562:1870622732901120:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783965064.362363:0:11562:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783965064.362402:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732901120 00000100:00100000:2.0:1783965064.362408:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732901120 00000100:00100000:2.0:1783965064.362448:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1783965064.362474:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94741cee3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae0997f7-3a15-4fc6-865a-35b2f101956e+19:11562:x1870622732901120:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783965064.362947:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94741cee3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae0997f7-3a15-4fc6-865a-35b2f101956e+19:11562:x1870622732901120:12345-0@lo:502:llog_process_th.0 Request processed in 484us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965064.363723:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 273 00000100:00100000:2.0:1783965064.363811:0:11562:0:(client.c:2702:ptlrpc_set_wait()) set ffff9474057dd9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783965064.363837:0:11562:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947407296300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:ae0997f7-3a15-4fc6-865a-35b2f101956e:11562:1870622732901120:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1783965064.363869:0:11562:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783965064.363877:0:11562:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783965064.363880:0:11562:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1783965064.363890:0:11562:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1783965064.364807:0:5809:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1783965064.364832:0:5809:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783965064.364842:0:5809:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.112@tcp lock: ffff94743fb8e200/0xe782b916994fd697 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fd69e expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965064.364854:0:5809:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.112@tcp lock: ffff94743fb8e200/0xe782b916994fd697 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fd69e expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965064.875482:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1783965065.388146:0:11561:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:2.0:1783965065.773478:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947436334000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3324:1870622732901248:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783965065.773478:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743706c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3322:1870622732901504:0@lo:400:kworker.0 00000100:00100000:3.0:1783965065.773572:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743706ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ae0997f7-3a15-4fc6-865a-35b2f101956e:3325:1870622732901376:0@lo:400:kworker.0 00000100:00100000:1.0:1783965065.774112:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743706df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3323:1870622732901632:0@lo:400:kworker.0 00000100:00100000:2.0:1783965065.774535:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783965065.774668:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743706c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3324:1870622732901760:0@lo:400:kworker.0 00000100:00100000:2.0:1783965065.774784:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783965065.775111:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732901248 00000100:00100000:2.0:1783965065.775120:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732901248 00000100:00100000:2.0:1783965065.775174:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1783965065.775182:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947407296300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3324:x1870622732901248:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783965065.775235:0:6611:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783965065.775281:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947407296300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3324:x1870622732901248:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (747us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965065.775288:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1783965065.775309:0:8738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732901760 00000100:00100000:2.0:1783965065.775312:0:8738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732901760 00000100:00100000:2.0:1783965065.775335:0:8738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1783965065.775341:0:8738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e57dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3324:x1870622732901760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783965065.775380:0:8738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e57dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3324:x1870622732901760:12345-0@lo:400:kworker.0 Request processed in 39us (597us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965065.775386:0:8738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1783965065.775506:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947436334000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3324:1870622732901248:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1783965065.775523:0:3324:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94743706c380 x1870622732901760/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783965081 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783965065.775533:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743706c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3324:1870622732901760:0@lo:400:kworker.0 00000100:00080000:2.0:1783965065.775682:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783965065.775685:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783965065.778657:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783965065.778723:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743706e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3325:1870622732901888:0@lo:400:kworker.0 00000100:00100000:3.0:1783965065.778759:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783965065.778919:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732901888 00000100:00100000:3.0:1783965065.778927:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732901888 00000100:00100000:3.0:1783965065.779134:0:6632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1783965065.779145:0:6632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436c3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3325:x1870622732901888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783965065.779257:0:6632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436c3dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3325:x1870622732901888:12345-0@lo:400:kworker.0 Request processed in 57us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965065.779266:0:6632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1783965065.779291:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732901376 00000100:00100000:3.0:1783965065.779294:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732901376 00000100:00100000:3.0:1783965065.779317:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 274 00000100:00100000:3.0:1783965065.779324:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94741cee3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+19:3325:x1870622732901376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783965065.779354:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94741cee3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+19:3325:x1870622732901376:12345-0@lo:400:kworker.0 Request processed in 30us (705us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965065.779361:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 274 00000100:00080000:3.0:1783965065.779388:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783965065.779428:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743706ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ae0997f7-3a15-4fc6-865a-35b2f101956e:3325:1870622732901376:0@lo:400:kworker.0 00000100:00100000:3.0:1783965065.779453:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743706e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3325:1870622732901888:0@lo:400:kworker.0 00000100:00100000:0.0:1783965065.781307:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783965065.781359:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743706ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3322:1870622732902016:0@lo:400:kworker.0 00000100:00100000:0.0:1783965065.781396:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783965065.781459:0:6609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732902016 00000100:00100000:0.0:1783965065.781466:0:6609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732902016 00000100:00100000:0.0:1783965065.781509:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1783965065.781518:0:6609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743706ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3322:x1870622732902016:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783965065.781888:0:6609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743706ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3322:x1870622732902016:12345-0@lo:400:kworker.0 Request processed in 370us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965065.781896:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1783965065.781947:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743706ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3322:1870622732902016:0@lo:400:kworker.0 00000100:00100000:3.0:1783965065.784138:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732901504 00000100:00100000:3.0:1783965065.784157:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732901504 00000100:00100000:3.0:1783965065.784244:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1783965065.784254:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743706f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3322:x1870622732901504:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783965065.784344:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743706f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3322:x1870622732901504:12345-0@lo:400:kworker.0 Request processed in 92us (3042us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965065.784352:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1783965065.784883:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743706c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3322:1870622732901504:0@lo:400:kworker.0 00000100:00100000:1.0:1783965065.785175:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783965065.785328:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732901632 00000100:00100000:3.0:1783965065.785335:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732901632 00000100:00100000:3.0:1783965065.785384:0:6632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1783965065.785391:0:6632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436334700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3323:x1870622732901632:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1783965065.785504:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783965065.787078:0:6632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436334700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3323:x1870622732901632:12345-0@lo:400:kworker.0 Request processed in 1681us (1897us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965065.787091:0:6632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1783965065.787389:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743706df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3323:1870622732901632:0@lo:400:kworker.0 00010000:00010000:1.0:1783965065.899470:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1783965066.896137:0:7523:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00010000:00010000:0.0:1783965066.923485:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783965067.822055:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783965067.822079:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e57ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3322:1870622732902144:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783965067.822145:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783965067.822312:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732902144 00000100:00100000:2.0:1783965067.822320:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732902144 00000100:00100000:2.0:1783965067.822379:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1783965067.822388:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436c3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1870622732902144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783965067.822444:0:6611:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783965067.822490:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436c3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1870622732902144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965067.822496:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:3.0:1783965067.822567:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1783965067.822598:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94743e57ed80 x1870622732902144/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783965083 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783965067.822617:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e57ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3322:1870622732902144:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1783965067.950384:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783965068.156353:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965068.156405:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965068.156438:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965068.156470:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783965068.156543:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715043072 00000100:00100000:0.0:1783965068.156554:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715043072 00000100:00100000:0.0:1783965068.156623:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715043328 00000100:00100000:0.0:1783965068.156627:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715043328 00000100:00100000:0.0:1783965068.156652:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 105 00000100:00100000:0.0:1783965068.156661:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436c3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9923189b-eb4a-470c-ab45-969435371000+5:2357:x1870622715043072:12345-192.168.204.12@tcp:400:kworker.0 00000100:00100000:0.0:1783965068.156768:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436c3f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9923189b-eb4a-470c-ab45-969435371000+5:2357:x1870622715043072:12345-192.168.204.12@tcp:400:kworker.0 Request processed in 107us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965068.156776:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 105 00000100:00100000:0.0:1783965068.156794:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 106 00000100:00100000:0.0:1783965068.156800:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436c3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49bbacc1-b013-4591-8d15-02f4f0d1884e+5:2357:x1870622715043328:12345-192.168.204.12@tcp:400:kworker.0 00000100:00100000:0.0:1783965068.156836:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436c3ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49bbacc1-b013-4591-8d15-02f4f0d1884e+5:2357:x1870622715043328:12345-192.168.204.12@tcp:400:kworker.0 Request processed in 37us (431us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965068.156842:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 106 00000100:00100000:2.0:1783965068.157280:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715042944 00000100:00100000:2.0:1783965068.157286:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715042944 00000100:00100000:2.0:1783965068.157324:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 275 00000100:00100000:2.0:1783965068.157331:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94741cee0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+13:2357:x1870622715042944:12345-192.168.204.12@tcp:400:kworker.0 00000100:00100000:2.0:1783965068.157371:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94741cee0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+13:2357:x1870622715042944:12345-192.168.204.12@tcp:400:kworker.0 Request processed in 41us (932us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965068.157378:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 275 00000100:00100000:2.0:1783965068.157432:0:8738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715043200 00000100:00100000:2.0:1783965068.157435:0:8738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715043200 00000100:00100000:2.0:1783965068.157465:0:8738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 52 00000100:00100000:2.0:1783965068.157470:0:8738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436c3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9923189b-eb4a-470c-ab45-969435371000+5:2357:x1870622715043200:12345-192.168.204.12@tcp:400:kworker.0 00000100:00100000:2.0:1783965068.157497:0:8738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436c3ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9923189b-eb4a-470c-ab45-969435371000+5:2357:x1870622715043200:12345-192.168.204.12@tcp:400:kworker.0 Request processed in 27us (1026us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965068.157504:0:8738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 52 00000100:00080000:3.0:1783965068.157918:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783965068.158276:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1783965068.972249:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783965070.001748:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783965070.891628:0:3325:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783965070.891659:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947436336680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3325:1870622732902272:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783965070.891733:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783965070.892275:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947436c3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ae0997f7-3a15-4fc6-865a-35b2f101956e:3325:1870622732902400:0@lo:400:kworker.0 00000100:00100000:0.0:1783965070.892326:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783965070.892416:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732902400 00000100:00100000:2.0:1783965070.892426:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732902400 00000100:00100000:2.0:1783965070.892475:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 276 00000100:00100000:2.0:1783965070.892484:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94741cee1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae0997f7-3a15-4fc6-865a-35b2f101956e+19:3325:x1870622732902400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783965070.893299:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732902272 00000100:00100000:1.0:1783965070.893308:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732902272 00000100:00100000:1.0:1783965070.893368:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1783965070.893375:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743706c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3325:x1870622732902272:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783965070.893404:0:6611:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783965070.897415:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94741cee1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae0997f7-3a15-4fc6-865a-35b2f101956e+19:3325:x1870622732902400:12345-0@lo:400:kworker.0 Request processed in 4922us (5077us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965070.897430:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 276 00000100:00100000:2.0:1783965070.897542:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947436c3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3322:1870622732902528:0@lo:400:kworker.0 00000100:00100000:2.0:1783965070.897596:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783965070.897646:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783965070.897654:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947436c3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3322:1870622732902656:0@lo:400:kworker.0 00000100:00100000:2.0:1783965070.897679:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783965070.897708:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947436c3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3324:1870622732902784:0@lo:400:kworker.0 00000100:00100000:0.0:1783965070.897722:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947436c3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ae0997f7-3a15-4fc6-865a-35b2f101956e:3325:1870622732902400:0@lo:400:kworker.0 00000100:00100000:2.0:1783965070.897734:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783965070.897739:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732902528 00000100:00100000:0.0:1783965070.897744:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732902528 00000100:00100000:0.0:1783965070.897782:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732902656 00000100:00100000:0.0:1783965070.897785:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732902656 00000100:00080000:2.0:1783965070.897790:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783965070.897795:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783965070.897817:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1783965070.897825:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e57ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3322:x1870622732902528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783965070.897880:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e57ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3322:x1870622732902528:12345-0@lo:400:kworker.0 Request processed in 56us (284us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965070.897887:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1783965070.897900:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1783965070.897921:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e57c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3322:x1870622732902656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783965070.897926:0:6609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732902784 00000100:00100000:2.0:1783965070.897929:0:6609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732902784 00000100:00100000:0.0:1783965070.897951:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e57c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3322:x1870622732902656:12345-0@lo:400:kworker.0 Request processed in 32us (271us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965070.897957:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1783965070.897962:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1783965070.897968:0:6609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e57df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3324:x1870622732902784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783965070.897986:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947436c3d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3322:1870622732902656:0@lo:400:kworker.0 00000100:00100000:0.0:1783965070.897996:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947436c3df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3322:1870622732902528:0@lo:400:kworker.0 00000100:00100000:2.0:1783965070.898007:0:6609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e57df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3324:x1870622732902784:12345-0@lo:400:kworker.0 Request processed in 39us (272us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965070.898013:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:2.0:1783965070.898032:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1783965070.898048:0:3324:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff947436c3c380 x1870622732902784/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783965086 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783965070.898058:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947436c3c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3324:1870622732902784:0@lo:400:kworker.0 00000100:00100000:2.0:1783965070.898374:0:3324:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783965070.898383:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947436c3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3324:1870622732902912:0@lo:400:kworker.0 00000100:00100000:2.0:1783965070.898409:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783965070.898417:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743706c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3325:x1870622732902272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 5041us (6682us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965070.898426:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1783965070.901271:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732902912 00000100:00100000:3.0:1783965070.901289:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732902912 00000100:00100000:3.0:1783965070.901409:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1783965070.901421:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e57c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3324:x1870622732902912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783965070.901527:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e57c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3324:x1870622732902912:12345-0@lo:400:kworker.0 Request processed in 109us (3116us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965070.901553:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1783965070.901620:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947436c3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3324:1870622732902912:0@lo:400:kworker.0 00000100:00080000:2.0:1783965070.901725:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783965070.913117:0:3325:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:0.0:1783965070.913130:0:3325:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94743706dc00, transno 4294967300 00000100:00100000:0.0:1783965070.913477:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947436336680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3325:1870622732902272:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1783965071.019420:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783965072.043687:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783965072.947877:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e57e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3322:1870622732903040:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783965072.947949:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783965072.948025:0:6610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732903040 00000100:00100000:2.0:1783965072.948033:0:6610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732903040 00000100:00100000:2.0:1783965072.948089:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1783965072.948099:0:6610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e57ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1870622732903040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783965072.948136:0:6610:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783965072.948183:0:6610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e57ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1870622732903040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965072.948191:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:2.0:1783965072.948233:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1783965072.948264:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94743e57e680 x1870622732903040/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783965088 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783965072.948284:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e57e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3322:1870622732903040:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1783965073.067517:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783965073.272719:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965073.272763:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965073.272806:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965073.272843:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965073.272886:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715043584 00000100:00100000:2.0:1783965073.272896:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715043584 00000100:00100000:2.0:1783965073.272953:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715043840 00000100:00100000:2.0:1783965073.272956:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715043840 00000100:00100000:2.0:1783965073.272979:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 110 00000100:00100000:2.0:1783965073.272989:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e57f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9923189b-eb4a-470c-ab45-969435371000+5:2360:x1870622715043584:12345-192.168.204.12@tcp:400:kworker.0 00000100:00100000:2.0:1783965073.273084:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e57f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9923189b-eb4a-470c-ab45-969435371000+5:2360:x1870622715043584:12345-192.168.204.12@tcp:400:kworker.0 Request processed in 95us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965073.273092:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 110 00000100:00100000:2.0:1783965073.273110:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 111 00000100:00100000:2.0:1783965073.273117:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e57ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49bbacc1-b013-4591-8d15-02f4f0d1884e+5:2360:x1870622715043840:12345-192.168.204.12@tcp:400:kworker.0 00000100:00100000:2.0:1783965073.273141:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e57ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49bbacc1-b013-4591-8d15-02f4f0d1884e+5:2360:x1870622715043840:12345-192.168.204.12@tcp:400:kworker.0 Request processed in 26us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965073.273147:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 111 00000100:00080000:2.0:1783965073.273163:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783965073.273672:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715043456 00000100:00100000:0.0:1783965073.273677:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715043456 00000100:00100000:0.0:1783965073.273722:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 277 00000100:00100000:0.0:1783965073.273730:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94741cee2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+13:2360:x1870622715043456:12345-192.168.204.12@tcp:400:kworker.0 00000100:00100000:0.0:1783965073.273760:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94741cee2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+13:2360:x1870622715043456:12345-192.168.204.12@tcp:400:kworker.0 Request processed in 32us (1052us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965073.273766:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 277 00000100:00100000:3.0:1783965073.278084:0:8738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715043712 00000100:00100000:3.0:1783965073.278100:0:8738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715043712 00000100:00100000:3.0:1783965073.278406:0:8738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 54 00000100:00100000:3.0:1783965073.278418:0:8738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e57e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9923189b-eb4a-470c-ab45-969435371000+5:2360:x1870622715043712:12345-192.168.204.12@tcp:400:kworker.0 00000100:00100000:3.0:1783965073.278502:0:8738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e57e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9923189b-eb4a-470c-ab45-969435371000+5:2360:x1870622715043712:12345-192.168.204.12@tcp:400:kworker.0 Request processed in 87us (5739us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965073.278509:0:8738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 54 00000100:00080000:0.0:1783965073.279134:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1783965074.092028:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783965075.115672:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1783965075.628352:0:11561:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1783965076.011747:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947436c3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3324:1870622732903296:0@lo:400:kworker.0 00000100:00100000:1.0:1783965076.011827:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783965076.011912:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947436c3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3324:1870622732903808:0@lo:400:kworker.0 00000100:00100000:1.0:1783965076.011941:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783965076.011975:0:3324:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783965076.011981:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947436c3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3324:1870622732903424:0@lo:400:kworker.0 00000100:00100000:1.0:1783965076.012005:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783965076.012037:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732903808 00000100:00100000:1.0:1783965076.012059:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732903808 00000100:00100000:1.0:1783965076.012121:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1783965076.012131:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436335180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3324:x1870622732903808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783965076.012191:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436335180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3324:x1870622732903808:12345-0@lo:400:kworker.0 Request processed in 62us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965076.012198:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00080000:1.0:1783965076.012262:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783965076.012277:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732903296 00000100:00100000:1.0:1783965076.012281:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732903296 00000100:00100000:1.0:1783965076.012304:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732903424 00000100:00100000:1.0:1783965076.012307:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732903424 00000100:00100000:1.0:1783965076.012329:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1783965076.012335:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436337100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3324:x1870622732903296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783965076.012371:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436337100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3324:x1870622732903296:12345-0@lo:400:kworker.0 Request processed in 35us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965076.012377:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1783965076.012388:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1783965076.012394:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436336680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3324:x1870622732903424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783965076.012433:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436336680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3324:x1870622732903424:12345-0@lo:400:kworker.0 Request processed in 38us (426us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965076.012438:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00080000:1.0:1783965076.012453:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783965076.012481:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947436c3f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3324:1870622732903424:0@lo:400:kworker.0 00000100:00100000:1.0:1783965076.012491:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947436c3d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3324:1870622732903296:0@lo:400:kworker.0 00000100:00100000:1.0:1783965076.012499:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947436c3c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3324:1870622732903808:0@lo:400:kworker.0 00000100:00100000:2.0:1783965076.013759:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947436c3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ae0997f7-3a15-4fc6-865a-35b2f101956e:3323:1870622732903168:0@lo:400:kworker.0 00000100:00100000:2.0:1783965076.013822:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783965076.013881:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947436c3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3323:1870622732903680:0@lo:400:kworker.0 00000100:00100000:2.0:1783965076.013906:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783965076.013930:0:3323:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783965076.013949:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947436c3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3323:1870622732903552:0@lo:400:kworker.0 00000100:00100000:2.0:1783965076.013975:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783965076.014005:0:6609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732903552 00000100:00100000:2.0:1783965076.014011:0:6609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732903552 00000100:00100000:2.0:1783965076.014052:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1783965076.014059:0:6609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e57f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3323:x1870622732903552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783965076.014101:0:6609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e57f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3323:x1870622732903552:12345-0@lo:400:kworker.0 Request processed in 43us (125us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965076.014108:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1783965076.014128:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732903680 00000100:00100000:2.0:1783965076.014131:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732903680 00000100:00100000:2.0:1783965076.014155:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1783965076.014160:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e57e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3323:x1870622732903680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783965076.014186:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e57e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3323:x1870622732903680:12345-0@lo:400:kworker.0 Request processed in 27us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965076.014192:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1783965076.014370:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732903168 00000100:00100000:3.0:1783965076.014375:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732903168 00000100:00100000:3.0:1783965076.014407:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 278 00000100:00100000:3.0:1783965076.014414:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94741cee2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae0997f7-3a15-4fc6-865a-35b2f101956e+19:3323:x1870622732903168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783965076.014448:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94741cee2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae0997f7-3a15-4fc6-865a-35b2f101956e+19:3323:x1870622732903168:12345-0@lo:400:kworker.0 Request processed in 36us (626us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965076.014454:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 278 00000100:00080000:3.0:1783965076.014538:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783965076.014544:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1783965076.014738:0:3323:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff947436c3ce00 x1870622732903552/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783965092 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783965076.014751:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947436c3ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3323:1870622732903552:0@lo:400:kworker.0 00000100:00100000:3.0:1783965076.014760:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947436c3f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ae0997f7-3a15-4fc6-865a-35b2f101956e:3323:1870622732903168:0@lo:400:kworker.0 00000100:00100000:3.0:1783965076.014775:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947436c3e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3323:1870622732903680:0@lo:400:kworker.0 00000100:00100000:0.0:1783965076.015421:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e57d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3325:1870622732903936:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783965076.015457:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783965076.015937:0:6610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732903936 00000100:00100000:2.0:1783965076.015943:0:6610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732903936 00000100:00100000:2.0:1783965076.015984:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1783965076.016000:0:6610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743706ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3325:x1870622732903936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783965076.016032:0:6610:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783965076.016267:0:6610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743706ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3325:x1870622732903936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 275us (808us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965076.016274:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1783965076.020764:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e57d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3325:1870622732903936:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1783965076.139453:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783965077.163892:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783965078.059542:0:3323:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783965078.059584:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e57d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3323:1870622732904064:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783965078.059658:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783965078.059815:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732904064 00000100:00100000:1.0:1783965078.059824:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732904064 00000100:00080000:2.0:1783965078.060154:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783965078.064451:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1783965078.064477:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436c3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3323:x1870622732904064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783965078.064532:0:6611:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783965078.064635:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436c3e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3323:x1870622732904064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 172us (4977us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965078.064642:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:3.0:1783965078.064741:0:3323:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94743e57d180 x1870622732904064/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783965094 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783965078.064765:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e57d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3323:1870622732904064:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1783965078.187495:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783965078.396124:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965078.396310:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965078.396667:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715043968 00000100:00100000:1.0:1783965078.396678:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715043968 00000100:00100000:1.0:1783965078.396740:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 279 00000100:00100000:1.0:1783965078.396751:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947408ec8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+13:2357:x1870622715043968:12345-192.168.204.12@tcp:400:kworker.0 00000100:00100000:1.0:1783965078.396837:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947408ec8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+13:2357:x1870622715043968:12345-192.168.204.12@tcp:400:kworker.0 Request processed in 88us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965078.396845:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 279 00000100:00100000:2.0:1783965078.397228:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715044096 00000100:00100000:2.0:1783965078.397234:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715044096 00000100:00080000:0.0:1783965078.397288:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783965078.397350:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 115 00000100:00100000:2.0:1783965078.397372:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436c3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9923189b-eb4a-470c-ab45-969435371000+5:2357:x1870622715044096:12345-192.168.204.12@tcp:400:kworker.0 00000100:00100000:2.0:1783965078.397420:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436c3f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9923189b-eb4a-470c-ab45-969435371000+5:2357:x1870622715044096:12345-192.168.204.12@tcp:400:kworker.0 Request processed in 48us (1308us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965078.397442:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 115 00000100:00100000:3.0:1783965078.408905:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783965078.409987:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965078.410455:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715044352 00000100:00100000:3.0:1783965078.410469:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715044352 00000100:00100000:3.0:1783965078.410640:0:6632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 116 00000100:00100000:3.0:1783965078.410655:0:6632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743706e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49bbacc1-b013-4591-8d15-02f4f0d1884e+5:2358:x1870622715044352:12345-192.168.204.12@tcp:400:kworker.0 00000100:00100000:1.0:1783965078.410696:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715044224 00000100:00100000:1.0:1783965078.410716:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715044224 00000100:00100000:1.0:1783965078.410809:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 20 00000100:00100000:1.0:1783965078.410824:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436c3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9923189b-eb4a-470c-ab45-969435371000+5:2356:x1870622715044224:12345-192.168.204.12@tcp:9:kworker.0 00000100:00100000:3.0:1783965078.410843:0:6632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743706e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49bbacc1-b013-4591-8d15-02f4f0d1884e+5:2358:x1870622715044352:12345-192.168.204.12@tcp:400:kworker.0 Request processed in 189us (859us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965078.410855:0:6632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 116 00000020:00000080:1.0:1783965078.410859:0:6606:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe782b916994fd5da 00000100:00080000:1.0:1783965078.410877:0:6606:0:(import.c:65:import_set_state_nolock()) ffff947429f76000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1783965078.410936:0:6606:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967300 00010000:00010000:0.0:1783965078.411142:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1783965078.411156:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783965078.411164:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783965078.411295:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436c3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9923189b-eb4a-470c-ab45-969435371000+2:2356:x1870622715044224:12345-192.168.204.12@tcp:9:kworker.0 Request processed in 473us (2402us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965078.411304:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 20 00010000:00010000:1.0:1783965079.213160:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783965080.235463:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783965081.132394:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783965081.132435:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e57f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3322:1870622732904192:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783965081.132539:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783965081.132773:0:6610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732904192 00000100:00100000:2.0:1783965081.132783:0:6610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732904192 00000100:00100000:2.0:1783965081.132859:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1783965081.132870:0:6610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743706f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1870622732904192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783965081.132922:0:6610:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783965081.132980:0:6610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743706f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1870622732904192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 112us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965081.132987:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1783965081.133033:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e57f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3322:1870622732904192:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1783965081.133577:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783965081.133781:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e57f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ae0997f7-3a15-4fc6-865a-35b2f101956e:3324:1870622732904320:0@lo:400:kworker.0 00000100:00100000:1.0:1783965081.133830:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783965081.133869:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e57d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3324:1870622732904832:0@lo:400:kworker.0 00000100:00100000:1.0:1783965081.133896:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783965081.133918:0:3324:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783965081.133924:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e57d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3324:1870622732904448:0@lo:400:kworker.0 00000100:00100000:1.0:1783965081.133949:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783965081.133978:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732904832 00000100:00100000:1.0:1783965081.133984:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732904832 00000100:00100000:1.0:1783965081.134019:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732904448 00000100:00100000:1.0:1783965081.134022:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732904448 00000100:00100000:1.0:1783965081.134037:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1783965081.134042:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436334000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3324:x1870622732904832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783965081.134081:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436334000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3324:x1870622732904832:12345-0@lo:400:kworker.0 Request processed in 38us (184us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965081.134088:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:1.0:1783965081.134101:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:1.0:1783965081.134107:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436306a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3324:x1870622732904448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783965081.134134:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436306a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3324:x1870622732904448:12345-0@lo:400:kworker.0 Request processed in 26us (183us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965081.134139:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00080000:1.0:1783965081.134181:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783965081.134225:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e57d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3324:1870622732904448:0@lo:400:kworker.0 00000100:00100000:1.0:1783965081.134236:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e57d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3324:1870622732904832:0@lo:400:kworker.0 00000100:00100000:3.0:1783965081.134779:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e57fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3323:1870622732904704:0@lo:400:kworker.0 00000100:00100000:3.0:1783965081.134820:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783965081.134854:0:3323:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783965081.134860:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e57c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3323:1870622732904576:0@lo:400:kworker.0 00000100:00100000:3.0:1783965081.134883:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783965081.134917:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732904576 00000100:00100000:3.0:1783965081.134921:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732904576 00000100:00100000:3.0:1783965081.134957:0:6632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1783965081.134964:0:6632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436c3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3323:x1870622732904576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783965081.135001:0:6632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436c3df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3323:x1870622732904576:12345-0@lo:400:kworker.0 Request processed in 38us (116us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965081.135025:0:6632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00080000:3.0:1783965081.135046:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783965081.135064:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e57c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3323:1870622732904576:0@lo:400:kworker.0 00000100:00100000:0.0:1783965081.135255:0:8738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732904704 00000100:00100000:0.0:1783965081.135260:0:8738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732904704 00000100:00100000:0.0:1783965081.135302:0:8738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1783965081.135309:0:8738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436c3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3323:x1870622732904704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783965081.135346:0:8738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436c3c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3323:x1870622732904704:12345-0@lo:400:kworker.0 Request processed in 38us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965081.135352:0:8738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1783965081.135473:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732904320 00000100:00100000:2.0:1783965081.135478:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732904320 00000100:00100000:2.0:1783965081.135513:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1783965081.135520:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947408ec9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+19:3324:x1870622732904320:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783965081.135563:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947408ec9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+19:3324:x1870622732904320:12345-0@lo:400:kworker.0 Request processed in 44us (1733us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965081.135569:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 280 00000100:00100000:2.0:1783965081.135608:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e57f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ae0997f7-3a15-4fc6-865a-35b2f101956e:3324:1870622732904320:0@lo:400:kworker.0 00000100:00080000:3.0:1783965081.135823:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1783965081.135846:0:3323:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94743e57fb80 x1870622732904704/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783965097 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783965081.135857:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e57fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3323:1870622732904704:0@lo:400:kworker.0 00010000:00010000:1.0:1783965081.259410:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1783965082.233510:0:7523:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 9923189b-eb4a-470c-ab45-969435371000 00000020:00000080:1.0:1783965082.233652:0:7523:0:(genops.c:906:class_export_put()) final put ffff947429f77000/9923189b-eb4a-470c-ab45-969435371000 00000020:00000080:2.0:1783965082.233725:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff947429f77000/9923189b-eb4a-470c-ab45-969435371000 for lustre-OST0001 00000020:00000080:2.0:1783965082.233789:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff947429f76000 for lustre-OST0001 00010000:00010000:0.0:1783965082.283500:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783965083.183279:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743706d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3325:1870622732904960:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783965083.183359:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783965083.183455:0:6610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732904960 00000100:00100000:0.0:1783965083.183463:0:6610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732904960 00000100:00100000:0.0:1783965083.183532:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1783965083.183542:0:6610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e57f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3325:x1870622732904960:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783965083.183577:0:6610:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783965083.183625:0:6610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e57f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3325:x1870622732904960:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965083.183633:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:0.0:1783965083.183672:0:3325:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94743706d500 x1870622732904960/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783965099 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783965083.183717:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743706d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3325:1870622732904960:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1783965083.183941:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1783965083.307486:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783965083.515445:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965083.515475:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965083.515542:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965083.515590:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715044480 00000100:00100000:3.0:1783965083.515601:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715044480 00000100:00100000:3.0:1783965083.515657:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 281 00000100:00100000:3.0:1783965083.515667:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947408eca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+13:2357:x1870622715044480:12345-192.168.204.12@tcp:400:kworker.0 00000100:00100000:3.0:1783965083.515737:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947408eca050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+13:2357:x1870622715044480:12345-192.168.204.12@tcp:400:kworker.0 Request processed in 72us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965083.515744:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 281 00000100:00100000:1.0:1783965083.521859:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715044736 00000100:00100000:1.0:1783965083.521874:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715044736 00000100:00100000:0.0:1783965083.522166:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715044608 00000100:00100000:0.0:1783965083.522171:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715044608 00000100:00100000:0.0:1783965083.522269:0:6632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 120 00000100:00100000:0.0:1783965083.522279:0:6632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e57ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9923189b-eb4a-470c-ab45-969435371000+5:2357:x1870622715044608:12345-192.168.204.12@tcp:400:kworker.0 00000100:00100000:0.0:1783965083.522378:0:6632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e57ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9923189b-eb4a-470c-ab45-969435371000+5:2357:x1870622715044608:12345-192.168.204.12@tcp:400:kworker.0 Request processed in 99us (6834us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965083.522386:0:6632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 120 00000100:00100000:0.0:1783965083.522549:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 121 00000100:00100000:0.0:1783965083.522555:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e57d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49bbacc1-b013-4591-8d15-02f4f0d1884e+5:2357:x1870622715044736:12345-192.168.204.12@tcp:400:kworker.0 00000100:00100000:0.0:1783965083.522588:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e57d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49bbacc1-b013-4591-8d15-02f4f0d1884e+5:2357:x1870622715044736:12345-192.168.204.12@tcp:400:kworker.0 Request processed in 33us (7112us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965083.522595:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 121 00000100:00080000:2.0:1783965083.522673:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1783965084.332916:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783965085.355350:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1783965085.877343:0:11561:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1783965086.252381:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743706d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3325:1870622732905472:0@lo:400:kworker.0 00000100:00100000:0.0:1783965086.252637:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783965086.252705:0:3325:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783965086.252711:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743706f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3325:1870622732905344:0@lo:400:kworker.0 00000100:00100000:0.0:1783965086.252740:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783965086.252776:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732905344 00000100:00100000:0.0:1783965086.252784:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732905344 00000100:00100000:0.0:1783965086.252854:0:6632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:0.0:1783965086.252866:0:6632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743706ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3325:x1870622732905344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783965086.252925:0:6632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743706ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3325:x1870622732905344:12345-0@lo:400:kworker.0 Request processed in 62us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965086.252940:0:6632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00080000:0.0:1783965086.252967:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783965086.253011:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743706f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3325:1870622732905344:0@lo:400:kworker.0 00000100:00100000:3.0:1783965086.253174:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743706d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ae0997f7-3a15-4fc6-865a-35b2f101956e:3322:1870622732905088:0@lo:400:kworker.0 00000100:00100000:3.0:1783965086.253245:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783965086.253276:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743706dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3322:1870622732905600:0@lo:400:kworker.0 00000100:00100000:3.0:1783965086.253306:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783965086.253326:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1783965086.253332:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743706d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3322:1870622732905216:0@lo:400:kworker.0 00000100:00100000:3.0:1783965086.253355:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783965086.253373:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743706df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3322:1870622732905728:0@lo:400:kworker.0 00000100:00100000:3.0:1783965086.253398:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783965086.253593:0:6609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732905472 00000100:00100000:3.0:1783965086.253598:0:6609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732905472 00000100:00100000:3.0:1783965086.253642:0:6609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732905728 00000100:00100000:3.0:1783965086.253645:0:6609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732905728 00000100:00100000:3.0:1783965086.253669:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1783965086.253676:0:6609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743706e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3325:x1870622732905472:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783965086.253722:0:6609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743706e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3325:x1870622732905472:12345-0@lo:400:kworker.0 Request processed in 47us (1086us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965086.253728:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1783965086.253743:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1783965086.253749:0:6609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436c3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3322:x1870622732905728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783965086.253781:0:6609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436c3d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3322:x1870622732905728:12345-0@lo:400:kworker.0 Request processed in 32us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965086.253787:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1783965086.253808:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732905088 00000100:00100000:3.0:1783965086.253811:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732905088 00000100:00100000:3.0:1783965086.253835:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 282 00000100:00100000:3.0:1783965086.253841:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947408eca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae0997f7-3a15-4fc6-865a-35b2f101956e+19:3322:x1870622732905088:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783965086.253873:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947408eca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae0997f7-3a15-4fc6-865a-35b2f101956e+19:3322:x1870622732905088:12345-0@lo:400:kworker.0 Request processed in 32us (629us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965086.253879:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 282 00000100:00100000:3.0:1783965086.253913:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732905600 00000100:00100000:3.0:1783965086.253916:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732905600 00000100:00100000:3.0:1783965086.253947:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732905216 00000100:00100000:3.0:1783965086.253950:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732905216 00000100:00100000:3.0:1783965086.253976:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1783965086.253984:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436c3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3322:x1870622732905600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783965086.254018:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436c3d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3322:x1870622732905600:12345-0@lo:400:kworker.0 Request processed in 36us (712us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965086.254031:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:3.0:1783965086.254044:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:3.0:1783965086.254064:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436c3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3322:x1870622732905216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783965086.254092:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436c3c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3322:x1870622732905216:12345-0@lo:400:kworker.0 Request processed in 29us (736us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965086.254096:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00080000:3.0:1783965086.254131:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783965086.254135:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783965086.254137:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783965086.254159:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743706d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3322:1870622732905216:0@lo:400:kworker.0 00000100:00100000:3.0:1783965086.254169:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743706df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3322:1870622732905728:0@lo:400:kworker.0 00000100:00100000:3.0:1783965086.254176:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743706d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ae0997f7-3a15-4fc6-865a-35b2f101956e:3322:1870622732905088:0@lo:400:kworker.0 00000100:00100000:3.0:1783965086.254184:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743706dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3322:1870622732905600:0@lo:400:kworker.0 00010000:00080000:3.0:1783965086.254251:0:3325:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94743706d880 x1870622732905472/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1783965102 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783965086.254263:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743706d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3325:1870622732905472:0@lo:400:kworker.0 00000100:00100000:0.0:1783965086.254769:0:3325:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783965086.254783:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947436305f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3325:1870622732905856:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783965086.254829:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783965086.254902:0:6610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732905856 00000100:00100000:1.0:1783965086.254908:0:6610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732905856 00000100:00100000:1.0:1783965086.254987:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1783965086.254997:0:6610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743706f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3325:x1870622732905856:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783965086.255037:0:6610:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783965086.255102:0:6610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743706f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3325:x1870622732905856:12345-0@lo:13:osp-pre-1-0.0 Request processed in 108us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965086.255109:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1783965086.260767:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947436305f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3325:1870622732905856:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1783965086.379527:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1783965086.379986:0:11725:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 13:51:24 (1783965084) 00010000:00010000:1.0:1783965087.412403:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783965088.069272:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965088.069732:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715044864 00000100:00100000:3.0:1783965088.069748:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715044864 00000100:00100000:3.0:1783965088.069841:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 32 00000100:00100000:3.0:1783965088.069854:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743706c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9923189b-eb4a-470c-ab45-969435371000+5:10203:x1870622715044864:12345-192.168.204.12@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783965088.069881:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783965088.069916:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27a00/0xe782b916994fd6a5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5eff4e expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965088.070067:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fd6ac lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965088.070085:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fd6ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965088.070101:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fd6ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783965088.070380:0:5813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1783965088.070384:0:5813:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1783965088.070627:0:5813:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fd6ac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965088.070661:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27a00/0xe782b916994fd6a5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5eff4e expref: 7 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965088.070684:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fd6ac lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5eff4e expref: 6 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965088.070693:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9474186e7a00) 00010000:00010000:3.0:1783965088.070696:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783965088.070700:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff947436f26200, rc 0) 00000100:00100000:3.0:1783965088.070866:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743706c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9923189b-eb4a-470c-ab45-969435371000+6:10203:x1870622715044864:12345-192.168.204.12@tcp:101:lhsmtool_posix.0 Request processed in 1013us (1606us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965088.070875:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 32 00000100:00080000:0.0:1783965088.071186:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783965088.078826:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965088.079003:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715044992 00000100:00100000:3.0:1783965088.079026:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715044992 00000100:00100000:3.0:1783965088.082340:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 33 00000100:00100000:3.0:1783965088.082369:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743706d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9923189b-eb4a-470c-ab45-969435371000+6:10204:x1870622715044992:12345-192.168.204.12@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783965088.082401:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783965088.082449:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27a00/0xe782b916994fd6b3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5eff55 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965088.082544:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26600/0xe782b916994fd6ba lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965088.082560:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26600/0xe782b916994fd6ba lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965088.082573:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26600/0xe782b916994fd6ba lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965088.082591:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fd6c1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965088.082598:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fd6c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965088.082606:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fd6c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965088.086354:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26a00/0xe782b916994fd6c8 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965088.086388:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26a00/0xe782b916994fd6c8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965088.086403:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26a00/0xe782b916994fd6c8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783965088.086562:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1783965088.086568:0:5811:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1783965088.086661:0:5811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26a00/0xe782b916994fd6c8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965088.086677:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26600/0xe782b916994fd6ba lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965088.086684:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26600/0xe782b916994fd6ba lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965088.086691:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26600/0xe782b916994fd6ba lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965088.086712:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947436f26600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1783965088.086718:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26600/0xe782b916994fd6ba lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965088.086727:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26600/0xe782b916994fd6ba lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965088.086744:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9474186e7a00) 00010000:00010000:3.0:1783965088.086748:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783965088.086754:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26600/0xe782b916994fd6ba lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965088.086761:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26600/0xe782b916994fd6ba lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965088.086778:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fd6c1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965088.086795:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fd6c1 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965088.086801:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fd6c1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965088.086806:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947436f26e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1783965088.086810:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fd6c1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965088.086816:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fd6c1 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965088.086824:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9474186e7900) 00010000:00010000:3.0:1783965088.086827:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783965088.086830:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fd6c1 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965088.086836:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fd6c1 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965088.086889:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27a00/0xe782b916994fd6b3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5eff55 expref: 8 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965088.086907:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26a00/0xe782b916994fd6c8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5eff55 expref: 7 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965088.086916:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9474186e7500) 00010000:00010000:3.0:1783965088.086918:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783965088.087312:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff947436f26a00, rc 0) 00000100:00100000:3.0:1783965088.087485:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743706d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9923189b-eb4a-470c-ab45-969435371000+7:10204:x1870622715044992:12345-192.168.204.12@tcp:101:lhsmtool_posix.0 Request processed in 5126us (8672us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965088.087497:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 33 00000100:00100000:2.0:1783965088.093842:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965088.093962:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715045248 00000100:00100000:3.0:1783965088.093976:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715045248 00000100:00100000:3.0:1783965088.094066:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 34 00000100:00100000:3.0:1783965088.094079:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e57fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9923189b-eb4a-470c-ab45-969435371000+7:10204:x1870622715045248:12345-192.168.204.12@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783965088.094109:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783965088.094140:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27a00/0xe782b916994fd6cf lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5eff5c expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965088.094282:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fd6d6 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965088.094301:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fd6d6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965088.094315:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fd6d6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965088.094333:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26600/0xe782b916994fd6dd lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965088.094340:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26600/0xe782b916994fd6dd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965088.094347:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26600/0xe782b916994fd6dd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965088.095048:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26000/0xe782b916994fd6e4 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965088.095072:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26000/0xe782b916994fd6e4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965088.095080:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26000/0xe782b916994fd6e4 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783965088.095095:0:5813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:3.0:1783965088.095385:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fd6d6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965088.095394:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fd6d6 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965088.095402:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fd6d6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965088.095408:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947436f26e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1783965088.095413:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fd6d6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965088.095421:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fd6d6 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965088.095436:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9474186e7500) 00010000:00010000:3.0:1783965088.095440:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783965088.095445:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fd6d6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965088.095452:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fd6d6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965088.095469:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26600/0xe782b916994fd6dd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965088.095482:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26600/0xe782b916994fd6dd lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965088.095488:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26600/0xe782b916994fd6dd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965088.095493:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947436f26600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1783965088.095496:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26600/0xe782b916994fd6dd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965088.095502:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26600/0xe782b916994fd6dd lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965088.095511:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9474186e7900) 00010000:00010000:3.0:1783965088.095514:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783965088.095517:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26600/0xe782b916994fd6dd lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965088.095523:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26600/0xe782b916994fd6dd lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965088.096067:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27a00/0xe782b916994fd6cf lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5eff5c expref: 10 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965088.096087:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26000/0xe782b916994fd6e4 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5eff5c expref: 9 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965088.096096:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9474186e7d00) 00010000:00010000:3.0:1783965088.096099:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783965088.096109:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff947436f26000, rc 0) 00000100:00100000:3.0:1783965088.096267:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e57fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9923189b-eb4a-470c-ab45-969435371000+9:10204:x1870622715045248:12345-192.168.204.12@tcp:101:lhsmtool_posix.0 Request processed in 2121us (2372us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1783965088.096279:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 34 00000100:00100000:0.0:1783965088.107370:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965088.107540:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715045376 00000100:00100000:3.0:1783965088.107554:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715045376 00000100:00100000:3.0:1783965088.107635:0:6632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 35 00000100:00100000:3.0:1783965088.107648:0:6632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743706dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9923189b-eb4a-470c-ab45-969435371000+9:10204:x1870622715045376:12345-192.168.204.12@tcp:59:lhsmtool_posix.0 00000100:00100000:3.0:1783965088.107812:0:6632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743706dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9923189b-eb4a-470c-ab45-969435371000+9:10204:x1870622715045376:12345-192.168.204.12@tcp:59:lhsmtool_posix.0 Request processed in 165us (456us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965088.107820:0:6632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 35 00000100:00100000:0.0:1783965088.299586:0:3324:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783965088.299633:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743706d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3324:1870622732905984:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783965088.299734:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783965088.299822:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732905984 00000100:00100000:0.0:1783965088.299833:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732905984 00000100:00100000:0.0:1783965088.299915:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1783965088.299927:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743706df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3324:x1870622732905984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783965088.299982:0:6611:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783965088.300045:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743706df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3324:x1870622732905984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 120us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965088.300053:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:0.0:1783965088.300080:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1783965088.300117:0:3324:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94743706d500 x1870622732905984/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783965104 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783965088.300142:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743706d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3324:1870622732905984:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1783965088.428418:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783965088.633074:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783965088.633117:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783965088.633155:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965088.633299:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715045632 00000100:00100000:1.0:1783965088.633313:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715045632 00000100:00100000:1.0:1783965088.633373:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715045760 00000100:00100000:1.0:1783965088.633376:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715045760 00000100:00100000:1.0:1783965088.633412:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 125 00000100:00100000:1.0:1783965088.633423:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743706d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9923189b-eb4a-470c-ab45-969435371000+9:2359:x1870622715045632:12345-192.168.204.12@tcp:400:kworker.0 00000100:00100000:1.0:1783965088.633537:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743706d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9923189b-eb4a-470c-ab45-969435371000+9:2359:x1870622715045632:12345-192.168.204.12@tcp:400:kworker.0 Request processed in 114us (418us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965088.633546:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 125 00000100:00100000:1.0:1783965088.633565:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 126 00000100:00100000:1.0:1783965088.633587:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743706d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49bbacc1-b013-4591-8d15-02f4f0d1884e+5:2360:x1870622715045760:12345-192.168.204.12@tcp:400:kworker.0 00000100:00100000:1.0:1783965088.633624:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743706d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49bbacc1-b013-4591-8d15-02f4f0d1884e+5:2360:x1870622715045760:12345-192.168.204.12@tcp:400:kworker.0 Request processed in 38us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965088.633631:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 126 00000100:00080000:1.0:1783965088.633654:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783965088.634120:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715045504 00000100:00100000:3.0:1783965088.634126:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715045504 00000100:00100000:3.0:1783965088.634172:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 283 00000100:00100000:3.0:1783965088.634180:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947408ec8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+13:2360:x1870622715045504:12345-192.168.204.12@tcp:400:kworker.0 00000100:00100000:3.0:1783965088.634253:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947408ec8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+13:2360:x1870622715045504:12345-192.168.204.12@tcp:400:kworker.0 Request processed in 74us (1193us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965088.634261:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 283 00000040:00080000:1.0:1783965088.947371:0:11561:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1783965089.457303:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783965090.303031:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965090.303742:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715045888 00000100:00100000:1.0:1783965090.303755:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715045888 00000100:00100000:1.0:1783965090.303840:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 36 00000100:00100000:1.0:1783965090.303850:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743fb92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9923189b-eb4a-470c-ab45-969435371000+9:10246:x1870622715045888:12345-192.168.204.12@tcp:101:lfs.0 00010000:00010000:1.0:1783965090.303872:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783965090.303897:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee200/0xe782b916994fd6f2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5eff63 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965090.303968:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef800/0xe782b916994fd6f9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965090.303994:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef800/0xe782b916994fd6f9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965090.304009:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef800/0xe782b916994fd6f9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965090.304025:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eec00/0xe782b916994fd700 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965090.304032:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eec00/0xe782b916994fd700 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965090.304056:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eec00/0xe782b916994fd700 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965090.304356:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef800/0xe782b916994fd6f9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965090.304365:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef800/0xe782b916994fd6f9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965090.304372:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef800/0xe782b916994fd6f9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965090.304378:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743d9ef800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1783965090.304383:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef800/0xe782b916994fd6f9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1783965090.304635:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1783965090.304804:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef800/0xe782b916994fd6f9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965090.304819:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9474186e7a00) 00010000:00010000:1.0:1783965090.304823:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783965090.304827:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef800/0xe782b916994fd6f9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965090.304834:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef800/0xe782b916994fd6f9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965090.304850:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eec00/0xe782b916994fd700 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965090.304857:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eec00/0xe782b916994fd700 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965090.304870:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eec00/0xe782b916994fd700 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965090.304876:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743d9eec00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1783965090.304878:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eec00/0xe782b916994fd700 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965090.304885:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eec00/0xe782b916994fd700 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965090.304893:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff947407b5c300) 00010000:00010000:1.0:1783965090.304895:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783965090.304898:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eec00/0xe782b916994fd700 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965090.304903:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eec00/0xe782b916994fd700 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965090.304944:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee200/0xe782b916994fd6f2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5eff63 expref: 10 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965090.304955:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9474186e7a00) 00010000:00010000:1.0:1783965090.304957:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783965090.304960:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee200/0xe782b916994fd6f2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5eff63 expref: 10 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965090.304979:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94743d9ee200, rc 0) 00000100:00100000:1.0:1783965090.305056:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743fb92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9923189b-eb4a-470c-ab45-969435371000+9:10246:x1870622715045888:12345-192.168.204.12@tcp:101:lfs.0 Request processed in 1207us (4853us total) trans 0 rc 301/301 00000100:00100000:1.0:1783965090.305074:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 36 00000100:00100000:3.0:1783965090.318821:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965090.318979:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715046144 00000100:00100000:2.0:1783965090.318990:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715046144 00000100:00100000:2.0:1783965090.319054:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 37 00000100:00100000:2.0:1783965090.319066:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436c3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9923189b-eb4a-470c-ab45-969435371000+9:10246:x1870622715046144:12345-192.168.204.12@tcp:36:lfs.0 00010000:00010000:2.0:1783965090.319123:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783965090.319150:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fd6ac lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5eff4e expref: 9 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965090.319173:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9474186e7a00) 00010000:00010000:2.0:1783965090.319184:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783965090.319665:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fc00/0xe782b916994fd707 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965090.319682:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fc00/0xe782b916994fd707 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965090.319693:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fc00/0xe782b916994fd707 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965090.319707:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e000/0xe782b916994fd70e lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965090.319714:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e000/0xe782b916994fd70e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965090.319732:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e000/0xe782b916994fd70e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783965090.321548:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:2.0:1783965090.321565:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fc00/0xe782b916994fd707 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965090.321575:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fc00/0xe782b916994fd707 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965090.321581:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fc00/0xe782b916994fd707 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965090.321587:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743fb8fc00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1783965090.321592:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fc00/0xe782b916994fd707 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965090.321611:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fc00/0xe782b916994fd707 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965090.321628:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff947402a2d900) 00010000:00010000:2.0:1783965090.321631:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783965090.321635:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fc00/0xe782b916994fd707 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965090.321640:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fc00/0xe782b916994fd707 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783965090.321667:0:5811:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000c9524dd reply state 00000000babb2d57 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e000/0xe782b916994fd70e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783965090.321689:0:5811:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783965090.321805:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436c3f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9923189b-eb4a-470c-ab45-969435371000+10:10246:x1870622715046144:12345-192.168.204.12@tcp:36:lfs.0 Request processed in 2737us (2990us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1783965090.321814:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 37 00010000:00010000:3.0:1783965090.324074:0:3308:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e000/0xe782b916994fd70e lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965090.324093:0:3308:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e000/0xe782b916994fd70e lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965090.324100:0:3308:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e000/0xe782b916994fd70e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965090.324126:0:3308:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743fb8e000 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1783965090.324131:0:3308:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e000/0xe782b916994fd70e lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965090.324138:0:3308:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e000/0xe782b916994fd70e lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965090.324155:0:3308:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff947402a2df00) 00010000:00010000:3.0:1783965090.324158:0:3308:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783965090.324161:0:3308:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e000/0xe782b916994fd70e lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965090.324168:0:3308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e000/0xe782b916994fd70e lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783965090.417672:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965090.418585:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715046272 00000100:00100000:1.0:1783965090.418598:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715046272 00000100:00100000:1.0:1783965090.418675:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 38 00000100:00100000:1.0:1783965090.418686:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e299500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9923189b-eb4a-470c-ab45-969435371000+9:10254:x1870622715046272:12345-192.168.204.12@tcp:101:lctl.0 00010000:00010000:1.0:1783965090.418721:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783965090.418746:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eec00/0xe782b916994fd715 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5eff6a expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965090.418946:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef800/0xe782b916994fd71c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965090.418962:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef800/0xe782b916994fd71c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965090.418985:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef800/0xe782b916994fd71c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783965090.419052:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1783965090.419056:0:5812:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1783965090.419093:0:5812:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef800/0xe782b916994fd71c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965090.419117:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eec00/0xe782b916994fd715 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5eff6a expref: 11 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965090.419139:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef800/0xe782b916994fd71c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5eff6a expref: 10 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965090.419166:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff947407b5c300) 00010000:00010000:1.0:1783965090.419169:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783965090.419172:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94743d9ef800, rc 0) 00000100:00100000:0.0:1783965090.420182:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e299500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9923189b-eb4a-470c-ab45-969435371000+10:10254:x1870622715046272:12345-192.168.204.12@tcp:101:lctl.0 Request processed in 1490us (2512us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965090.420194:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 38 00010000:00010000:1.0:1783965090.475853:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783965090.511086:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965090.511482:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715046400 00000100:00100000:3.0:1783965090.511493:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715046400 00000100:00100000:3.0:1783965090.511557:0:6632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 39 00000100:00100000:3.0:1783965090.511566:0:6632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e57c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9923189b-eb4a-470c-ab45-969435371000+10:10260:x1870622715046400:12345-192.168.204.12@tcp:101:bash.0 00010000:00010000:3.0:1783965090.511586:0:6632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783965090.511607:0:6632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27a00/0xe782b916994fd723 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5eff71 expref: -99 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965090.511667:0:6632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26600/0xe782b916994fd72a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965090.511681:0:6632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26600/0xe782b916994fd72a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965090.511707:0:6632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26600/0xe782b916994fd72a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965090.511721:0:6632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fd731 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965090.511728:0:6632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fd731 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965090.511734:0:6632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fd731 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965090.511840:0:6632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27200/0xe782b916994fd738 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965090.511847:0:6632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27200/0xe782b916994fd738 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965090.511854:0:6632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27200/0xe782b916994fd738 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783965090.511886:0:6632:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:3.0:1783965090.511890:0:6632:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1783965090.511926:0:6632:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27200/0xe782b916994fd738 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965090.511937:0:6632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26600/0xe782b916994fd72a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965090.511944:0:6632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26600/0xe782b916994fd72a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965090.511959:0:6632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26600/0xe782b916994fd72a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965090.511975:0:6632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947436f26600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1783965090.511980:0:6632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26600/0xe782b916994fd72a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965090.511987:0:6632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26600/0xe782b916994fd72a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965090.512000:0:6632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff947407b5c300) 00010000:00010000:3.0:1783965090.512003:0:6632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783965090.512007:0:6632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26600/0xe782b916994fd72a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965090.512014:0:6632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26600/0xe782b916994fd72a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965090.512026:0:6632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fd731 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965090.512032:0:6632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fd731 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965090.512038:0:6632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fd731 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965090.512043:0:6632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947436f26e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1783965090.512046:0:6632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fd731 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965090.512060:0:6632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fd731 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965090.512067:0:6632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9474186e7900) 00010000:00010000:3.0:1783965090.512069:0:6632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783965090.512071:0:6632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fd731 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965090.512077:0:6632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fd731 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965090.512103:0:6632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27a00/0xe782b916994fd723 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5eff71 expref: 12 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965090.512115:0:6632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27200/0xe782b916994fd738 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5eff71 expref: 11 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965090.512121:0:6632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9474186e7a00) 00010000:00010000:3.0:1783965090.512123:0:6632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1783965090.512126:0:6632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff947436f27200, rc 0) 00000100:00100000:3.0:1783965090.512247:0:6632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e57c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9923189b-eb4a-470c-ab45-969435371000+11:10260:x1870622715046400:12345-192.168.204.12@tcp:101:bash.0 Request processed in 680us (1168us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965090.512254:0:6632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 39 00000100:00100000:3.0:1783965090.521251:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965090.521947:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715046656 00000100:00100000:1.0:1783965090.521959:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715046656 00000100:00100000:1.0:1783965090.522036:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 40 00000100:00100000:1.0:1783965090.522046:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947429f46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9923189b-eb4a-470c-ab45-969435371000+11:10260:x1870622715046656:12345-192.168.204.12@tcp:101:bash.0 00010000:00010000:1.0:1783965090.522068:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783965090.522092:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eec00/0xe782b916994fd73f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5eff78 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965090.522297:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee200/0xe782b916994fd746 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965090.522314:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee200/0xe782b916994fd746 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965090.522327:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee200/0xe782b916994fd746 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965090.522343:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef600/0xe782b916994fd74d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965090.522350:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef600/0xe782b916994fd74d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965090.522357:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef600/0xe782b916994fd74d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783965090.524216:0:5813:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:1.0:1783965090.524431:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eee00/0xe782b916994fd754 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965090.524447:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eee00/0xe782b916994fd754 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965090.524458:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eee00/0xe782b916994fd754 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965090.524498:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee200/0xe782b916994fd746 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965090.524505:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee200/0xe782b916994fd746 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965090.524512:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee200/0xe782b916994fd746 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965090.524518:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743d9ee200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1783965090.524523:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee200/0xe782b916994fd746 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965090.524529:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee200/0xe782b916994fd746 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965090.524541:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9474186e7a00) 00010000:00010000:1.0:1783965090.524544:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783965090.524548:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee200/0xe782b916994fd746 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965090.524569:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee200/0xe782b916994fd746 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783965090.524588:0:5813:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000061cc7ab0 reply state 000000003923fb0b transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef600/0xe782b916994fd74d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783965090.524597:0:5813:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1783965090.524635:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eec00/0xe782b916994fd73f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5eff78 expref: 14 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965090.524650:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eee00/0xe782b916994fd754 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5eff78 expref: 13 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965090.524657:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff947407b5c100) 00010000:00010000:1.0:1783965090.524659:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783965090.524662:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94743d9eee00, rc 0) 00000100:00100000:1.0:1783965090.524740:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947429f46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9923189b-eb4a-470c-ab45-969435371000+14:10260:x1870622715046656:12345-192.168.204.12@tcp:101:bash.0 Request processed in 2695us (3539us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1783965090.524749:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 40 00010000:00010000:3.0:1783965090.526699:0:3309:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef600/0xe782b916994fd74d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965090.526717:0:3309:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef600/0xe782b916994fd74d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965090.526739:0:3309:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef600/0xe782b916994fd74d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965090.526746:0:3309:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743d9ef600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1783965090.526755:0:3309:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef600/0xe782b916994fd74d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965090.526763:0:3309:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef600/0xe782b916994fd74d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965090.526780:0:3309:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff947407b5c800) 00010000:00010000:3.0:1783965090.526783:0:3309:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783965090.526787:0:3309:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef600/0xe782b916994fd74d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965090.526793:0:3309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef600/0xe782b916994fd74d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783965090.530483:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783965090.530574:0:6609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715046784 00000100:00100000:0.0:1783965090.530584:0:6609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715046784 00000100:00100000:0.0:1783965090.530636:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 21 00000100:00100000:0.0:1783965090.530645:0:6609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947429f46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2356:x1870622715046784:12345-192.168.204.12@tcp:8:bash.0 00010000:00080000:0.0:1783965090.530679:0:6609:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from 9923189b-eb4a-470c-ab45-969435371000@192.168.204.12@tcp t0 exp 0000000000000000 cur 324 last 0 00000020:00000080:0.0:1783965090.530712:0:6609:0:(genops.c:1406:class_connect()) connect: client 9923189b-eb4a-470c-ab45-969435371000, cookie 0xe782b916994fd762 00002000:00100000:0.0:1783965090.530726:0:6609:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 9923189b-eb4a-470c-ab45-969435371000/ffff947436b4f000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1783965090.530749:0:6609:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1783965090.530983:0:6609:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1783965090.531012:0:6609:0:(import.c:65:import_set_state_nolock()) ffff947436b4e000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783965090.531085:0:6609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947429f46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9923189b-eb4a-470c-ab45-969435371000+6:2356:x1870622715046784:12345-192.168.204.12@tcp:8:bash.0 Request processed in 439us (611us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965090.531092:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 21 00000100:00100000:2.0:1783965090.534249:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965090.534444:0:8738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715046912 00000100:00100000:3.0:1783965090.534454:0:8738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715046912 00000100:00100000:3.0:1783965090.534537:0:8738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 22 00000100:00100000:3.0:1783965090.534547:0:8738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e57d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9923189b-eb4a-470c-ab45-969435371000+6:0:x1870622715046912:12345-192.168.204.12@tcp:101:bash.0 00010000:00010000:3.0:1783965090.534563:0:8738:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783965090.534584:0:8738:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a28d02c2/0xe782b916994fd769 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5eff7f expref: -99 pid: 8738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783965090.534610:0:8738:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783965090.534628:0:8738:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=324s v=(0 0) 00010000:00010000:3.0:1783965090.534644:0:8738:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783965090.534654:0:8738:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a28d02c2/0xe782b916994fd769 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5eff7f expref: 7 pid: 8738 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965090.534675:0:8738:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a28d02c2/0xe782b916994fd769 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5eff7f expref: 7 pid: 8738 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965090.534689:0:8738:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff947436f27a00, rc 0) 00000100:00100000:3.0:1783965090.534753:0:8738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e57d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9923189b-eb4a-470c-ab45-969435371000+7:0:x1870622715046912:12345-192.168.204.12@tcp:101:bash.0 Request processed in 207us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965090.534759:0:8738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 22 00000100:00080000:0.0:1783965090.534871:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783965090.542800:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783965090.542906:0:6609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715047040 00000100:00100000:0.0:1783965090.542916:0:6609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715047040 00000100:00100000:0.0:1783965090.542984:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 23 00000100:00100000:0.0:1783965090.542994:0:6609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e57d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9923189b-eb4a-470c-ab45-969435371000+7:10260:x1870622715047040:12345-192.168.204.12@tcp:101:bash.0 00010000:00010000:0.0:1783965090.543023:0:6609:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783965090.543044:0:6609:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000006da8dfc/0xe782b916994fd770 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5eff86 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965090.543072:0:6609:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a28d02c2/0xe782b916994fd769 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5eff7f expref: 8 pid: 8738 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965090.543082:0:6609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783965090.543086:0:6609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783965090.543090:0:6609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000006da8dfc/0xe782b916994fd770 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5eff86 expref: 8 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965090.543121:0:6609:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a28d02c2/0xe782b916994fd769 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5eff7f expref: 8 pid: 8738 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965090.543135:0:6609:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a28d02c2/0xe782b916994fd769 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5eff7f expref: 8 pid: 8738 timeout: 424 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783965090.543151:0:6609:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743fb93480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6609:1870622732906112:192.168.204.12@tcp:104: 00000100:00100000:0.0:1783965090.543432:0:6609:0:(client.c:2702:ptlrpc_set_wait()) set ffff94743e29f6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783965090.552567:0:6609:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743fb93480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6609:1870622732906112:192.168.204.12@tcp:104: 00010000:00010000:0.0:1783965090.552825:0:6609:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000006da8dfc/0xe782b916994fd770 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5eff86 expref: 8 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965090.552848:0:6609:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff947430c11000, rc 0) 00000100:00100000:0.0:1783965090.552963:0:6609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e57d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9923189b-eb4a-470c-ab45-969435371000+8:10260:x1870622715047040:12345-192.168.204.12@tcp:101:bash.0 Request processed in 9968us (10170us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965090.552982:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 23 00000100:00100000:2.0:1783965090.560190:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965090.563030:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715047168 00000100:00100000:1.0:1783965090.563045:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715047168 00010000:00010000:1.0:1783965090.563100:0:5798:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a28d02c2/0xe782b916994fd769 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5eff7f expref: 8 pid: 8738 timeout: 424 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783965090.563152:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 35 00000100:00100000:1.0:1783965090.563163:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e2a4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9923189b-eb4a-470c-ab45-969435371000+8:2360:x1870622715047168:12345-192.168.204.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783965090.563180:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783965090.563311:0:5798:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a28d02c2/0xe782b916994fd769 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5eff7f expref: 8 pid: 8738 timeout: 424 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965090.563327:0:5798:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a28d02c2/0xe782b916994fd769 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5eff7f expref: 8 pid: 8738 timeout: 424 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965090.563353:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a28d02c2/0xe782b916994fd769 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5eff7f expref: 8 pid: 8738 timeout: 424 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965090.563371:0:5798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783965090.563376:0:5798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783965090.563385:0:5798:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000006da8dfc/0xe782b916994fd770 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5eff86 expref: 7 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965090.563395:0:5798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000006da8dfc/0xe782b916994fd770 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5eff86 expref: 7 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965090.563501:0:5798:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000006da8dfc/0xe782b916994fd770 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5eff86 expref: 7 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783965090.563515:0:5798:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947436305f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5798:1870622732906240:192.168.204.12@tcp:105: 00000100:00100000:1.0:1783965090.563759:0:5798:0:(client.c:2702:ptlrpc_set_wait()) set ffff9474400a3300 going to sleep for 11 seconds 00000100:00100000:1.0:1783965090.567352:0:5798:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947436305f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5798:1870622732906240:192.168.204.12@tcp:105: 00010000:00010000:1.0:1783965090.567380:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783965090.567441:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e2a4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9923189b-eb4a-470c-ab45-969435371000+7:2360:x1870622715047168:12345-192.168.204.12@tcp:103:ldlm_bl.0 Request processed in 4279us (7261us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965090.567470:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 35 00000100:00100000:2.0:1783965090.569096:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783965090.569243:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715047424 00000100:00100000:0.0:1783965090.569253:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715047424 00000100:00100000:0.0:1783965090.569304:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 6 00000100:00100000:0.0:1783965090.569314:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e2a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9923189b-eb4a-470c-ab45-969435371000+13:10260:x1870622715047424:12345-192.168.204.12@tcp:35:bash.0 00000100:00100000:0.0:1783965090.569778:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e2a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9923189b-eb4a-470c-ab45-969435371000+14:10260:x1870622715047424:12345-192.168.204.12@tcp:35:bash.0 Request processed in 464us (688us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1783965090.569786:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 6 00000100:00100000:2.0:1783965090.721027:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965090.721460:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715047680 00000100:00100000:1.0:1783965090.721471:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715047680 00000100:00100000:1.0:1783965090.721541:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 41 00000100:00100000:1.0:1783965090.721551:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e2a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9923189b-eb4a-470c-ab45-969435371000+14:10270:x1870622715047680:12345-192.168.204.12@tcp:101:lfs.0 00010000:00010000:1.0:1783965090.721577:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783965090.721598:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eec00/0xe782b916994fd777 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5eff8d expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783965090.721709:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:1.0:1783965090.721842:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eec00/0xe782b916994fd777 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5eff8d expref: 16 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965090.721861:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff947407b5c300) 00010000:00010000:1.0:1783965090.721864:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783965090.721868:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eec00/0xe782b916994fd777 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5eff8d expref: 16 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965090.721887:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94743d9eec00, rc 0) 00000100:00100000:1.0:1783965090.721945:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e2a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9923189b-eb4a-470c-ab45-969435371000+15:10270:x1870622715047680:12345-192.168.204.12@tcp:101:lfs.0 Request processed in 396us (929us total) trans 4294967313 rc 301/301 00000100:00100000:1.0:1783965090.721952:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 41 00000100:00100000:2.0:1783965090.727629:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783965090.727711:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715047936 00000100:00100000:0.0:1783965090.727721:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715047936 00000100:00100000:0.0:1783965090.727779:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 7 00000100:00100000:0.0:1783965090.727790:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e2a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9923189b-eb4a-470c-ab45-969435371000+15:10270:x1870622715047936:12345-192.168.204.12@tcp:35:lfs.0 00000100:00100000:0.0:1783965090.728089:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e2a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9923189b-eb4a-470c-ab45-969435371000+16:10270:x1870622715047936:12345-192.168.204.12@tcp:35:lfs.0 Request processed in 300us (468us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1783965090.728098:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 7 00000100:00100000:2.0:1783965090.819167:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965090.821046:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715048064 00000100:00100000:1.0:1783965090.821058:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715048064 00000100:00100000:1.0:1783965090.821123:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 42 00000100:00100000:1.0:1783965090.821133:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e2a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9923189b-eb4a-470c-ab45-969435371000+16:10276:x1870622715048064:12345-192.168.204.12@tcp:101:lfs.0 00010000:00010000:1.0:1783965090.821172:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783965090.821194:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eec00/0xe782b916994fd785 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5eff94 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965090.821296:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee200/0xe782b916994fd78c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965090.821310:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee200/0xe782b916994fd78c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965090.821323:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee200/0xe782b916994fd78c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783965090.821389:0:5813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:1.0:1783965090.821393:0:5813:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1783965090.821412:0:5813:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee200/0xe782b916994fd78c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965090.821435:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eec00/0xe782b916994fd785 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5eff94 expref: 18 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965090.821458:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee200/0xe782b916994fd78c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5eff94 expref: 17 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965090.821467:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9474186e7a00) 00010000:00010000:1.0:1783965090.821471:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783965090.821475:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94743d9ee200, rc 0) 00000100:00100000:1.0:1783965090.821547:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e2a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9923189b-eb4a-470c-ab45-969435371000+17:10276:x1870622715048064:12345-192.168.204.12@tcp:101:lfs.0 Request processed in 416us (2391us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965090.821554:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 42 00000100:00100000:2.0:1783965090.825828:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965090.825909:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715048320 00000100:00100000:1.0:1783965090.825919:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715048320 00000100:00100000:1.0:1783965090.825995:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 43 00000100:00100000:1.0:1783965090.826004:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e2a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9923189b-eb4a-470c-ab45-969435371000+17:10276:x1870622715048320:12345-192.168.204.12@tcp:101:lfs.0 00010000:00010000:1.0:1783965090.826026:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783965090.826058:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef200/0xe782b916994fd793 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5eff9b expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965090.826166:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee000/0xe782b916994fd79a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965090.826181:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee000/0xe782b916994fd79a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965090.826194:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee000/0xe782b916994fd79a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783965090.826249:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1783965090.826394:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef200/0xe782b916994fd793 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5eff9b expref: 20 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965090.826421:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee000/0xe782b916994fd79a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5eff9b expref: 19 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965090.826430:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff947407b5c100) 00010000:00010000:1.0:1783965090.826433:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783965090.826437:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94743d9ee000, rc 0) 00000100:00100000:1.0:1783965090.826885:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e2a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9923189b-eb4a-470c-ab45-969435371000+19:10276:x1870622715048320:12345-192.168.204.12@tcp:101:lfs.0 Request processed in 881us (1066us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1783965090.826913:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 43 00000100:00100000:2.0:1783965090.834830:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965090.834874:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965090.835076:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715048576 00000100:00100000:3.0:1783965090.835087:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715048576 00000100:00100000:3.0:1783965090.835150:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 44 00000100:00100000:3.0:1783965090.835161:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e2a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9923189b-eb4a-470c-ab45-969435371000+19:10276:x1870622715048576:12345-192.168.204.12@tcp:101:lfs.0 00010000:00010000:3.0:1783965090.835185:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783965090.835234:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fd7a8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5effa2 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965090.835334:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26600/0xe782b916994fd7af lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965090.835349:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26600/0xe782b916994fd7af lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965090.835361:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26600/0xe782b916994fd7af lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783965090.835373:0:5813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1783965090.835544:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fd7a8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5effa2 expref: 22 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965090.835564:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26600/0xe782b916994fd7af lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5effa2 expref: 21 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965090.835572:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff947407b5c100) 00010000:00010000:3.0:1783965090.835575:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1783965090.835579:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff947436f26600, rc 0) 00000100:00100000:0.0:1783965090.836072:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715048704 00000100:00100000:0.0:1783965090.836079:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715048704 00000100:00100000:0.0:1783965090.836130:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 2 00000100:00100000:0.0:1783965090.836139:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e2a6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9923189b-eb4a-470c-ab45-969435371000+22:2358:x1870622715048704:12345-192.168.204.12@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783965090.836151:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783965090.836167:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee000/0xe782b916994fd79a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5eff9b expref: 22 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965090.836181:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff947407b5c100) 00010000:00010000:0.0:1783965090.836192:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783965090.836559:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e2a6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9923189b-eb4a-470c-ab45-969435371000+21:2358:x1870622715048704:12345-192.168.204.12@tcp:103:ldlm_bl.0 Request processed in 420us (1682us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965090.836567:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 2 00000100:00100000:3.0:1783965090.836849:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e2a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9923189b-eb4a-470c-ab45-969435371000+20:10276:x1870622715048576:12345-192.168.204.12@tcp:101:lfs.0 Request processed in 1690us (2028us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1783965090.836856:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 44 00000100:00100000:0.0:1783965090.846268:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965090.846515:0:8738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715048832 00000100:00100000:3.0:1783965090.846526:0:8738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715048832 00000100:00100000:3.0:1783965090.846576:0:8738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 24 00000100:00100000:3.0:1783965090.846598:0:8738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743fb93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9923189b-eb4a-470c-ab45-969435371000+7:2360:x1870622715048832:12345-192.168.204.12@tcp:1:lfs.0 00010000:00010000:3.0:1783965090.846640:0:8738:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006127a45f/0xe782b916994fd7bd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965090.846779:0:8738:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000006da8dfc/0xe782b916994fd770 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5eff86 expref: 7 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965090.846788:0:8738:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x2:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1783965090.846792:0:8738:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783965090.846798:0:8738:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006127a45f/0xe782b916994fd7bd lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965090.846835:0:8738:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000006da8dfc/0xe782b916994fd770 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5eff86 expref: 7 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965090.846869:0:8738:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000006da8dfc/0xe782b916994fd770 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5eff86 expref: 7 pid: 6609 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783965090.846889:0:8738:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947429f44380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8738:1870622732906368:192.168.204.12@tcp:104: 00000100:00100000:3.0:1783965090.847184:0:8738:0:(client.c:2702:ptlrpc_set_wait()) set ffff9474110b6240 going to sleep for 11 seconds 00000100:00100000:2.0:1783965090.852657:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783965090.853717:0:6612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715048960 00000100:00100000:0.0:1783965090.853733:0:6612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715048960 00002000:00100000:0.0:1783965090.853785:0:6612:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff94743e2a7480 x1870622715048960/t0(0) o4->9923189b-eb4a-470c-ab45-969435371000@192.168.204.12@tcp:516/0 lens 504/0 e 0 to 0 dl 1783965101 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1783965090.853796:0:6612:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff94743e2a7480 with x1870622715048960 ext(0->12) 00010000:00010000:0.0:1783965090.853805:0:6612:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000006da8dfc/0xe782b916994fd770 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5eff86 expref: 8 pid: 6609 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965090.853822:0:6612:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000006da8dfc/0xe782b916994fd770 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5eff86 expref: 8 pid: 6609 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783965090.853830:0:6612:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff94743e2a7480 00000100:00100000:0.0:1783965090.853869:0:6612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 0 00000100:00100000:0.0:1783965090.853879:0:6612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e2a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9923189b-eb4a-470c-ab45-969435371000+8:2360:x1870622715048960:12345-192.168.204.12@tcp:4:lfs.0 00000100:00100000:3.0:1783965090.854892:0:8738:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947429f44380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8738:1870622732906368:192.168.204.12@tcp:104: 00010000:00010000:3.0:1783965090.854923:0:8738:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006127a45f/0xe782b916994fd7bd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:0.0:1783965090.926249:0:6637:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 9923189b-eb4a-470c-ab45-969435371000 00000001:00080000:1.0:1783965090.960905:0:6637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000100:00100000:0.0:1783965090.960925:0:6612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e2a7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9923189b-eb4a-470c-ab45-969435371000+8:2360:x1870622715048960:12345-192.168.204.12@tcp:4:lfs.0 Request processed in 107038us (108269us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1783965090.960939:0:6612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 0 00002000:00100000:0.0:1783965090.960955:0:6612:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff94743e2a7480 x1870622715048960/t4294967299(0) o4->9923189b-eb4a-470c-ab45-969435371000@192.168.204.12@tcp:516/0 lens 504/448 e 0 to 0 dl 1783965101 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1783965090.960993:0:6612:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff94743e2a7480 with x1870622715048960 ext(0->12) 00010000:00010000:0.0:1783965090.961004:0:6612:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000006da8dfc/0xe782b916994fd770 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5eff86 expref: 7 pid: 6609 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965090.961024:0:6612:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000006da8dfc/0xe782b916994fd770 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5eff86 expref: 7 pid: 6609 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783965090.961038:0:6612:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff94743e2a7480 00000100:00100000:2.0:1783965090.963873:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965090.963989:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715049088 00000100:00100000:1.0:1783965090.963999:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715049088 00010000:00010000:1.0:1783965090.964093:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000006da8dfc/0xe782b916994fd770 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5eff86 expref: 7 pid: 6609 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783965090.964185:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 36 00000100:00100000:1.0:1783965090.964197:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e2a5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9923189b-eb4a-470c-ab45-969435371000+7:2358:x1870622715049088:12345-192.168.204.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783965090.964553:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1783965090.964644:0:5797:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1783965090.964649:0:5797:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1783965090 00002000:00010000:0.0:1783965090.964652:0:5797:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb atime from disk: 0 -> 1783965090 00002000:00010000:0.0:1783965090.964654:0:5797:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1783965090 00002000:00010000:0.0:1783965090.964656:0:5797:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:0.0:1783965090.964667:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000006da8dfc/0xe782b916994fd770 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5eff86 expref: 7 pid: 6609 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965090.964684:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000006da8dfc/0xe782b916994fd770 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5eff86 expref: 7 pid: 6609 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965090.964721:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000006da8dfc/0xe782b916994fd770 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5eff86 expref: 7 pid: 6609 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965090.964745:0:5797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783965090.964750:0:5797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783965090.964757:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006127a45f/0xe782b916994fd7bd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965090.964788:0:5797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006127a45f/0xe782b916994fd7bd lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965090.964874:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783965090.964967:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e2a5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9923189b-eb4a-470c-ab45-969435371000+6:2358:x1870622715049088:12345-192.168.204.12@tcp:103:ldlm_bl.0 Request processed in 761us (1098us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965090.964976:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 36 00010000:00010000:3.0:1783965090.967032:0:8738:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006127a45f/0xe782b916994fd7bd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965090.967055:0:8738:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006127a45f/0xe782b916994fd7bd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965090.967103:0:8738:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006127a45f/0xe782b916994fd7bd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965090.967114:0:8738:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006127a45f/0xe782b916994fd7bd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965090.967124:0:8738:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006127a45f/0xe782b916994fd7bd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965090.967162:0:8738:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947436f26e00 already unused, calling callback (ffffffffc168d230) 00010000:00010000:3.0:1783965090.967168:0:8738:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006127a45f/0xe782b916994fd7bd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965090.967178:0:8738:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006127a45f/0xe782b916994fd7bd lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965090.967361:0:8738:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006127a45f/0xe782b916994fd7bd lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965090.967690:0:8738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006127a45f/0xe782b916994fd7bd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783965090.967870:0:8738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743fb93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9923189b-eb4a-470c-ab45-969435371000+5:2360:x1870622715048832:12345-192.168.204.12@tcp:1:lfs.0 Request processed in 121279us (121606us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965090.967881:0:8738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 24 00000100:00100000:2.0:1783965090.970144:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783965090.970593:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715049344 00000100:00100000:0.0:1783965090.970603:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715049344 00000100:00100000:0.0:1783965090.970693:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 8 00000100:00100000:0.0:1783965090.970705:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e2a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9923189b-eb4a-470c-ab45-969435371000+20:10276:x1870622715049344:12345-192.168.204.12@tcp:35:lfs.0 00000004:00010000:0.0:1783965090.970766:0:5815:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26600/0xe782b916994fd7af lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5effa2 expref: 20 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783965090.971063:0:5815:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:0.0:1783965090.971117:0:5815:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:0.0:1783965090.972682:0:5815:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:0.0:1783965090.972773:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff947430c11000/0xe782b916994fd7c4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965090.972796:0:5815:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eee00/0xe782b916994fd754 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5eff78 expref: 24 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965090.972806:0:5815:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff947430c11000/0xe782b916994fd7c4 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965090.972848:0:5815:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eee00/0xe782b916994fd754 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5eff78 expref: 24 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965090.972871:0:5815:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eee00/0xe782b916994fd754 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5eff78 expref: 24 pid: 5813 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783965090.972887:0:5815:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743fb91500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5815:1870622732906496:192.168.204.12@tcp:104: 00000100:00100000:0.0:1783965090.973248:0:5815:0:(client.c:2702:ptlrpc_set_wait()) set ffff94743e29f600 going to sleep for 11 seconds 00000100:00100000:2.0:1783965090.977009:0:5815:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743fb91500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5815:1870622732906496:192.168.204.12@tcp:104: 00000100:00100000:0.0:1783965090.977048:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00010000:00010000:2.0:1783965090.977112:0:5815:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff947430c11000/0xe782b916994fd7c4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783965090.977144:0:8330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715049472 00000100:00100000:3.0:1783965090.977153:0:8330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715049472 00010000:00010000:3.0:1783965090.977194:0:8330:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eee00/0xe782b916994fd754 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5eff78 expref: 25 pid: 5813 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783965090.977432:0:8330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 37 00000100:00100000:2.0:1783965090.977443:0:8330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743fb91180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9923189b-eb4a-470c-ab45-969435371000+25:2359:x1870622715049472:12345-192.168.204.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783965090.977460:0:8330:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783965090.977483:0:8330:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eee00/0xe782b916994fd754 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5eff78 expref: 25 pid: 5813 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965090.977496:0:8330:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eee00/0xe782b916994fd754 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5eff78 expref: 25 pid: 5813 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965090.977520:0:8330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eee00/0xe782b916994fd754 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5eff78 expref: 25 pid: 5813 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965090.977668:0:8330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff947407b5c100) 00010000:00010000:2.0:1783965090.977675:0:8330:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff947430c11000/0xe782b916994fd7c4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965090.977688:0:8330:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff947430c11000/0xe782b916994fd7c4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965090.977696:0:8330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947430c11000/0xe782b916994fd7c4 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965090.977731:0:8330:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783965090.977849:0:5815:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff947430c11000/0xe782b916994fd7c4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965090.977856:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947430c11000/0xe782b916994fd7c4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783965090.978017:0:5815:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:0.0:1783965090.978269:0:5815:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:0.0:1783965090.978430:0:5815:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743fb93100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5815:1870622732906624:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1783965090.978539:0:5815:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783965090.978577:0:5815:0:(client.c:2702:ptlrpc_set_wait()) set ffff94743e29f240 going to sleep for 11 seconds 00000100:00100000:1.0:1783965090.978618:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732906624 00000100:00100000:1.0:1783965090.978628:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732906624 00000100:00100000:1.0:1783965090.978686:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783965090.978695:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743fb91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5815:x1870622732906624:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1783965090.978769:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743fb91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5815:x1870622732906624:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 76us (229us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965090.978776:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783965090.979221:0:8330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743fb91180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9923189b-eb4a-470c-ab45-969435371000+26:2359:x1870622715049472:12345-192.168.204.12@tcp:103:ldlm_bl.0 Request processed in 1776us (2169us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965090.979232:0:8330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 37 00000100:00080000:0.0:1783965090.981080:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783965090.981163:0:5815:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743fb93100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5815:1870622732906624:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1783965090.985284:0:5815:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:0.0:1783965090.985732:0:5815:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743fb93100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5815:1870622732906752:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1783965090.985840:0:5815:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783965090.985896:0:5815:0:(client.c:2702:ptlrpc_set_wait()) set ffff94743e29fd80 going to sleep for 11 seconds 00000100:00100000:1.0:1783965090.985991:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732906752 00000100:00100000:1.0:1783965090.986001:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732906752 00000100:00100000:1.0:1783965090.986067:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783965090.986077:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743fb90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5815:x1870622732906752:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1783965090.986387:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743fb90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5815:x1870622732906752:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 297us (532us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1783965090.986397:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783965090.986790:0:5815:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743fb93100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5815:1870622732906752:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1783965090.986888:0:5815:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:0.0:1783965090.986940:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff947430c11000/0xe782b916994fd7c4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965090.986970:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff947430c11000/0xe782b916994fd7c4 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965090.986977:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff947430c11000/0xe782b916994fd7c4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965090.986984:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947430c11000 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1783965090.986989:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947430c11000/0xe782b916994fd7c4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965090.986998:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947430c11000/0xe782b916994fd7c4 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965090.987018:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff947407b5c100) 00010000:00010000:0.0:1783965090.987021:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1783965090.987027:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff947430c11000/0xe782b916994fd7c4 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965090.987034:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947430c11000/0xe782b916994fd7c4 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1783965090.987293:0:5815:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1783965090.987743:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:0.0:1783965090.987760:0:5815:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 325216558112ns, next at 326216554909ns, rc = 0 00000001:00080000:0.0:1783965090.987768:0:5815:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:0.0:1783965090.987804:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff947407b5c100) 00010000:00010000:0.0:1783965090.987808:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1783965090.987815:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26600/0xe782b916994fd7af lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5effa2 expref: 28 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783965090.988073:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e2a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9923189b-eb4a-470c-ab45-969435371000+27:10276:x1870622715049344:12345-192.168.204.12@tcp:35:lfs.0 Request processed in 17238us (17807us total) trans 4294967325 rc 0/0 00000100:00100000:0.0:1783965090.988084:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 8 00000020:00080000:0.0:1783965090.988090:0:5815:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1783965090.993371:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965090.993641:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715049600 00000100:00100000:1.0:1783965090.993669:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715049600 00000100:00100000:1.0:1783965090.993770:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 45 00000100:00100000:1.0:1783965090.993782:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e2a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9923189b-eb4a-470c-ab45-969435371000+27:10276:x1870622715049600:12345-192.168.204.12@tcp:101:lfs.0 00010000:00010000:1.0:1783965090.993813:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783965090.993837:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef200/0xe782b916994fd7cb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5effa9 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965090.993906:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef200/0xe782b916994fd7cb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5effa9 expref: 28 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965090.993923:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef200/0xe782b916994fd7cb lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5effa9 expref: 28 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965090.993942:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff947407b5c000) 00010000:00010000:1.0:1783965090.993969:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783965090.993973:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94743d9ef200, rc 0) 00000100:00100000:1.0:1783965090.994035:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e2a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9923189b-eb4a-470c-ab45-969435371000+28:10276:x1870622715049600:12345-192.168.204.12@tcp:101:lfs.0 Request processed in 255us (675us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965090.994042:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 45 00000100:00100000:2.0:1783965090.998462:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965090.998632:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715049856 00000100:00100000:3.0:1783965090.998643:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715049856 00000100:00100000:3.0:1783965090.998701:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 9 00000100:00100000:3.0:1783965090.998712:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94740638fc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9923189b-eb4a-470c-ab45-969435371000+28:10276:x1870622715049856:12345-192.168.204.12@tcp:35:lfs.0 00000100:00100000:3.0:1783965090.999099:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94740638fc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9923189b-eb4a-470c-ab45-969435371000+29:10276:x1870622715049856:12345-192.168.204.12@tcp:35:lfs.0 Request processed in 387us (647us total) trans 4294967326 rc 0/0 00000100:00100000:3.0:1783965090.999107:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 9 00000100:00100000:0.0:1783965091.142797:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965091.142977:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715050112 00000100:00100000:1.0:1783965091.142988:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715050112 00000100:00100000:1.0:1783965091.143050:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 46 00000100:00100000:1.0:1783965091.143060:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743fb93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9923189b-eb4a-470c-ab45-969435371000+29:10286:x1870622715050112:12345-192.168.204.12@tcp:101:lfs.0 00010000:00010000:1.0:1783965091.143088:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783965091.143111:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eec00/0xe782b916994fd7d2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5effb0 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783965091.143259:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:1.0:1783965091.143822:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eec00/0xe782b916994fd7d2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5effb0 expref: 31 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965091.143838:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff947407b5c300) 00010000:00010000:1.0:1783965091.143841:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783965091.143847:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eec00/0xe782b916994fd7d2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5effb0 expref: 31 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965091.143865:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94743d9eec00, rc 0) 00000100:00100000:1.0:1783965091.143934:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743fb93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9923189b-eb4a-470c-ab45-969435371000+30:10286:x1870622715050112:12345-192.168.204.12@tcp:101:lfs.0 Request processed in 875us (1151us total) trans 4294967327 rc 301/301 00000100:00100000:1.0:1783965091.143960:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 46 00000100:00100000:2.0:1783965091.147560:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965091.147718:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715050240 00000100:00100000:3.0:1783965091.147729:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715050240 00000100:00100000:3.0:1783965091.147787:0:6632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 47 00000100:00100000:3.0:1783965091.147798:0:6632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e2a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9923189b-eb4a-470c-ab45-969435371000+30:10286:x1870622715050240:12345-192.168.204.12@tcp:34:lfs.0 00010000:00010000:3.0:1783965091.147878:0:6632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fd7e0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965091.147896:0:6632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fd7e0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965091.147908:0:6632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fd7e0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965091.147922:0:6632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27c00/0xe782b916994fd7e7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965091.147929:0:6632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27c00/0xe782b916994fd7e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965091.147935:0:6632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27c00/0xe782b916994fd7e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965091.148063:0:6632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26600/0xe782b916994fd7ee lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965091.148072:0:6632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26600/0xe782b916994fd7ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965091.148096:0:6632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26600/0xe782b916994fd7ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783965091.148141:0:6632:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26600/0xe782b916994fd7ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965091.148154:0:6632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fd7e0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965091.148160:0:6632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fd7e0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965091.148167:0:6632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fd7e0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965091.148173:0:6632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947436f26e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1783965091.148177:0:6632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fd7e0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965091.148184:0:6632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fd7e0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965091.148195:0:6632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9474186e7a00) 00010000:00010000:3.0:1783965091.148199:0:6632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783965091.148242:0:6632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fd7e0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965091.148248:0:6632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fd7e0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965091.148262:0:6632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27c00/0xe782b916994fd7e7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965091.148280:0:6632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27c00/0xe782b916994fd7e7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965091.148286:0:6632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27c00/0xe782b916994fd7e7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965091.148291:0:6632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947436f27c00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1783965091.148294:0:6632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27c00/0xe782b916994fd7e7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965091.148300:0:6632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27c00/0xe782b916994fd7e7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965091.148308:0:6632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9474186e7900) 00010000:00010000:3.0:1783965091.148310:0:6632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783965091.148313:0:6632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27c00/0xe782b916994fd7e7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965091.148319:0:6632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27c00/0xe782b916994fd7e7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965091.148334:0:6632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26600/0xe782b916994fd7ee lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965091.148340:0:6632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26600/0xe782b916994fd7ee lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965091.148346:0:6632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26600/0xe782b916994fd7ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965091.148351:0:6632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947436f26600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1783965091.148360:0:6632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26600/0xe782b916994fd7ee lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965091.148367:0:6632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26600/0xe782b916994fd7ee lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965091.148375:0:6632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff947407b5c000) 00010000:00010000:3.0:1783965091.148377:0:6632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783965091.148380:0:6632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26600/0xe782b916994fd7ee lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965091.148386:0:6632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26600/0xe782b916994fd7ee lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783965091.148456:0:6632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e2a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9923189b-eb4a-470c-ab45-969435371000+30:10286:x1870622715050240:12345-192.168.204.12@tcp:34:lfs.0 Request processed in 658us (913us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965091.148465:0:6632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 47 00000100:00100000:2.0:1783965091.156323:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965091.157009:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715050496 00000100:00100000:3.0:1783965091.157021:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715050496 00000100:00100000:3.0:1783965091.157083:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 10 00000100:00100000:3.0:1783965091.157094:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e2a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9923189b-eb4a-470c-ab45-969435371000+30:10286:x1870622715050496:12345-192.168.204.12@tcp:35:lfs.0 00000100:00100000:3.0:1783965091.157870:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e2a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9923189b-eb4a-470c-ab45-969435371000+31:10286:x1870622715050496:12345-192.168.204.12@tcp:35:lfs.0 Request processed in 775us (1564us total) trans 4294967328 rc 0/0 00000100:00100000:3.0:1783965091.157881:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 10 00000100:00100000:0.0:1783965091.238091:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965091.238259:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715050752 00000100:00100000:3.0:1783965091.238275:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715050752 00000100:00100000:3.0:1783965091.238348:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 48 00000100:00100000:3.0:1783965091.238359:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743fb91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9923189b-eb4a-470c-ab45-969435371000+31:10289:x1870622715050752:12345-192.168.204.12@tcp:101:lfs.0 00010000:00010000:3.0:1783965091.238399:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783965091.238442:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26600/0xe782b916994fd7f5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5effb7 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965091.238531:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27c00/0xe782b916994fd7fc lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965091.238547:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27c00/0xe782b916994fd7fc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965091.239133:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27c00/0xe782b916994fd7fc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965091.239161:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fd803 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965091.239169:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fd803 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965091.239178:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fd803 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965091.239373:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27a00/0xe782b916994fd80a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965091.239382:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27a00/0xe782b916994fd80a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965091.239389:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27a00/0xe782b916994fd80a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783965091.239400:0:5813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1783965091.239506:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27c00/0xe782b916994fd7fc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965091.239527:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27c00/0xe782b916994fd7fc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965091.239534:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27c00/0xe782b916994fd7fc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965091.239540:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947436f27c00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1783965091.239544:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27c00/0xe782b916994fd7fc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965091.239552:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27c00/0xe782b916994fd7fc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965091.239564:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9474186e7a00) 00010000:00010000:3.0:1783965091.239566:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783965091.239571:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27c00/0xe782b916994fd7fc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965091.239576:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27c00/0xe782b916994fd7fc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965091.239589:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fd803 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965091.239594:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fd803 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965091.239600:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fd803 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965091.239604:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947436f26e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1783965091.239612:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fd803 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965091.239618:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fd803 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965091.239624:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9474186e7900) 00010000:00010000:3.0:1783965091.239626:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783965091.239629:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fd803 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965091.239634:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fd803 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965091.239675:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26600/0xe782b916994fd7f5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5effb7 expref: 34 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965091.239687:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27a00/0xe782b916994fd80a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5effb7 expref: 33 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965091.239693:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff947407b5c000) 00010000:00010000:3.0:1783965091.239695:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783965091.239697:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff947436f27a00, rc 0) 00000100:00100000:3.0:1783965091.239770:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743fb91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9923189b-eb4a-470c-ab45-969435371000+33:10289:x1870622715050752:12345-192.168.204.12@tcp:101:lfs.0 Request processed in 1413us (1693us total) trans 4294967329 rc 0/0 00000100:00100000:3.0:1783965091.239778:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 48 00000100:00100000:2.0:1783965091.251933:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965091.253428:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715050880 00000100:00100000:3.0:1783965091.253442:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715050880 00000100:00100000:3.0:1783965091.253512:0:6632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 49 00000100:00100000:3.0:1783965091.253524:0:6632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e2a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9923189b-eb4a-470c-ab45-969435371000+33:10289:x1870622715050880:12345-192.168.204.12@tcp:54:lfs.0 00010000:00010000:3.0:1783965091.253634:0:6632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26600/0xe782b916994fd818 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965091.253667:0:6632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26600/0xe782b916994fd818 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965091.253681:0:6632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26600/0xe782b916994fd818 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965091.253714:0:6632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26600/0xe782b916994fd818 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965091.253722:0:6632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26600/0xe782b916994fd818 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965091.253729:0:6632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26600/0xe782b916994fd818 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965091.253735:0:6632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947436f26600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1783965091.253740:0:6632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26600/0xe782b916994fd818 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965091.253747:0:6632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26600/0xe782b916994fd818 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965091.253759:0:6632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff947407b5c000) 00010000:00010000:3.0:1783965091.253762:0:6632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783965091.253766:0:6632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26600/0xe782b916994fd818 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965091.253773:0:6632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26600/0xe782b916994fd818 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783965091.253863:0:6632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e2a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9923189b-eb4a-470c-ab45-969435371000+33:10289:x1870622715050880:12345-192.168.204.12@tcp:54:lfs.0 Request processed in 340us (1940us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965091.253871:0:6632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 49 00000100:00100000:2.0:1783965091.257354:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965091.264242:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715051136 00000100:00100000:1.0:1783965091.264257:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715051136 00000100:00100000:1.0:1783965091.265068:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 11 00000100:00100000:1.0:1783965091.265088:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e2a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9923189b-eb4a-470c-ab45-969435371000+33:10289:x1870622715051136:12345-192.168.204.12@tcp:35:lfs.0 00000100:00100000:1.0:1783965091.265539:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e2a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9923189b-eb4a-470c-ab45-969435371000+34:10289:x1870622715051136:12345-192.168.204.12@tcp:35:lfs.0 Request processed in 457us (8196us total) trans 4294967330 rc 0/0 00000100:00100000:1.0:1783965091.265548:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 11 00000100:00100000:3.0:1783965091.372277:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947436305f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3322:1870622732906880:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783965091.372431:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783965091.378583:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732906880 00000100:00100000:1.0:1783965091.378600:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732906880 00000100:00100000:1.0:1783965091.378709:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1783965091.378721:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947429f44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1870622732906880:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783965091.378766:0:6611:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783965091.378856:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947429f44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1870622732906880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 138us (6425us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965091.378878:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1783965091.378971:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947436305f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3322:1870622732906880:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1783965091.379234:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783965091.386150:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e2a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3325:1870622732907264:0@lo:400:kworker.0 00000100:00100000:2.0:1783965091.386282:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783965091.386354:0:3325:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783965091.386361:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e2a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3325:1870622732907136:0@lo:400:kworker.0 00000100:00100000:2.0:1783965091.386413:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783965091.386456:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732907264 00000100:00100000:2.0:1783965091.386463:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732907264 00000100:00100000:2.0:1783965091.386511:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732907136 00000100:00100000:2.0:1783965091.386514:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732907136 00000100:00100000:2.0:1783965091.386536:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1783965091.386545:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e2a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3325:x1870622732907264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783965091.386604:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e2a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3325:x1870622732907264:12345-0@lo:400:kworker.0 Request processed in 59us (336us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965091.386611:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1783965091.386627:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1783965091.386634:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e611c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3325:x1870622732907136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783965091.386661:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e611c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3325:x1870622732907136:12345-0@lo:400:kworker.0 Request processed in 29us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965091.386667:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1783965091.386707:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e2a4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3325:1870622732907136:0@lo:400:kworker.0 00000100:00100000:2.0:1783965091.386718:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e2a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3325:1870622732907264:0@lo:400:kworker.0 00000100:00100000:0.0:1783965091.387418:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e2a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ae0997f7-3a15-4fc6-865a-35b2f101956e:3323:1870622732907008:0@lo:400:kworker.0 00000100:00100000:0.0:1783965091.387468:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783965091.387510:0:3323:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783965091.387517:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e2a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3323:1870622732907392:0@lo:400:kworker.0 00000100:00100000:0.0:1783965091.387542:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1783965091.387586:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783965091.387598:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732907392 00000100:00100000:0.0:1783965091.387602:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732907392 00000100:00100000:0.0:1783965091.387641:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:0.0:1783965091.387647:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743fb92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3323:x1870622732907392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783965091.387685:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743fb92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3323:x1870622732907392:12345-0@lo:400:kworker.0 Request processed in 38us (142us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965091.387690:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00080000:0.0:1783965091.387704:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783965091.387723:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e2a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3323:1870622732907392:0@lo:400:kworker.0 00000100:00100000:2.0:1783965091.389171:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732907008 00000100:00100000:2.0:1783965091.389183:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732907008 00000100:00100000:2.0:1783965091.390000:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:2.0:1783965091.390025:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947408ec9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae0997f7-3a15-4fc6-865a-35b2f101956e+19:3323:x1870622732907008:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783965091.390244:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947408ec9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae0997f7-3a15-4fc6-865a-35b2f101956e+19:3323:x1870622732907008:12345-0@lo:400:kworker.0 Request processed in 233us (2774us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965091.390474:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1783965091.390582:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e2a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ae0997f7-3a15-4fc6-865a-35b2f101956e:3323:1870622732907008:0@lo:400:kworker.0 00010000:00010000:1.0:1783965091.499457:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783965091.552097:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965091.552263:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715051392 00000100:00100000:2.0:1783965091.552276:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715051392 00000100:00100000:2.0:1783965091.552342:0:6632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 50 00000100:00100000:2.0:1783965091.552354:0:6632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743fb90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9923189b-eb4a-470c-ab45-969435371000+34:10320:x1870622715051392:12345-192.168.204.12@tcp:101:cat.0 00010000:00010000:2.0:1783965091.552391:0:6632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783965091.552427:0:6632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fc00/0xe782b916994fd81f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5effbe expref: -99 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965091.552536:0:6632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f600/0xe782b916994fd826 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965091.552550:0:6632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f600/0xe782b916994fd826 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965091.552561:0:6632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f600/0xe782b916994fd826 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783965091.552573:0:6632:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1783965091.552713:0:6632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fc00/0xe782b916994fd81f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5effbe expref: 37 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965091.552730:0:6632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f600/0xe782b916994fd826 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5effbe expref: 36 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965091.552738:0:6632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff947407b5c000) 00010000:00010000:2.0:1783965091.552741:0:6632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783965091.552745:0:6632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94743fb8f600, rc 0) 00000100:00100000:2.0:1783965091.552819:0:6632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743fb90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9923189b-eb4a-470c-ab45-969435371000+36:10320:x1870622715051392:12345-192.168.204.12@tcp:101:cat.0 Request processed in 469us (733us total) trans 4294967331 rc 0/0 00000100:00100000:2.0:1783965091.552826:0:6632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 50 00000100:00100000:3.0:1783965091.559451:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783965091.559591:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715051520 00000100:00100000:0.0:1783965091.559600:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715051520 00000100:00100000:0.0:1783965091.559664:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 3 00000100:00100000:0.0:1783965091.559672:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94741843d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9923189b-eb4a-470c-ab45-969435371000+36:2357:x1870622715051520:12345-192.168.204.12@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783965091.559689:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783965091.559712:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f600/0xe782b916994fd826 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5effbe expref: 36 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965091.559728:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff947407b5c000) 00010000:00010000:0.0:1783965091.559733:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783965091.559797:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94741843d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9923189b-eb4a-470c-ab45-969435371000+35:2357:x1870622715051520:12345-192.168.204.12@tcp:103:ldlm_bl.0 Request processed in 125us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965091.559804:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 3 00000100:00100000:3.0:1783965091.561287:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783965091.561808:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715051776 00000100:00100000:0.0:1783965091.561817:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715051776 00000100:00100000:0.0:1783965091.561984:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 12 00000100:00100000:0.0:1783965091.561995:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947429f45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9923189b-eb4a-470c-ab45-969435371000+35:10320:x1870622715051776:12345-192.168.204.12@tcp:35:cat.0 00000100:00100000:0.0:1783965091.562845:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947429f45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9923189b-eb4a-470c-ab45-969435371000+36:10320:x1870622715051776:12345-192.168.204.12@tcp:35:cat.0 Request processed in 846us (1559us total) trans 4294967332 rc 0/0 00000100:00100000:0.0:1783965091.562856:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 12 00000100:00100000:1.0:1783965091.630095:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783965091.630192:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715052032 00000100:00100000:0.0:1783965091.630237:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715052032 00000100:00100000:1.0:1783965091.630619:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 51 00000100:00100000:1.0:1783965091.630631:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436305f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9923189b-eb4a-470c-ab45-969435371000+36:10326:x1870622715052032:12345-192.168.204.12@tcp:101:dd.0 00010000:00010000:1.0:1783965091.630656:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783965091.630659:0:5812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1783965091.630687:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee200/0xe782b916994fd78c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5eff94 expref: 36 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965091.630711:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9474186e7a00) 00010000:00010000:1.0:1783965091.630716:0:5812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783965091.630729:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee400/0xe782b916994fd834 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5effc5 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965091.630821:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efe00/0xe782b916994fd83b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965091.630834:0:5812:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27a00/0xe782b916994fd80a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5effb7 expref: 36 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965091.630842:0:5812:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efe00/0xe782b916994fd83b lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965091.630873:0:5812:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27a00/0xe782b916994fd80a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5effb7 expref: 36 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965091.630886:0:5812:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27a00/0xe782b916994fd80a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5effb7 expref: 36 pid: 5813 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783965091.630917:0:5812:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947436307b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5812:1870622732907520:192.168.204.12@tcp:104: 00000100:00100000:1.0:1783965091.631073:0:5812:0:(client.c:2702:ptlrpc_set_wait()) set ffff9474400a3780 going to sleep for 11 seconds 00000100:00100000:3.0:1783965091.636019:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965091.636163:0:5812:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947436307b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5812:1870622732907520:192.168.204.12@tcp:104: 00010000:00010000:1.0:1783965091.636196:0:5812:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efe00/0xe782b916994fd83b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783965091.636895:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715052160 00000100:00100000:0.0:1783965091.636905:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715052160 00010000:00010000:0.0:1783965091.636961:0:5799:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27a00/0xe782b916994fd80a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5effb7 expref: 37 pid: 5813 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783965091.637004:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 38 00000100:00100000:0.0:1783965091.637027:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947429f47480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9923189b-eb4a-470c-ab45-969435371000+37:2360:x1870622715052160:12345-192.168.204.12@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783965091.637043:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783965091.637051:0:5799:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27a00/0xe782b916994fd80a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5effb7 expref: 37 pid: 5813 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965091.637064:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27a00/0xe782b916994fd80a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5effb7 expref: 37 pid: 5813 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965091.637088:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27a00/0xe782b916994fd80a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5effb7 expref: 37 pid: 5813 timeout: 425 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965091.637104:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff947407b5c000) 00010000:00010000:0.0:1783965091.637109:0:5799:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efe00/0xe782b916994fd83b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965091.637118:0:5799:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efe00/0xe782b916994fd83b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965091.637126:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efe00/0xe782b916994fd83b lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965091.637199:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783965091.637274:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947429f47480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9923189b-eb4a-470c-ab45-969435371000+36:2360:x1870622715052160:12345-192.168.204.12@tcp:103:ldlm_bl.0 Request processed in 239us (1256us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965091.637283:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 38 00010000:00010000:1.0:1783965091.639148:0:5812:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efe00/0xe782b916994fd83b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965091.639165:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efe00/0xe782b916994fd83b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783965091.639193:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1783965091.642665:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee400/0xe782b916994fd834 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5effc5 expref: 37 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965091.642699:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efe00/0xe782b916994fd83b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5effc5 expref: 36 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965091.642708:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff947407b5c000) 00010000:00010000:1.0:1783965091.642711:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1783965091.642714:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94743d9efe00, rc 0) 00000100:00100000:1.0:1783965091.642796:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436305f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9923189b-eb4a-470c-ab45-969435371000+36:10326:x1870622715052032:12345-192.168.204.12@tcp:101:dd.0 Request processed in 12168us (12711us total) trans 4294967333 rc 0/0 00000100:00100000:1.0:1783965091.642805:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 51 00000100:00100000:0.0:1783965091.647555:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965091.647633:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715052416 00000100:00100000:2.0:1783965091.647643:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715052416 00000100:00100000:2.0:1783965091.647700:0:6632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 52 00000100:00100000:2.0:1783965091.647712:0:6632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743fb91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9923189b-eb4a-470c-ab45-969435371000+36:10326:x1870622715052416:12345-192.168.204.12@tcp:36:dd.0 00010000:00010000:2.0:1783965091.648011:0:6632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fc00/0xe782b916994fd849 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965091.648028:0:6632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fc00/0xe782b916994fd849 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965091.648040:0:6632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fc00/0xe782b916994fd849 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783965091.648095:0:6632:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:2.0:1783965091.648120:0:6632:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d0ff3ee2 reply state 00000000fa1a5d4a transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fc00/0xe782b916994fd849 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783965091.648128:0:6632:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783965091.648264:0:6632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743fb91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9923189b-eb4a-470c-ab45-969435371000+39:10326:x1870622715052416:12345-192.168.204.12@tcp:36:dd.0 Request processed in 553us (720us total) trans 4294967335 rc 0/0 00000100:00100000:2.0:1783965091.648272:0:6632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 52 00000020:00080000:2.0:1783965091.648277:0:6632:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1783965091.650672:0:3308:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fc00/0xe782b916994fd849 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965091.650716:0:3308:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fc00/0xe782b916994fd849 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965091.650724:0:3308:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fc00/0xe782b916994fd849 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965091.650730:0:3308:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743fb8fc00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1783965091.650737:0:3308:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fc00/0xe782b916994fd849 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965091.650745:0:3308:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fc00/0xe782b916994fd849 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965091.650764:0:3308:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff947407b5c000) 00010000:00010000:0.0:1783965091.650768:0:3308:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783965091.650773:0:3308:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fc00/0xe782b916994fd849 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965091.650779:0:3308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fc00/0xe782b916994fd849 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783965091.968850:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965091.968993:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715052544 00000100:00100000:2.0:1783965091.969013:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715052544 00000100:00100000:2.0:1783965091.969079:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 53 00000100:00100000:2.0:1783965091.969090:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743fb90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9923189b-eb4a-470c-ab45-969435371000+38:10341:x1870622715052544:12345-192.168.204.12@tcp:101:stat.0 00010000:00010000:2.0:1783965091.969127:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783965091.969150:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8ec00/0xe782b916994fd850 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5effcc expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965091.969260:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fa00/0xe782b916994fd857 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965091.969277:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fa00/0xe782b916994fd857 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965091.969291:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fa00/0xe782b916994fd857 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965091.969313:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f800/0xe782b916994fd85e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965091.969320:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f800/0xe782b916994fd85e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965091.969327:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f800/0xe782b916994fd85e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965091.969429:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e400/0xe782b916994fd865 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965091.969441:0:5813:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efe00/0xe782b916994fd83b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5effc5 expref: 39 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965091.969449:0:5813:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e400/0xe782b916994fd865 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965091.969484:0:5813:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efe00/0xe782b916994fd83b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5effc5 expref: 39 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965091.969506:0:5813:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efe00/0xe782b916994fd83b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5effc5 expref: 39 pid: 5812 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783965091.969536:0:5813:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e612d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5813:1870622732907648:192.168.204.12@tcp:104: 00000100:00100000:2.0:1783965091.969633:0:5813:0:(client.c:2702:ptlrpc_set_wait()) set ffff947436de03c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783965091.972193:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965091.972658:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715052800 00000100:00100000:1.0:1783965091.972685:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715052800 00000100:00100000:1.0:1783965091.972748:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 13 00000100:00100000:1.0:1783965091.972761:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947425979c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9923189b-eb4a-470c-ab45-969435371000+40:5570:x1870622715052800:12345-192.168.204.12@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1783965091.973274:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947425979c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9923189b-eb4a-470c-ab45-969435371000+41:5570:x1870622715052800:12345-192.168.204.12@tcp:35:ldlm_bl.0 Request processed in 514us (1090us total) trans 4294967336 rc 0/0 00000100:00100000:1.0:1783965091.973283:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 13 00000100:00100000:2.0:1783965091.973819:0:5813:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e612d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5813:1870622732907648:192.168.204.12@tcp:104: 00010000:00010000:2.0:1783965091.973846:0:5813:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e400/0xe782b916994fd865 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783965091.978569:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783965091.978654:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715052928 00000100:00100000:0.0:1783965091.978665:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715052928 00010000:00010000:0.0:1783965091.978709:0:5798:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efe00/0xe782b916994fd83b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5effc5 expref: 41 pid: 5812 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783965091.978811:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 39 00000100:00100000:0.0:1783965091.978821:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9474072a9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9923189b-eb4a-470c-ab45-969435371000+41:2360:x1870622715052928:12345-192.168.204.12@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783965091.978850:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783965091.978858:0:5798:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efe00/0xe782b916994fd83b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5effc5 expref: 41 pid: 5812 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965091.978872:0:5798:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efe00/0xe782b916994fd83b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5effc5 expref: 41 pid: 5812 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965091.978895:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efe00/0xe782b916994fd83b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5effc5 expref: 41 pid: 5812 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965091.978930:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff947407b5c000) 00010000:00010000:0.0:1783965091.978935:0:5798:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e400/0xe782b916994fd865 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965091.978957:0:5798:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e400/0xe782b916994fd865 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965091.978964:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e400/0xe782b916994fd865 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965091.978998:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783965091.979058:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9474072a9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9923189b-eb4a-470c-ab45-969435371000+40:2360:x1870622715052928:12345-192.168.204.12@tcp:103:ldlm_bl.0 Request processed in 239us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965091.979065:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 39 00010000:00010000:3.0:1783965091.979427:0:5813:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e400/0xe782b916994fd865 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965091.979436:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e400/0xe782b916994fd865 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783965091.979483:0:5813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1783965091.979488:0:5813:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1783965091.979537:0:5813:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e400/0xe782b916994fd865 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965091.979561:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e400/0xe782b916994fd865 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965091.979571:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fa00/0xe782b916994fd857 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965091.979585:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fa00/0xe782b916994fd857 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965091.979606:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fa00/0xe782b916994fd857 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965091.979612:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743fb8fa00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1783965091.979615:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fa00/0xe782b916994fd857 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965091.979622:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fa00/0xe782b916994fd857 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965091.979633:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9474186e7a00) 00010000:00010000:3.0:1783965091.979636:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783965091.979640:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fa00/0xe782b916994fd857 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965091.979647:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fa00/0xe782b916994fd857 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965091.979659:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f800/0xe782b916994fd85e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965091.979665:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f800/0xe782b916994fd85e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965091.979670:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f800/0xe782b916994fd85e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965091.979674:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743fb8f800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1783965091.979676:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f800/0xe782b916994fd85e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965091.979691:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f800/0xe782b916994fd85e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965091.979700:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff947402a2dc00) 00010000:00010000:3.0:1783965091.979702:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783965091.979706:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f800/0xe782b916994fd85e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965091.979711:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f800/0xe782b916994fd85e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965091.979762:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8ec00/0xe782b916994fd850 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5effcc expref: 40 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965091.979777:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e400/0xe782b916994fd865 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5effcc expref: 39 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965091.979785:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff947407b5c000) 00010000:00010000:3.0:1783965091.979786:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783965091.979789:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94743fb8e400, rc 0) 00000100:00100000:3.0:1783965091.980604:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743fb90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9923189b-eb4a-470c-ab45-969435371000+39:10341:x1870622715052544:12345-192.168.204.12@tcp:101:stat.0 Request processed in 11512us (11760us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965091.980614:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 53 00000100:00100000:3.0:1783965092.080610:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965092.082692:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715053184 00000100:00100000:2.0:1783965092.082710:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715053184 00000100:00100000:2.0:1783965092.082828:0:6632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 54 00000100:00100000:2.0:1783965092.082841:0:6632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9474072a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9923189b-eb4a-470c-ab45-969435371000+39:10347:x1870622715053184:12345-192.168.204.12@tcp:36:truncate.0 00010000:00010000:2.0:1783965092.082912:0:6632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783965092.082953:0:6632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e400/0xe782b916994fd865 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5effcc expref: 39 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965092.082975:0:6632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff947407b5c000) 00010000:00010000:2.0:1783965092.082981:0:6632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783965092.083552:0:6632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e800/0xe782b916994fd86c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965092.083569:0:6632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e800/0xe782b916994fd86c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965092.083580:0:6632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e800/0xe782b916994fd86c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783965092.083649:0:6632:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:2.0:1783965092.083678:0:6632:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000542874bc reply state 00000000cf403ff4 transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e800/0xe782b916994fd86c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783965092.083688:0:6632:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783965092.083809:0:6632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9474072a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9923189b-eb4a-470c-ab45-969435371000+41:10347:x1870622715053184:12345-192.168.204.12@tcp:36:truncate.0 Request processed in 969us (3207us total) trans 4294967338 rc 0/0 00000100:00100000:2.0:1783965092.083817:0:6632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 54 00000020:00080000:2.0:1783965092.083822:0:6632:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00080000:0.0:1783965092.084079:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1783965092.086249:0:3309:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e800/0xe782b916994fd86c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965092.086268:0:3309:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e800/0xe782b916994fd86c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965092.086289:0:3309:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e800/0xe782b916994fd86c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965092.086296:0:3309:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743fb8e800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1783965092.086300:0:3309:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e800/0xe782b916994fd86c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965092.086307:0:3309:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e800/0xe782b916994fd86c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965092.086324:0:3309:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff947407b5c000) 00010000:00010000:3.0:1783965092.086327:0:3309:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783965092.086332:0:3309:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e800/0xe782b916994fd86c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965092.086338:0:3309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e800/0xe782b916994fd86c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783965092.378317:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965092.378437:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715053312 00000100:00100000:1.0:1783965092.378448:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715053312 00000100:00100000:1.0:1783965092.378517:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 55 00000100:00100000:1.0:1783965092.378528:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e612d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9923189b-eb4a-470c-ab45-969435371000+40:10361:x1870622715053312:12345-192.168.204.12@tcp:101:stat.0 00010000:00010000:1.0:1783965092.378556:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783965092.378580:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee200/0xe782b916994fd873 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5effd3 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965092.378662:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eea00/0xe782b916994fd87a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965092.378676:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eea00/0xe782b916994fd87a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965092.378688:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eea00/0xe782b916994fd87a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965092.378704:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994fd881 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965092.378710:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994fd881 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965092.378716:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994fd881 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965092.378830:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efa00/0xe782b916994fd888 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965092.378838:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efa00/0xe782b916994fd888 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965092.378845:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efa00/0xe782b916994fd888 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783965092.378879:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:1.0:1783965092.378883:0:5812:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1783965092.378905:0:5812:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efa00/0xe782b916994fd888 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965092.378916:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efa00/0xe782b916994fd888 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965092.378924:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eea00/0xe782b916994fd87a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965092.378942:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eea00/0xe782b916994fd87a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965092.378949:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eea00/0xe782b916994fd87a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965092.378955:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743d9eea00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1783965092.378959:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eea00/0xe782b916994fd87a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965092.378967:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eea00/0xe782b916994fd87a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965092.378987:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9474186e7a00) 00010000:00010000:1.0:1783965092.378990:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783965092.378994:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eea00/0xe782b916994fd87a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965092.379001:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eea00/0xe782b916994fd87a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965092.379020:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994fd881 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965092.379026:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994fd881 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965092.379032:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994fd881 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965092.379038:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743d9ee800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1783965092.379041:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994fd881 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965092.379047:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994fd881 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965092.379054:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff947407b5cd00) 00010000:00010000:1.0:1783965092.379056:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783965092.379059:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994fd881 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965092.379064:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994fd881 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965092.379110:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee200/0xe782b916994fd873 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5effd3 expref: 42 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965092.379125:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efa00/0xe782b916994fd888 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5effd3 expref: 41 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965092.379132:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff947407b5c000) 00010000:00010000:1.0:1783965092.379134:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783965092.379136:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94743d9efa00, rc 0) 00000100:00100000:1.0:1783965092.379330:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e612d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9923189b-eb4a-470c-ab45-969435371000+41:10361:x1870622715053312:12345-192.168.204.12@tcp:101:stat.0 Request processed in 802us (1033us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965092.379339:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 55 00000001:00080000:3.0:1783965092.451073:0:5835:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967332 is committed 00000004:00080000:3.0:1783965092.451098:0:5835:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000020:00080000:3.0:1783965092.451124:0:5835:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff94743e29f240 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:3.0:1783965092.451129:0:5835:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff94743e433400 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff94743e29fb40 00000020:00080000:3.0:1783965092.451132:0:5835:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff94743e433600 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff94743fb36800 00000001:00080000:3.0:1783965092.451170:0:5835:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967336 is committed 00000001:00080000:3.0:1783965092.451189:0:5835:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967338 is committed 00000020:00080000:2.0:1783965092.451499:0:5846:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:2.0:1783965092.451695:0:5846:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:0.0:1783965092.451899:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947436307b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3323:1870622732907776:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1783965092.451981:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783965092.452136:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732907776 00000100:00100000:3.0:1783965092.452144:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732907776 00000100:00100000:3.0:1783965092.452222:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1783965092.452232:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743fb91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3323:x1870622732907776:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1783965092.452269:0:6606:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:3.0:1783965092.452300:0:6606:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a5525a2, atime: 0x6a5525a2, ctime: 0x6a5525a2, blocks: 0xb 00010000:00010000:3.0:1783965092.452309:0:6606:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006127a45f/0xe782b916994fd88f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965092.452327:0:6606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=326s v=(0 0) 00010000:00010000:3.0:1783965092.452332:0:6606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783965092.452339:0:6606:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006127a45f/0xe782b916994fd88f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965092.452365:0:6606:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006127a45f/0xe782b916994fd88f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965092.452375:0:6606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006127a45f/0xe782b916994fd88f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965092.452382:0:6606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006127a45f/0xe782b916994fd88f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965092.452401:0:6606:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00080000:2.0:1783965092.452907:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783965092.458430:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743fb91f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3323:x1870622732907776:12345-0@lo:6:osp-syn-0-0.0 Request processed in 6190us (6440us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1783965092.458455:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:3.0:1783965092.458504:0:5801:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783965092.458514:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006127a45f/0xe782b916994fd88f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965092.458556:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947436f26e00 already unused, calling callback (ffffffffc168d230) 00010000:00010000:3.0:1783965092.458561:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006127a45f/0xe782b916994fd88f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965092.458572:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006127a45f/0xe782b916994fd88f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965092.458592:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006127a45f/0xe782b916994fd88f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965092.458610:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006127a45f/0xe782b916994fd88f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965092.458632:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783965092.458634:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783965092.458635:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1783965092.459382:0:3323:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff947436307b80/2, rc 0, transno 4294967301 00000100:00100000:0.0:1783965092.459402:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947436307b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3323:1870622732907776:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1783965092.523526:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783965092.541649:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965092.543496:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715053568 00000100:00100000:2.0:1783965092.543511:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715053568 00000100:00100000:3.0:1783965092.543759:0:6632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 56 00000100:00100000:3.0:1783965092.543770:0:6632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743fb90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9923189b-eb4a-470c-ab45-969435371000+11:10371:x1870622715053568:12345-192.168.204.12@tcp:101:lfs.0 00010000:00010000:3.0:1783965092.543791:0:6632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783965092.543813:0:6632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fd896 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5effda expref: -99 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783965092.544289:0:6632:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:3.0:1783965092.544782:0:6632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fd896 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5effda expref: 13 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965092.544812:0:6632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff947407b5c300) 00010000:00010000:3.0:1783965092.544815:0:6632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783965092.544821:0:6632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fd896 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5effda expref: 13 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965092.544836:0:6632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff947436f26e00, rc 0) 00000100:00100000:3.0:1783965092.545007:0:6632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743fb90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9923189b-eb4a-470c-ab45-969435371000+12:10371:x1870622715053568:12345-192.168.204.12@tcp:101:lfs.0 Request processed in 1237us (3368us total) trans 4294967339 rc 301/301 00000100:00100000:3.0:1783965092.545016:0:6632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 56 00000100:00100000:2.0:1783965092.550716:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965092.552570:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715053824 00000100:00100000:1.0:1783965092.552584:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715053824 00000100:00100000:1.0:1783965092.552699:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 14 00000100:00100000:1.0:1783965092.552711:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e610a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9923189b-eb4a-470c-ab45-969435371000+12:10371:x1870622715053824:12345-192.168.204.12@tcp:35:lfs.0 00000100:00100000:1.0:1783965092.553249:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e610a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9923189b-eb4a-470c-ab45-969435371000+13:10371:x1870622715053824:12345-192.168.204.12@tcp:35:lfs.0 Request processed in 539us (2541us total) trans 4294967340 rc 0/0 00000100:00100000:1.0:1783965092.553259:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 14 00000100:00100000:2.0:1783965092.673313:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965092.673424:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715054080 00000100:00100000:1.0:1783965092.673436:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715054080 00000100:00100000:1.0:1783965092.673505:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 57 00000100:00100000:1.0:1783965092.673516:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e610000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9923189b-eb4a-470c-ab45-969435371000+13:10377:x1870622715054080:12345-192.168.204.12@tcp:101:bash.0 00010000:00010000:1.0:1783965092.673549:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783965092.673589:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee200/0xe782b916994fd8a4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5effe1 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965092.673704:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994fd8ab lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965092.673719:0:5812:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efa00/0xe782b916994fd888 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5effd3 expref: 14 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965092.673728:0:5812:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994fd8ab lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965092.673762:0:5812:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efa00/0xe782b916994fd888 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5effd3 expref: 14 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965092.673777:0:5812:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efa00/0xe782b916994fd888 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5effd3 expref: 14 pid: 5812 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783965092.673791:0:5812:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947436307800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5812:1870622732907904:192.168.204.12@tcp:104: 00000100:00100000:1.0:1783965092.673905:0:5812:0:(client.c:2702:ptlrpc_set_wait()) set ffff9474400a3000 going to sleep for 11 seconds 00000100:00100000:3.0:1783965092.687104:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965092.687284:0:5812:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947436307800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5812:1870622732907904:192.168.204.12@tcp:104: 00010000:00010000:1.0:1783965092.687315:0:5812:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994fd8ab lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783965092.687427:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715054208 00000100:00100000:0.0:1783965092.687434:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715054208 00010000:00010000:0.0:1783965092.687481:0:5799:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efa00/0xe782b916994fd888 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5effd3 expref: 15 pid: 5812 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783965092.687518:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 40 00000100:00100000:0.0:1783965092.687527:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9474072a9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9923189b-eb4a-470c-ab45-969435371000+15:2359:x1870622715054208:12345-192.168.204.12@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783965092.687543:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783965092.687550:0:5799:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efa00/0xe782b916994fd888 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5effd3 expref: 15 pid: 5812 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965092.687562:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efa00/0xe782b916994fd888 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5effd3 expref: 15 pid: 5812 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965092.687584:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efa00/0xe782b916994fd888 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5effd3 expref: 15 pid: 5812 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965092.687620:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff947407b5c000) 00010000:00010000:0.0:1783965092.687626:0:5799:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994fd8ab lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965092.687636:0:5799:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994fd8ab lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965092.687644:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994fd8ab lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965092.687772:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783965092.687830:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9474072a9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9923189b-eb4a-470c-ab45-969435371000+14:2359:x1870622715054208:12345-192.168.204.12@tcp:103:ldlm_bl.0 Request processed in 303us (736us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965092.687839:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 40 00010000:00010000:1.0:1783965092.696073:0:5812:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994fd8ab lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965092.696093:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994fd8ab lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783965092.696144:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:1.0:1783965092.696356:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee200/0xe782b916994fd8a4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5effe1 expref: 15 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965092.696385:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994fd8ab lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5effe1 expref: 14 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965092.696394:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff947407b5c000) 00010000:00010000:1.0:1783965092.696397:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1783965092.696400:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94743d9ee800, rc 0) 00000100:00100000:1.0:1783965092.696477:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e610000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9923189b-eb4a-470c-ab45-969435371000+14:10377:x1870622715054080:12345-192.168.204.12@tcp:101:bash.0 Request processed in 22963us (23175us total) trans 4294967341 rc 0/0 00000100:00100000:1.0:1783965092.696486:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 57 00000100:00100000:3.0:1783965092.702692:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965092.705483:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715054464 00000100:00100000:1.0:1783965092.705498:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715054464 00000100:00100000:1.0:1783965092.705575:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 58 00000100:00100000:1.0:1783965092.705587:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9474072abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9923189b-eb4a-470c-ab45-969435371000+14:10377:x1870622715054464:12345-192.168.204.12@tcp:36:bash.0 00010000:00010000:2.0:1783965092.706021:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e000/0xe782b916994fd8b9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965092.706040:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e000/0xe782b916994fd8b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965092.706052:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e000/0xe782b916994fd8b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783965092.706109:0:5811:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:2.0:1783965092.706135:0:5811:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000068be56c2 reply state 00000000f491b874 transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e000/0xe782b916994fd8b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783965092.706161:0:5811:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783965092.706297:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9474072abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9923189b-eb4a-470c-ab45-969435371000+17:10377:x1870622715054464:12345-192.168.204.12@tcp:36:bash.0 Request processed in 711us (3615us total) trans 4294967343 rc 0/0 00000100:00100000:2.0:1783965092.706304:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 58 00000020:00080000:2.0:1783965092.706309:0:5811:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1783965092.709937:0:3308:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e000/0xe782b916994fd8b9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965092.709957:0:3308:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e000/0xe782b916994fd8b9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965092.709966:0:3308:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e000/0xe782b916994fd8b9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965092.709973:0:3308:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743fb8e000 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1783965092.709977:0:3308:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e000/0xe782b916994fd8b9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965092.709985:0:3308:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e000/0xe782b916994fd8b9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965092.710012:0:3308:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff947407b5c000) 00010000:00010000:0.0:1783965092.710016:0:3308:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783965092.710020:0:3308:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e000/0xe782b916994fd8b9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965092.710027:0:3308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e000/0xe782b916994fd8b9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783965092.714691:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965092.717048:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715054592 00000100:00100000:2.0:1783965092.717065:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715054592 00000100:00100000:2.0:1783965092.717156:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 59 00000100:00100000:2.0:1783965092.717168:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436e76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9923189b-eb4a-470c-ab45-969435371000+16:10377:x1870622715054592:12345-192.168.204.12@tcp:101:bash.0 00010000:00010000:2.0:1783965092.717239:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783965092.717269:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fe00/0xe782b916994fd8c0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5effe8 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965092.717373:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f400/0xe782b916994fd8c7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965092.717391:0:5813:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994fd8ab lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5effe1 expref: 17 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965092.717400:0:5813:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f400/0xe782b916994fd8c7 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965092.717437:0:5813:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994fd8ab lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5effe1 expref: 17 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965092.717747:0:5813:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994fd8ab lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5effe1 expref: 17 pid: 5812 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783965092.717783:0:5813:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e611f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5813:1870622732908032:192.168.204.12@tcp:104: 00000100:00100000:2.0:1783965092.719066:0:5813:0:(client.c:2702:ptlrpc_set_wait()) set ffff947436de03c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783965092.729031:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965092.729837:0:5813:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e611f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5813:1870622732908032:192.168.204.12@tcp:104: 00010000:00010000:3.0:1783965092.729868:0:5813:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f400/0xe782b916994fd8c7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783965092.730497:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715054720 00000100:00100000:0.0:1783965092.730507:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715054720 00010000:00010000:0.0:1783965092.730562:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994fd8ab lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5effe1 expref: 18 pid: 5812 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783965092.730617:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 41 00000100:00100000:0.0:1783965092.730627:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e610380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9923189b-eb4a-470c-ab45-969435371000+18:2360:x1870622715054720:12345-192.168.204.12@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783965092.730642:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783965092.730649:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994fd8ab lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5effe1 expref: 18 pid: 5812 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965092.730662:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994fd8ab lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5effe1 expref: 18 pid: 5812 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965092.730685:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994fd8ab lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5effe1 expref: 18 pid: 5812 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965092.730705:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff947407b5c000) 00010000:00010000:0.0:1783965092.730711:0:5797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f400/0xe782b916994fd8c7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965092.730720:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f400/0xe782b916994fd8c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965092.730727:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f400/0xe782b916994fd8c7 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965092.730759:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783965092.730815:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e610380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9923189b-eb4a-470c-ab45-969435371000+17:2360:x1870622715054720:12345-192.168.204.12@tcp:103:ldlm_bl.0 Request processed in 190us (1792us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965092.730822:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 41 00010000:00010000:2.0:1783965092.731625:0:5813:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f400/0xe782b916994fd8c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965092.731639:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f400/0xe782b916994fd8c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783965092.731688:0:5813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1783965092.731693:0:5813:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1783965092.731715:0:5813:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f400/0xe782b916994fd8c7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965092.731750:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fe00/0xe782b916994fd8c0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5effe8 expref: 17 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965092.731766:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f400/0xe782b916994fd8c7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5effe8 expref: 16 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965092.731773:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff947407b5c000) 00010000:00010000:2.0:1783965092.731776:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783965092.731779:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94743fb8f400, rc 0) 00000100:00100000:2.0:1783965092.734075:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436e76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9923189b-eb4a-470c-ab45-969435371000+16:10377:x1870622715054592:12345-192.168.204.12@tcp:101:bash.0 Request processed in 16896us (19383us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965092.734088:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 59 00000100:00100000:2.0:1783965092.745419:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783965092.745523:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715054976 00000100:00100000:0.0:1783965092.745534:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715054976 00000100:00100000:0.0:1783965092.745605:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 15 00000100:00100000:0.0:1783965092.745615:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94740638d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9923189b-eb4a-470c-ab45-969435371000+16:10377:x1870622715054976:12345-192.168.204.12@tcp:35:bash.0 00000100:00100000:0.0:1783965092.745860:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94740638d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9923189b-eb4a-470c-ab45-969435371000+17:10377:x1870622715054976:12345-192.168.204.12@tcp:35:bash.0 Request processed in 246us (451us total) trans 4294967344 rc 0/0 00000100:00100000:0.0:1783965092.745869:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 15 00000100:00100000:1.0:1783965092.850135:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965092.850575:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715055232 00000100:00100000:3.0:1783965092.850586:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715055232 00000100:00100000:3.0:1783965092.850669:0:6632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 60 00000100:00100000:3.0:1783965092.850682:0:6632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436307800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9923189b-eb4a-470c-ab45-969435371000+17:10387:x1870622715055232:12345-192.168.204.12@tcp:101:lfs.0 00010000:00010000:3.0:1783965092.850722:0:6632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783965092.850749:0:6632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fd8ce lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5effef expref: -99 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783965092.851313:0:6632:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:3.0:1783965092.851912:0:6632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fd8ce lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5effef expref: 19 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965092.851943:0:6632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff947407b5c300) 00010000:00010000:3.0:1783965092.851946:0:6632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783965092.851953:0:6632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fd8ce lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5effef expref: 19 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965092.851967:0:6632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff947436f26e00, rc 0) 00000100:00100000:3.0:1783965092.852095:0:6632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436307800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9923189b-eb4a-470c-ab45-969435371000+18:10387:x1870622715055232:12345-192.168.204.12@tcp:101:lfs.0 Request processed in 1415us (1969us total) trans 4294967345 rc 301/301 00000100:00100000:3.0:1783965092.852103:0:6632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 60 00000100:00100000:3.0:1783965092.860312:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965092.860775:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715055360 00000100:00100000:1.0:1783965092.860787:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715055360 00000100:00100000:1.0:1783965092.860859:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 61 00000100:00100000:1.0:1783965092.860870:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436e74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9923189b-eb4a-470c-ab45-969435371000+18:10387:x1870622715055360:12345-192.168.204.12@tcp:34:lfs.0 00010000:00010000:1.0:1783965092.860975:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efc00/0xe782b916994fd8dc lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965092.860994:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efc00/0xe782b916994fd8dc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965092.861023:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efc00/0xe782b916994fd8dc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965092.861040:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef000/0xe782b916994fd8e3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965092.861048:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef000/0xe782b916994fd8e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965092.861055:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef000/0xe782b916994fd8e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965092.863504:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef400/0xe782b916994fd8ea lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965092.863523:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef400/0xe782b916994fd8ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965092.863534:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef400/0xe782b916994fd8ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783965092.863582:0:5812:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef400/0xe782b916994fd8ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965092.863595:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efc00/0xe782b916994fd8dc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965092.863601:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efc00/0xe782b916994fd8dc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965092.863607:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efc00/0xe782b916994fd8dc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965092.863625:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743d9efc00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1783965092.863629:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efc00/0xe782b916994fd8dc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965092.863636:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efc00/0xe782b916994fd8dc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965092.863662:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9474186e7a00) 00010000:00010000:1.0:1783965092.863665:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783965092.863670:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efc00/0xe782b916994fd8dc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965092.863676:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efc00/0xe782b916994fd8dc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965092.863697:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef000/0xe782b916994fd8e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965092.863704:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef000/0xe782b916994fd8e3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965092.863710:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef000/0xe782b916994fd8e3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965092.863715:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743d9ef000 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1783965092.863718:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef000/0xe782b916994fd8e3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965092.863724:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef000/0xe782b916994fd8e3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965092.863743:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff947407b5c800) 00010000:00010000:1.0:1783965092.863745:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783965092.863748:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef000/0xe782b916994fd8e3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965092.863753:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef000/0xe782b916994fd8e3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965092.863903:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef400/0xe782b916994fd8ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965092.863909:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef400/0xe782b916994fd8ea lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965092.863916:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef400/0xe782b916994fd8ea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965092.863929:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743d9ef400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1783965092.863933:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef400/0xe782b916994fd8ea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965092.863938:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef400/0xe782b916994fd8ea lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965092.863946:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff947407b5c000) 00010000:00010000:1.0:1783965092.863949:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783965092.863952:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef400/0xe782b916994fd8ea lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965092.863958:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef400/0xe782b916994fd8ea lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783965092.864087:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436e74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9923189b-eb4a-470c-ab45-969435371000+18:10387:x1870622715055360:12345-192.168.204.12@tcp:34:lfs.0 Request processed in 3214us (3780us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965092.864097:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 61 00000100:00100000:2.0:1783965092.871811:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783965092.872175:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715055616 00000100:00100000:0.0:1783965092.872186:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715055616 00000100:00100000:0.0:1783965092.872321:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 16 00000100:00100000:0.0:1783965092.872332:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e612680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9923189b-eb4a-470c-ab45-969435371000+18:10387:x1870622715055616:12345-192.168.204.12@tcp:35:lfs.0 00000100:00100000:0.0:1783965092.872825:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e612680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9923189b-eb4a-470c-ab45-969435371000+19:10387:x1870622715055616:12345-192.168.204.12@tcp:35:lfs.0 Request processed in 492us (1023us total) trans 4294967346 rc 0/0 00000100:00100000:0.0:1783965092.872834:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 16 00000100:00100000:2.0:1783965092.937057:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783965092.942866:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715055872 00000100:00100000:0.0:1783965092.942888:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715055872 00000100:00100000:1.0:1783965092.945164:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 62 00000100:00100000:1.0:1783965092.945185:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e610e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9923189b-eb4a-470c-ab45-969435371000+19:10390:x1870622715055872:12345-192.168.204.12@tcp:101:lfs.0 00010000:00010000:1.0:1783965092.945232:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783965092.945265:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef400/0xe782b916994fd8f1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5efff6 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965092.945345:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef000/0xe782b916994fd8f8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965092.945360:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef000/0xe782b916994fd8f8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965092.945373:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef000/0xe782b916994fd8f8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965092.945388:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efc00/0xe782b916994fd8ff lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965092.945395:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efc00/0xe782b916994fd8ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965092.945401:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efc00/0xe782b916994fd8ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965092.948185:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994fd906 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965092.948255:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994fd906 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965092.948268:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994fd906 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783965092.948282:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1783965092.948390:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef000/0xe782b916994fd8f8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965092.948398:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef000/0xe782b916994fd8f8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965092.948405:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef000/0xe782b916994fd8f8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965092.948411:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743d9ef000 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1783965092.948416:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef000/0xe782b916994fd8f8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965092.948423:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef000/0xe782b916994fd8f8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965092.948436:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9474186e7a00) 00010000:00010000:1.0:1783965092.948439:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783965092.948444:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef000/0xe782b916994fd8f8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965092.948450:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef000/0xe782b916994fd8f8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965092.948474:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efc00/0xe782b916994fd8ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965092.948487:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efc00/0xe782b916994fd8ff lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965092.948493:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efc00/0xe782b916994fd8ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965092.948498:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743d9efc00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1783965092.948502:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efc00/0xe782b916994fd8ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965092.948508:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efc00/0xe782b916994fd8ff lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965092.949026:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff947407b5c800) 00010000:00010000:1.0:1783965092.949030:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783965092.949035:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efc00/0xe782b916994fd8ff lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965092.949040:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efc00/0xe782b916994fd8ff lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965092.949115:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef400/0xe782b916994fd8f1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5efff6 expref: 22 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965092.949132:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994fd906 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5efff6 expref: 21 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965092.949141:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff947407b5c000) 00010000:00010000:1.0:1783965092.949143:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783965092.949154:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94743d9ee800, rc 0) 00000100:00100000:1.0:1783965092.949284:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e610e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9923189b-eb4a-470c-ab45-969435371000+21:10390:x1870622715055872:12345-192.168.204.12@tcp:101:lfs.0 Request processed in 4104us (12236us total) trans 4294967347 rc 0/0 00000100:00100000:1.0:1783965092.949294:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 62 00000100:00100000:3.0:1783965092.952519:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965092.952677:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715056000 00000100:00100000:2.0:1783965092.952688:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715056000 00000100:00100000:2.0:1783965092.952750:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 63 00000100:00100000:2.0:1783965092.952761:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436e74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9923189b-eb4a-470c-ab45-969435371000+21:10390:x1870622715056000:12345-192.168.204.12@tcp:54:lfs.0 00010000:00010000:2.0:1783965092.952830:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fe00/0xe782b916994fd914 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965092.952849:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fe00/0xe782b916994fd914 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965092.952862:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fe00/0xe782b916994fd914 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965092.952901:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fe00/0xe782b916994fd914 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965092.952908:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fe00/0xe782b916994fd914 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965092.952915:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fe00/0xe782b916994fd914 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965092.952929:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743fb8fe00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1783965092.952933:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fe00/0xe782b916994fd914 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965092.952941:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fe00/0xe782b916994fd914 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965092.952953:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff947407b5c000) 00010000:00010000:2.0:1783965092.952969:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783965092.952974:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fe00/0xe782b916994fd914 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965092.952980:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fe00/0xe782b916994fd914 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783965092.953504:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436e74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9923189b-eb4a-470c-ab45-969435371000+21:10390:x1870622715056000:12345-192.168.204.12@tcp:54:lfs.0 Request processed in 742us (992us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965092.953513:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 63 00000100:00100000:2.0:1783965092.954822:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783965092.954935:0:8330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715056128 00000100:00100000:0.0:1783965092.954943:0:8330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715056128 00000100:00100000:0.0:1783965092.955008:0:8330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 4 00000100:00100000:0.0:1783965092.955020:0:8330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e613800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9923189b-eb4a-470c-ab45-969435371000+21:2359:x1870622715056128:12345-192.168.204.12@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783965092.955053:0:8330:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783965092.955083:0:8330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994fd906 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5efff6 expref: 21 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783965092.955104:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00010000:00010000:0.0:1783965092.955109:0:8330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff947407b5c000) 00010000:00010000:0.0:1783965092.955116:0:8330:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783965092.955169:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715056384 00000100:00100000:3.0:1783965092.955180:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715056384 00000100:00100000:0.0:1783965092.955193:0:8330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e613800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9923189b-eb4a-470c-ab45-969435371000+21:2359:x1870622715056128:12345-192.168.204.12@tcp:103:ldlm_bl.0 Request processed in 172us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965092.955251:0:8330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 4 00000100:00100000:3.0:1783965092.955285:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 17 00000100:00100000:3.0:1783965092.955301:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436e75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9923189b-eb4a-470c-ab45-969435371000+20:10390:x1870622715056384:12345-192.168.204.12@tcp:35:lfs.0 00000100:00100000:3.0:1783965092.956597:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436e75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9923189b-eb4a-470c-ab45-969435371000+21:10390:x1870622715056384:12345-192.168.204.12@tcp:35:lfs.0 Request processed in 1295us (1495us total) trans 4294967348 rc 0/0 00000100:00100000:3.0:1783965092.956611:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 17 00000100:00100000:3.0:1783965093.151394:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783965093.151535:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715056640 00000100:00100000:0.0:1783965093.151550:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715056640 00000100:00100000:0.0:1783965093.151632:0:6632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 64 00000100:00100000:0.0:1783965093.151644:0:6632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436e74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9923189b-eb4a-470c-ab45-969435371000+21:10408:x1870622715056640:12345-192.168.204.12@tcp:101:cat.0 00010000:00010000:0.0:1783965093.151676:0:6632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783965093.151706:0:6632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947430c10e00/0xe782b916994fd91b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5efffd expref: -99 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965093.151862:0:6632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff947430c10a00/0xe782b916994fd922 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965093.151882:0:6632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947430c10a00/0xe782b916994fd922 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965093.151896:0:6632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947430c10a00/0xe782b916994fd922 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783965093.151912:0:6632:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1783965093.152121:0:6632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947430c10e00/0xe782b916994fd91b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5efffd expref: 24 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965093.152148:0:6632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff947430c10a00/0xe782b916994fd922 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5efffd expref: 23 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965093.152158:0:6632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff947407b5c000) 00010000:00010000:0.0:1783965093.152162:0:6632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1783965093.152184:0:6632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff947430c10a00, rc 0) 00000100:00100000:0.0:1783965093.152348:0:6632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436e74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9923189b-eb4a-470c-ab45-969435371000+23:10408:x1870622715056640:12345-192.168.204.12@tcp:101:cat.0 Request processed in 706us (969us total) trans 4294967349 rc 0/0 00000100:00100000:0.0:1783965093.152358:0:6632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 64 00000100:00100000:2.0:1783965093.177175:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965093.177327:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715056768 00000100:00100000:1.0:1783965093.177352:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715056768 00000100:00100000:1.0:1783965093.177446:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 65 00000100:00100000:1.0:1783965093.177459:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e612a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9923189b-eb4a-470c-ab45-969435371000+23:10409:x1870622715056768:12345-192.168.204.12@tcp:101:lfs.0 00010000:00010000:1.0:1783965093.177503:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783965093.177548:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef400/0xe782b916994fd930 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5f0004 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965093.177681:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efc00/0xe782b916994fd937 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965093.177704:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efc00/0xe782b916994fd937 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965093.177717:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efc00/0xe782b916994fd937 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783965093.178535:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:1.0:1783965093.178545:0:5812:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1783965093.178659:0:5812:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efc00/0xe782b916994fd937 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965093.178704:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef400/0xe782b916994fd930 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0004 expref: 25 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965093.178741:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efc00/0xe782b916994fd937 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0004 expref: 24 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965093.178760:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9474186e7a00) 00010000:00010000:1.0:1783965093.178764:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783965093.178769:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94743d9efc00, rc 0) 00000100:00100000:1.0:1783965093.178867:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e612a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9923189b-eb4a-470c-ab45-969435371000+24:10409:x1870622715056768:12345-192.168.204.12@tcp:101:lfs.0 Request processed in 1409us (1707us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965093.178877:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 65 00000100:00100000:3.0:1783965093.187141:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783965093.187592:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715057152 00000100:00100000:0.0:1783965093.187608:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715057152 00000100:00100000:0.0:1783965093.187695:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 18 00000100:00100000:0.0:1783965093.187707:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436e76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9923189b-eb4a-470c-ab45-969435371000+24:10409:x1870622715057152:12345-192.168.204.12@tcp:35:lfs.0 00000100:00100000:0.0:1783965093.188198:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436e76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9923189b-eb4a-470c-ab45-969435371000+25:10409:x1870622715057152:12345-192.168.204.12@tcp:35:lfs.0 Request processed in 491us (1075us total) trans 4294967350 rc 0/0 00000100:00100000:0.0:1783965093.188260:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 18 00000100:00100000:3.0:1783965093.195086:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783965093.196033:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715057280 00000100:00100000:0.0:1783965093.196052:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715057280 00000100:00100000:0.0:1783965093.196168:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 5 00000100:00100000:0.0:1783965093.196182:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436e74e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9923189b-eb4a-470c-ab45-969435371000+25:10409:x1870622715057280:12345-192.168.204.12@tcp:103:lfs.0 00010000:00010000:0.0:1783965093.196245:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1783965093.196287:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f400/0xe782b916994fd8c7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5effe8 expref: 25 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965093.196320:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947430c10a00/0xe782b916994fd922 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5efffd expref: 24 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965093.196338:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef200/0xe782b916994fd7cb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5effa9 expref: 23 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965093.196360:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff947407b5c000) 00010000:00010000:0.0:1783965093.196378:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783965093.196497:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436e74e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9923189b-eb4a-470c-ab45-969435371000+22:10409:x1870622715057280:12345-192.168.204.12@tcp:103:lfs.0 Request processed in 317us (1424us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965093.196507:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 5 00000100:00100000:2.0:1783965093.201001:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783965093.201111:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715057408 00000100:00100000:0.0:1783965093.201125:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715057408 00000100:00100000:0.0:1783965093.201239:0:6632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 66 00000100:00100000:0.0:1783965093.201251:0:6632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e612300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9923189b-eb4a-470c-ab45-969435371000+22:10409:x1870622715057408:12345-192.168.204.12@tcp:58:lfs.0 00010000:00010000:0.0:1783965093.201734:0:6632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff947430c10e00/0xe782b916994fd93e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965093.201758:0:6632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947430c10e00/0xe782b916994fd93e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965093.201776:0:6632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947430c10e00/0xe782b916994fd93e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783965093.208505:0:6632:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783965093.208730:0:6632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:0.0:1783965093.208800:0:6632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:0.0:1783965093.208988:0:6632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e612300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9923189b-eb4a-470c-ab45-969435371000+22:10409:x1870622715057408:12345-192.168.204.12@tcp:58:lfs.0 Request processed in 7730us (7993us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965093.209004:0:6632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 66 00000100:00100000:3.0:1783965093.227655:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965093.227833:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715057536 00000100:00100000:1.0:1783965093.227847:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715057536 00000100:00100000:1.0:1783965093.227942:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 67 00000100:00100000:1.0:1783965093.227955:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436e77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9923189b-eb4a-470c-ab45-969435371000+22:10411:x1870622715057536:12345-192.168.204.12@tcp:101:lfs.0 00010000:00010000:1.0:1783965093.227985:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783965093.228015:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef400/0xe782b916994fd945 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5f000b expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965093.228112:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef000/0xe782b916994fd94c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965093.228136:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef000/0xe782b916994fd94c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965093.228153:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef000/0xe782b916994fd94c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965093.228174:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee200/0xe782b916994fd953 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965093.228181:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee200/0xe782b916994fd953 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965093.228264:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee200/0xe782b916994fd953 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965093.228751:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efa00/0xe782b916994fd95a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965093.228765:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efa00/0xe782b916994fd95a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965093.228776:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efa00/0xe782b916994fd95a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783965093.228828:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1783965093.228833:0:5812:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1783965093.228859:0:5812:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efa00/0xe782b916994fd95a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965093.228873:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efa00/0xe782b916994fd95a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965093.228883:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef000/0xe782b916994fd94c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965093.228889:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef000/0xe782b916994fd94c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965093.228897:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef000/0xe782b916994fd94c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965093.228903:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743d9ef000 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1783965093.228908:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef000/0xe782b916994fd94c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965093.228935:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef000/0xe782b916994fd94c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965093.228950:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9474186e7a00) 00010000:00010000:1.0:1783965093.228954:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783965093.228959:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef000/0xe782b916994fd94c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965093.228966:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef000/0xe782b916994fd94c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965093.228988:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee200/0xe782b916994fd953 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965093.228994:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee200/0xe782b916994fd953 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965093.229000:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee200/0xe782b916994fd953 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965093.229005:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743d9ee200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1783965093.229008:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee200/0xe782b916994fd953 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965093.229015:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee200/0xe782b916994fd953 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965093.229022:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff947407b5c800) 00010000:00010000:1.0:1783965093.229024:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783965093.229027:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee200/0xe782b916994fd953 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965093.229043:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee200/0xe782b916994fd953 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965093.229097:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef400/0xe782b916994fd945 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f000b expref: 24 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965093.229112:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efa00/0xe782b916994fd95a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f000b expref: 23 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965093.229119:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94740a90cb00) 00010000:00010000:1.0:1783965093.229122:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783965093.229124:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94743d9efa00, rc 0) 00000100:00100000:1.0:1783965093.229260:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436e77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9923189b-eb4a-470c-ab45-969435371000+23:10411:x1870622715057536:12345-192.168.204.12@tcp:101:lfs.0 Request processed in 1305us (1621us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965093.229269:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 67 00000100:00100000:0.0:1783965093.419405:0:3325:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783965093.419443:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743fb92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3325:1870622732908160:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783965093.419548:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783965093.419602:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732908160 00000100:00100000:3.0:1783965093.419622:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732908160 00000100:00100000:3.0:1783965093.419700:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1783965093.419712:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743fb90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3325:x1870622732908160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783965093.419855:0:6611:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783965093.419932:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743fb90e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3325:x1870622732908160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 222us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965093.419940:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1783965093.419972:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743fb92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3325:1870622732908160:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1783965093.547905:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783965093.757722:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965093.757784:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783965093.758067:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715057920 00000100:00100000:0.0:1783965093.758078:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715057920 00000100:00100000:0.0:1783965093.758144:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 60 00000100:00100000:0.0:1783965093.758154:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e613480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9923189b-eb4a-470c-ab45-969435371000+5:2358:x1870622715057920:12345-192.168.204.12@tcp:400:kworker.0 00000100:00100000:3.0:1783965093.758264:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715057664 00000100:00100000:3.0:1783965093.758269:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715057664 00000100:00100000:0.0:1783965093.758335:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e613480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9923189b-eb4a-470c-ab45-969435371000+5:2358:x1870622715057920:12345-192.168.204.12@tcp:400:kworker.0 Request processed in 181us (550us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965093.758343:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 60 00000100:00080000:0.0:1783965093.758368:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783965093.758406:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 285 00000100:00100000:3.0:1783965093.758413:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947408eca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+13:2358:x1870622715057664:12345-192.168.204.12@tcp:400:kworker.0 00000100:00100000:3.0:1783965093.758454:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947408eca450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+13:2358:x1870622715057664:12345-192.168.204.12@tcp:400:kworker.0 Request processed in 41us (746us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965093.758460:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 285 00000100:00100000:2.0:1783965093.758581:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783965093.758648:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715057792 00000100:00100000:0.0:1783965093.758652:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715057792 00000100:00100000:0.0:1783965093.758699:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 130 00000100:00100000:0.0:1783965093.758706:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e611500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9923189b-eb4a-470c-ab45-969435371000+23:2358:x1870622715057792:12345-192.168.204.12@tcp:400:kworker.0 00000100:00100000:0.0:1783965093.758743:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e611500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9923189b-eb4a-470c-ab45-969435371000+23:2358:x1870622715057792:12345-192.168.204.12@tcp:400:kworker.0 Request processed in 39us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965093.758750:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 130 00000100:00100000:2.0:1783965093.759056:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965093.759350:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715058048 00000100:00100000:3.0:1783965093.759355:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715058048 00000100:00100000:3.0:1783965093.759399:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 131 00000100:00100000:3.0:1783965093.759407:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e611180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49bbacc1-b013-4591-8d15-02f4f0d1884e+5:2358:x1870622715058048:12345-192.168.204.12@tcp:400:kworker.0 00000100:00100000:3.0:1783965093.759484:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e611180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49bbacc1-b013-4591-8d15-02f4f0d1884e+5:2358:x1870622715058048:12345-192.168.204.12@tcp:400:kworker.0 Request processed in 77us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965093.759492:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 131 00000100:00080000:0.0:1783965093.759642:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:3.0:1783965094.059711:0:11561:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1783965094.059720:0:11561:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1783965094.059787:0:11561:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1783965094.059798:0:11561:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1783965094.059937:0:11561:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947436e76a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11561:1870622732908288:192.168.204.12@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1783965094.060038:0:11561:0:(client.c:2702:ptlrpc_set_wait()) set ffff94741cee8f00 going to sleep for 11 seconds 00000100:00100000:3.0:1783965094.064083:0:11561:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947436e76a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11561:1870622732908288:192.168.204.12@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1783965094.074260:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965094.074392:0:5823:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715058176 00000100:00100000:1.0:1783965094.074412:0:5823:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715058176 00000100:00100000:1.0:1783965094.074487:0:5823:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 1 00000100:00100000:1.0:1783965094.074498:0:5823:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743fb93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:9923189b-eb4a-470c-ab45-969435371000+23:10422:x1870622715058176:12345-192.168.204.12@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1783965094.074587:0:5823:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743fb93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:9923189b-eb4a-470c-ab45-969435371000+23:10422:x1870622715058176:12345-192.168.204.12@tcp:900:lhsmtool_posix.0 Request processed in 91us (337us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965094.074595:0:5823:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 1 00000100:00080000:0.0:1783965094.074684:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783965094.085230:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965094.085333:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715058304 00000100:00100000:2.0:1783965094.085343:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715058304 00000100:00100000:2.0:1783965094.085389:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 68 00000100:00100000:2.0:1783965094.085399:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743fb92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9923189b-eb4a-470c-ab45-969435371000+23:10422:x1870622715058304:12345-192.168.204.12@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1783965094.085444:0:5811:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1783965094.085548:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743fb92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9923189b-eb4a-470c-ab45-969435371000+23:10422:x1870622715058304:12345-192.168.204.12@tcp:53:lhsmtool_posix.0 Request processed in 149us (358us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965094.085555:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 68 00000100:00100000:1.0:1783965094.094233:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965094.096668:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715058432 00000100:00100000:3.0:1783965094.096686:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715058432 00000100:00100000:3.0:1783965094.096775:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 69 00000100:00100000:3.0:1783965094.096786:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436306300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9923189b-eb4a-470c-ab45-969435371000+23:10422:x1870622715058432:12345-192.168.204.12@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1783965094.096865:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26600/0xe782b916994fd961 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965094.096881:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26600/0xe782b916994fd961 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965094.096905:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26600/0xe782b916994fd961 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965094.096921:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fd968 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965094.096929:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fd968 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965094.096936:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fd968 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965094.096964:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27c00/0xe782b916994fd96f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965094.096972:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27c00/0xe782b916994fd96f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965094.096978:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27c00/0xe782b916994fd96f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783965094.097025:0:5813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1783965094.097030:0:5813:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1783965094.097044:0:5813:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27c00/0xe782b916994fd96f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965094.097055:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26600/0xe782b916994fd961 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965094.097062:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26600/0xe782b916994fd961 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965094.097069:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26600/0xe782b916994fd961 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965094.097075:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947436f26600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1783965094.097079:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26600/0xe782b916994fd961 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965094.097086:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26600/0xe782b916994fd961 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965094.097099:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9474186e7d00) 00010000:00010000:3.0:1783965094.097102:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783965094.097106:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26600/0xe782b916994fd961 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965094.097112:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26600/0xe782b916994fd961 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965094.097123:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fd968 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965094.097139:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fd968 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965094.097145:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fd968 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965094.097150:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947436f26e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1783965094.097153:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fd968 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965094.097159:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fd968 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965094.097167:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff9474186e7900) 00010000:00010000:3.0:1783965094.097170:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783965094.097173:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fd968 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965094.097179:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fd968 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965094.097193:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27c00/0xe782b916994fd96f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965094.097215:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27c00/0xe782b916994fd96f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965094.097221:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27c00/0xe782b916994fd96f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965094.097225:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947436f27c00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1783965094.097233:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27c00/0xe782b916994fd96f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965094.097239:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27c00/0xe782b916994fd96f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965094.097246:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94740a90cb00) 00010000:00010000:3.0:1783965094.097249:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783965094.097251:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27c00/0xe782b916994fd96f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965094.097257:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27c00/0xe782b916994fd96f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783965094.097346:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436306300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9923189b-eb4a-470c-ab45-969435371000+23:10422:x1870622715058432:12345-192.168.204.12@tcp:34:lhsmtool_posix.0 Request processed in 561us (3148us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965094.097354:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 69 00000100:00100000:0.0:1783965094.105821:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965094.105920:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715058688 00000100:00100000:2.0:1783965094.105930:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715058688 00000100:00100000:2.0:1783965094.105993:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 70 00000100:00100000:2.0:1783965094.106004:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743fb92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9923189b-eb4a-470c-ab45-969435371000+23:10422:x1870622715058688:12345-192.168.204.12@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783965094.106041:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783965094.106063:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f800/0xe782b916994fd976 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5f0012 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965094.106174:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e400/0xe782b916994fd97d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965094.106192:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e400/0xe782b916994fd97d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965094.106231:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e400/0xe782b916994fd97d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783965094.106244:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1783965094.106363:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e400/0xe782b916994fd97d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965094.106371:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e400/0xe782b916994fd97d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965094.106378:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e400/0xe782b916994fd97d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965094.106384:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743fb8e400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1783965094.106387:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e400/0xe782b916994fd97d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965094.106395:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e400/0xe782b916994fd97d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965094.106519:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94740a90cb00) 00010000:00010000:2.0:1783965094.106529:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783965094.106535:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e400/0xe782b916994fd97d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965094.106541:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e400/0xe782b916994fd97d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965094.106591:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f800/0xe782b916994fd976 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0012 expref: 25 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965094.106602:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9474186e7d00) 00010000:00010000:2.0:1783965094.106604:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783965094.106608:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f800/0xe782b916994fd976 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0012 expref: 25 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965094.106618:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94743fb8f800, rc 0) 00000100:00100000:2.0:1783965094.106730:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743fb92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9923189b-eb4a-470c-ab45-969435371000+24:10422:x1870622715058688:12345-192.168.204.12@tcp:101:lhsmtool_posix.0 Request processed in 727us (920us total) trans 4294967351 rc 301/301 00000100:00100000:2.0:1783965094.106738:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 70 00000100:00100000:0.0:1783965094.119753:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783965094.119801:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715058816 00000100:00100000:0.0:1783965094.119813:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715058816 00000100:00100000:0.0:1783965094.119868:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 71 00000100:00100000:0.0:1783965094.119877:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743fb91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9923189b-eb4a-470c-ab45-969435371000+24:10422:x1870622715058816:12345-192.168.204.12@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1783965094.119924:0:5813:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1783965094.120030:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743fb91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9923189b-eb4a-470c-ab45-969435371000+24:10422:x1870622715058816:12345-192.168.204.12@tcp:53:lhsmtool_posix.0 Request processed in 154us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965094.120039:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 71 00000100:00100000:0.0:1783965094.127686:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965094.128378:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715059072 00000100:00100000:3.0:1783965094.128390:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715059072 00000100:00100000:3.0:1783965094.128475:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 72 00000100:00100000:3.0:1783965094.128485:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947429f45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9923189b-eb4a-470c-ab45-969435371000+24:10422:x1870622715059072:12345-192.168.204.12@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783965094.128508:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783965094.128511:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1783965094.128539:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efc00/0xe782b916994fd937 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0004 expref: 24 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965094.128563:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9474186e7a00) 00010000:00010000:3.0:1783965094.128568:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783965094.128581:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27c00/0xe782b916994fd98b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5f0019 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783965094.129316:0:5811:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:3.0:1783965094.129577:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fd992 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965094.129593:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fd992 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965094.129605:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fd992 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965094.129667:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27c00/0xe782b916994fd98b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0019 expref: 26 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965094.129692:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fd992 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0019 expref: 25 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965094.129702:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9474186e7900) 00010000:00010000:3.0:1783965094.129704:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783965094.129707:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff947436f26e00, rc 0) 00000100:00100000:3.0:1783965094.129781:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947429f45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9923189b-eb4a-470c-ab45-969435371000+25:10422:x1870622715059072:12345-192.168.204.12@tcp:101:lhsmtool_posix.0 Request processed in 1296us (2105us total) trans 4294967352 rc 0/0 00000100:00100000:3.0:1783965094.129791:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 72 00000040:00080000:2.0:1783965094.132074:0:11876:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783965094.132082:0:11876:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783965094.132118:0:11876:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1783965094.132125:0:11876:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1783965094.137966:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965094.138078:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715059328 00000100:00100000:3.0:1783965094.138089:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715059328 00000100:00100000:3.0:1783965094.138151:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 73 00000100:00100000:3.0:1783965094.138161:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e613100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9923189b-eb4a-470c-ab45-969435371000+25:10422:x1870622715059328:12345-192.168.204.12@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1783965094.138253:0:5813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783965094.138292:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fd992 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0019 expref: 25 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965094.138312:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9474186e7900) 00010000:00010000:3.0:1783965094.138336:0:5813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783965094.138357:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26600/0xe782b916994fd9a0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965094.138370:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26600/0xe782b916994fd9a0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965094.138380:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26600/0xe782b916994fd9a0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965094.138645:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fd9a7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xc3868612 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965094.138656:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fd9a7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xc3868612 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965094.138664:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fd9a7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xc3868612 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965094.138963:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26600/0xe782b916994fd9a0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965094.138972:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26600/0xe782b916994fd9a0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965094.138980:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26600/0xe782b916994fd9a0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965094.138986:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947436f26600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1783965094.138997:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26600/0xe782b916994fd9a0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965094.139004:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26600/0xe782b916994fd9a0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965094.139014:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9474186e7a00) 00010000:00010000:3.0:1783965094.139017:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783965094.139021:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26600/0xe782b916994fd9a0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965094.139026:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26600/0xe782b916994fd9a0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965094.139035:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fd9a7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xc3868612 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965094.139040:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fd9a7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xc3868612 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965094.139045:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fd9a7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xc3868612 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965094.139050:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947436f26200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1783965094.139053:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fd9a7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xc3868612 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965094.139058:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fd9a7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xc3868612 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965094.139064:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xc3868612 (ffff9474186e7800) 00010000:00010000:3.0:1783965094.139066:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783965094.139074:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fd9a7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xc3868612 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965094.139080:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fd9a7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xc3868612 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783965094.139259:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e613100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9923189b-eb4a-470c-ab45-969435371000+24:10422:x1870622715059328:12345-192.168.204.12@tcp:36:lhsmtool_posix.0 Request processed in 1095us (1302us total) trans 0 rc -2/-2 00000100:00100000:3.0:1783965094.139267:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 73 00000100:00100000:1.0:1783965094.150733:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965094.150815:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715059456 00000100:00100000:3.0:1783965094.150825:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715059456 00000100:00100000:3.0:1783965094.150885:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 74 00000100:00100000:3.0:1783965094.150895:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e43b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9923189b-eb4a-470c-ab45-969435371000+24:10422:x1870622715059456:12345-192.168.204.12@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783965094.150927:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783965094.150953:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27600/0xe782b916994fd9ae lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5f0020 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965094.150990:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26400/0xe782b916994fd9b5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965094.151004:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26400/0xe782b916994fd9b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965094.151015:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26400/0xe782b916994fd9b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965094.151109:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27600/0xe782b916994fd9ae lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0020 expref: 26 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965094.151126:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26400/0xe782b916994fd9b5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0020 expref: 25 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965094.151139:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9474186e7100) 00010000:00010000:3.0:1783965094.151142:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1783965094.151145:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff947436f26400, rc 0) 00000100:00100000:3.0:1783965094.151957:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e43b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9923189b-eb4a-470c-ab45-969435371000+25:10422:x1870622715059456:12345-192.168.204.12@tcp:101:lhsmtool_posix.0 Request processed in 1047us (1218us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965094.151966:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 74 00000100:00100000:1.0:1783965094.176770:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965094.176808:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715059712 00000100:00100000:1.0:1783965094.176818:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715059712 00000100:00100000:1.0:1783965094.176877:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 75 00000100:00100000:1.0:1783965094.176887:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e43bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9923189b-eb4a-470c-ab45-969435371000+25:10422:x1870622715059712:12345-192.168.204.12@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1783965094.176990:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eee00/0xe782b916994fd9bc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965094.177009:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eee00/0xe782b916994fd9bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965094.177021:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eee00/0xe782b916994fd9bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783965094.177341:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:1.0:1783965094.177351:0:5812:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 328406148983ns, next at 329406146684ns, rc = 0 00000004:00010000:1.0:1783965094.177948:0:5812:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000015af42cf reply state 000000009a69e40c transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eee00/0xe782b916994fd9bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783965094.177962:0:5812:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783965094.178086:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e43bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9923189b-eb4a-470c-ab45-969435371000+27:10422:x1870622715059712:12345-192.168.204.12@tcp:36:lhsmtool_posix.0 Request processed in 1196us (1322us total) trans 4294967353 rc 0/0 00000100:00100000:1.0:1783965094.178094:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 75 00000100:00100000:0.0:1783965094.183843:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783965094.183878:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715059840 00000100:00100000:0.0:1783965094.183888:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715059840 00000100:00100000:0.0:1783965094.183956:0:6632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 76 00000100:00100000:0.0:1783965094.183966:0:6632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947425979c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9923189b-eb4a-470c-ab45-969435371000+27:10422:x1870622715059840:12345-192.168.204.12@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783965094.183993:0:6632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783965094.184014:0:6632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947430c11000/0xe782b916994fd9c3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5f0027 expref: -99 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965094.184080:0:6632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947430c11000/0xe782b916994fd9c3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0027 expref: 28 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965094.184098:0:6632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff947430c11000/0xe782b916994fd9c3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0027 expref: 28 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965094.184118:0:6632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9474186e7100) 00010000:00010000:0.0:1783965094.184121:0:6632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783965094.184125:0:6632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff947430c11000, rc 0) 00000100:00100000:0.0:1783965094.184180:0:6632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947425979c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9923189b-eb4a-470c-ab45-969435371000+28:10422:x1870622715059840:12345-192.168.204.12@tcp:101:lhsmtool_posix.0 Request processed in 215us (348us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965094.184187:0:6632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 76 00010000:00010000:3.0:1783965094.186644:0:3309:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eee00/0xe782b916994fd9bc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965094.186660:0:3309:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eee00/0xe782b916994fd9bc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965094.186669:0:3309:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eee00/0xe782b916994fd9bc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965094.186676:0:3309:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743d9eee00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1783965094.186681:0:3309:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eee00/0xe782b916994fd9bc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965094.186688:0:3309:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eee00/0xe782b916994fd9bc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965094.186706:0:3309:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9474186e7100) 00010000:00010000:3.0:1783965094.186708:0:3309:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1783965094.186713:0:3309:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eee00/0xe782b916994fd9bc lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965094.186719:0:3309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eee00/0xe782b916994fd9bc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783965094.198313:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965094.200046:0:6609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715059968 00000100:00100000:2.0:1783965094.200063:0:6609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715059968 00000100:00100000:2.0:1783965094.200123:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 26 00000100:00100000:2.0:1783965094.200133:0:6609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947429f99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2356:x1870622715059968:12345-192.168.204.12@tcp:8:lhsmtool_posix.0 00010000:00080000:2.0:1783965094.200169:0:6609:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from 9923189b-eb4a-470c-ab45-969435371000@192.168.204.12@tcp t0 exp 0000000000000000 cur 328 last 0 00000020:00000080:2.0:1783965094.200222:0:6609:0:(genops.c:1406:class_connect()) connect: client 9923189b-eb4a-470c-ab45-969435371000, cookie 0xe782b916994fd9ca 00002000:00100000:2.0:1783965094.200235:0:6609:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 9923189b-eb4a-470c-ab45-969435371000/ffff947307df8000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1783965094.200278:0:6609:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1783965094.200549:0:6609:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1783965094.200594:0:6609:0:(import.c:65:import_set_state_nolock()) ffff947307dfc800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783965094.200672:0:6609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947429f99500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9923189b-eb4a-470c-ab45-969435371000+6:2356:x1870622715059968:12345-192.168.204.12@tcp:8:lhsmtool_posix.0 Request processed in 539us (2366us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965094.200680:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 26 00000100:00100000:2.0:1783965094.204620:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965094.204879:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715060096 00000100:00100000:1.0:1783965094.204890:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715060096 00000100:00100000:1.0:1783965094.204976:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 27 00000100:00100000:1.0:1783965094.204987:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e611880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9923189b-eb4a-470c-ab45-969435371000+6:0:x1870622715060096:12345-192.168.204.12@tcp:2:lhsmtool_posix.0 00000100:00080000:2.0:1783965094.205919:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783965094.242366:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e611880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9923189b-eb4a-470c-ab45-969435371000+7:0:x1870622715060096:12345-192.168.204.12@tcp:2:lhsmtool_posix.0 Request processed in 37369us (37804us total) trans 4294967301 rc 0/0 00000100:00100000:1.0:1783965094.242393:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 27 00000001:00080000:1.0:1783965094.242432:0:7523:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000001:00100000:1.0:1783965094.242444:0:7523:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 9923189b-eb4a-470c-ab45-969435371000 00000100:00100000:0.0:1783965094.244727:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965094.244814:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715060352 00000100:00100000:1.0:1783965094.244824:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715060352 00000100:00100000:1.0:1783965094.244889:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 19 00000100:00100000:1.0:1783965094.244909:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947407297100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9923189b-eb4a-470c-ab45-969435371000+27:10422:x1870622715060352:12345-192.168.204.12@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1783965094.245159:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947407297100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9923189b-eb4a-470c-ab45-969435371000+28:10422:x1870622715060352:12345-192.168.204.12@tcp:35:lhsmtool_posix.0 Request processed in 260us (440us total) trans 4294967354 rc 0/0 00000100:00100000:1.0:1783965094.245167:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 19 00000100:00100000:1.0:1783965094.248658:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965094.248743:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715060608 00000100:00100000:3.0:1783965094.248753:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715060608 00000100:00100000:3.0:1783965094.248812:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 77 00000100:00100000:3.0:1783965094.248822:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e439880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9923189b-eb4a-470c-ab45-969435371000+28:10422:x1870622715060608:12345-192.168.204.12@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1783965094.248938:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e439880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9923189b-eb4a-470c-ab45-969435371000+28:10422:x1870622715060608:12345-192.168.204.12@tcp:57:lhsmtool_posix.0 Request processed in 117us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965094.248946:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 77 00000100:00100000:0.0:1783965094.254886:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965094.258836:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715060736 00000100:00100000:2.0:1783965094.258850:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715060736 00000100:00100000:2.0:1783965094.258917:0:6632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 78 00000100:00100000:2.0:1783965094.258928:0:6632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e542300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9923189b-eb4a-470c-ab45-969435371000+28:10422:x1870622715060736:12345-192.168.204.12@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783965094.258951:0:6632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783965094.258974:0:6632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8ec00/0xe782b916994fd9d1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5f002e expref: -99 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965094.259043:0:6632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e800/0xe782b916994fd9d8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965094.259058:0:6632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e800/0xe782b916994fd9d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965094.259070:0:6632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e800/0xe782b916994fd9d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783965094.259108:0:6632:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1783965094.259136:0:6632:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e800/0xe782b916994fd9d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965094.259162:0:6632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8ec00/0xe782b916994fd9d1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f002e expref: 30 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965094.259178:0:6632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e800/0xe782b916994fd9d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f002e expref: 29 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965094.259187:0:6632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9474186e7100) 00010000:00010000:2.0:1783965094.259190:0:6632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1783965094.259193:0:6632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94743fb8e800, rc 0) 00000100:00100000:2.0:1783965094.259924:0:6632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e542300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9923189b-eb4a-470c-ab45-969435371000+29:10422:x1870622715060736:12345-192.168.204.12@tcp:101:lhsmtool_posix.0 Request processed in 994us (5044us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965094.259932:0:6632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 78 00000100:00100000:0.0:1783965094.269502:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965094.269575:0:6609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715060864 00000100:00100000:3.0:1783965094.269585:0:6609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715060864 00000100:00100000:3.0:1783965094.269645:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 28 00000100:00100000:3.0:1783965094.269656:0:6609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e543480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9923189b-eb4a-470c-ab45-969435371000+5:2358:x1870622715060864:12345-192.168.204.12@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783965094.269675:0:6609:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783965094.269698:0:6609:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b6c5d4cf/0xe782b916994fd9df lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5f0035 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783965094.269727:0:6609:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a5525a5, blocks: 0x1 00010000:00010000:3.0:1783965094.269745:0:6609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=328s v=(0 0) 00010000:00010000:3.0:1783965094.269750:0:6609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783965094.269759:0:6609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b6c5d4cf/0xe782b916994fd9df lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0035 expref: 6 pid: 6609 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965094.269779:0:6609:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b6c5d4cf/0xe782b916994fd9df lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0035 expref: 6 pid: 6609 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965094.269792:0:6609:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff947436f27600, rc 0) 00000100:00100000:3.0:1783965094.269850:0:6609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e543480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9923189b-eb4a-470c-ab45-969435371000+6:2358:x1870622715060864:12345-192.168.204.12@tcp:101:lhsmtool_posix.0 Request processed in 197us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965094.269858:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 28 00000100:00100000:2.0:1783965094.277384:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783965094.277467:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715061120 00000100:00100000:0.0:1783965094.277477:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715061120 00000100:00100000:0.0:1783965094.277538:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 79 00000100:00100000:0.0:1783965094.277556:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e610700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9923189b-eb4a-470c-ab45-969435371000+29:10422:x1870622715061120:12345-192.168.204.12@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1783965094.277661:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e610700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9923189b-eb4a-470c-ab45-969435371000+29:10422:x1870622715061120:12345-192.168.204.12@tcp:57:lhsmtool_posix.0 Request processed in 108us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965094.277669:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 79 00000100:00100000:1.0:1783965094.292331:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965094.292369:0:8738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715061248 00000100:00100000:1.0:1783965094.292378:0:8738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715061248 00000100:00100000:1.0:1783965094.292425:0:8738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 29 00000100:00100000:1.0:1783965094.292435:0:8738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e43b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9923189b-eb4a-470c-ab45-969435371000+6:10422:x1870622715061248:12345-192.168.204.12@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783965094.292453:0:8738:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783965094.292473:0:8738:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c15d4080/0xe782b916994fd9e6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5f003c expref: -99 pid: 8738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965094.292506:0:8738:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b6c5d4cf/0xe782b916994fd9df lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0035 expref: 7 pid: 6609 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965094.292516:0:8738:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783965094.292520:0:8738:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783965094.292540:0:8738:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c15d4080/0xe782b916994fd9e6 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f003c expref: 7 pid: 8738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965094.292575:0:8738:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b6c5d4cf/0xe782b916994fd9df lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0035 expref: 7 pid: 6609 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965094.292590:0:8738:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b6c5d4cf/0xe782b916994fd9df lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0035 expref: 7 pid: 6609 timeout: 428 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783965094.292605:0:8738:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e438700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8738:1870622732908416:192.168.204.12@tcp:104: 00000100:00100000:1.0:1783965094.292688:0:8738:0:(client.c:2702:ptlrpc_set_wait()) set ffff947405812c00 going to sleep for 11 seconds 00000100:00100000:3.0:1783965094.300304:0:8738:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e438700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8738:1870622732908416:192.168.204.12@tcp:104: 00010000:00010000:3.0:1783965094.300417:0:8738:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c15d4080/0xe782b916994fd9e6 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f003c expref: 7 pid: 8738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965094.300441:0:8738:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94743d9ef600, rc 0) 00000100:00100000:3.0:1783965094.300512:0:8738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e43b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9923189b-eb4a-470c-ab45-969435371000+7:10422:x1870622715061248:12345-192.168.204.12@tcp:101:lhsmtool_posix.0 Request processed in 8077us (8189us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965094.300521:0:8738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 29 00000100:00100000:1.0:1783965094.310127:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965094.310815:0:8330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715061376 00000100:00100000:3.0:1783965094.310824:0:8330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715061376 00010000:00010000:3.0:1783965094.310866:0:8330:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b6c5d4cf/0xe782b916994fd9df lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0035 expref: 7 pid: 6609 timeout: 428 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783965094.310921:0:8330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 42 00000100:00100000:3.0:1783965094.310931:0:8330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94741843f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9923189b-eb4a-470c-ab45-969435371000+7:2359:x1870622715061376:12345-192.168.204.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783965094.310947:0:8330:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783965094.310968:0:8330:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b6c5d4cf/0xe782b916994fd9df lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0035 expref: 7 pid: 6609 timeout: 428 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965094.310983:0:8330:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b6c5d4cf/0xe782b916994fd9df lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0035 expref: 7 pid: 6609 timeout: 428 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965094.311007:0:8330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b6c5d4cf/0xe782b916994fd9df lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0035 expref: 7 pid: 6609 timeout: 428 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965094.311035:0:8330:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783965094.311039:0:8330:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783965094.311049:0:8330:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c15d4080/0xe782b916994fd9e6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f003c expref: 6 pid: 8738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965094.311058:0:8330:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c15d4080/0xe782b916994fd9e6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f003c expref: 6 pid: 8738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965094.311097:0:8330:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000c15d4080/0xe782b916994fd9e6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f003c expref: 6 pid: 8738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783965094.311110:0:8330:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947436e76a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8330:1870622732908544:192.168.204.12@tcp:105: 00000100:00100000:3.0:1783965094.311181:0:8330:0:(client.c:2702:ptlrpc_set_wait()) set ffff947407e29cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783965094.319241:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965094.319300:0:6614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715061504 00000100:00100000:1.0:1783965094.319309:0:6614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715061504 00002000:00100000:1.0:1783965094.319361:0:6614:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff94743e439c00 x1870622715061504/t0(0) o4->9923189b-eb4a-470c-ab45-969435371000@192.168.204.12@tcp:520/0 lens 504/0 e 0 to 0 dl 1783965105 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783965094.319374:0:6614:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff94743e439c00 with x1870622715061504 ext(0->8) 00002000:00010000:1.0:1783965094.319380:0:6614:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff94743e439c00 00000100:00100000:1.0:1783965094.319410:0:6614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 0 00000100:00100000:1.0:1783965094.319420:0:6614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e439c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9923189b-eb4a-470c-ab45-969435371000+7:2359:x1870622715061504:12345-192.168.204.12@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1783965094.321462:0:6614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e439c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9923189b-eb4a-470c-ab45-969435371000+9:2359:x1870622715061504:12345-192.168.204.12@tcp:4:lhsmtool_posix.0 Request processed in 2035us (2222us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1783965094.321476:0:6614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 0 00002000:00100000:1.0:1783965094.321486:0:6614:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff94743e439c00 x1870622715061504/t4294967302(0) o4->9923189b-eb4a-470c-ab45-969435371000@192.168.204.12@tcp:520/0 lens 504/448 e 0 to 0 dl 1783965105 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783965094.321503:0:6614:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff94743e439c00 with x1870622715061504 ext(0->8) 00002000:00010000:1.0:1783965094.321509:0:6614:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff94743e439c00 00000100:00100000:0.0:1783965094.322646:0:8330:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947436e76a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8330:1870622732908544:192.168.204.12@tcp:105: 00010000:00010000:0.0:1783965094.322672:0:8330:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783965094.322729:0:8330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94741843f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9923189b-eb4a-470c-ab45-969435371000+8:2359:x1870622715061376:12345-192.168.204.12@tcp:103:ldlm_bl.0 Request processed in 11799us (12610us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965094.322739:0:8330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 42 00000100:00100000:1.0:1783965094.328691:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965094.328768:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715061632 00000100:00100000:3.0:1783965094.328779:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715061632 00000100:00100000:3.0:1783965094.328842:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 80 00000100:00100000:3.0:1783965094.328853:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e43b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9923189b-eb4a-470c-ab45-969435371000+29:10422:x1870622715061632:12345-192.168.204.12@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1783965094.369846:0:5835:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967350 is committed 00000001:00080000:1.0:1783965094.369866:0:5835:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000004:00080000:1.0:1783965094.369872:0:5835:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:1.0:1783965094.369906:0:5835:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000020:00080000:1.0:1783965094.370135:0:5846:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:1.0:1783965094.370148:0:5846:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:1.0:1783965094.370166:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e43aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3325:1870622732908672:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1783965094.370260:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783965094.370457:0:6609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732908672 00000100:00100000:1.0:1783965094.370465:0:6609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732908672 00000100:00100000:1.0:1783965094.370525:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1783965094.370534:0:6609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e438a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3325:x1870622732908672:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1783965094.370684:0:6609:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1783965094.370688:0:6609:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1783965094 00002000:00010000:1.0:1783965094.370691:0:6609:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1783965094.370693:0:6609:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1783965093 -> 1783965094 00002000:00010000:1.0:1783965094.370696:0:6609:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1783965094.370736:0:6609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e438a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3325:x1870622732908672:12345-0@lo:2:osp-syn-1-0.0 Request processed in 203us (475us total) trans 4294967303 rc 0/0 00000100:00100000:1.0:1783965094.370744:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000004:00080000:1.0:1783965094.370786:0:3325:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94743e43aa00/2, rc 0, transno 4294967303 00000100:00100000:1.0:1783965094.370791:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e43aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3325:1870622732908672:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1783965094.370940:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e43b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9923189b-eb4a-470c-ab45-969435371000+13:10422:x1870622715061632:12345-192.168.204.12@tcp:44:lhsmtool_posix.0 Request processed in 42087us (42257us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965094.370949:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 80 00000100:00080000:0.0:1783965094.371013:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783965094.375137:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965094.376149:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715061760 00000100:00100000:1.0:1783965094.376177:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715061760 00000100:00100000:1.0:1783965094.376294:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 31 00000100:00100000:1.0:1783965094.376315:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e613b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9923189b-eb4a-470c-ab45-969435371000+8:2357:x1870622715061760:12345-192.168.204.12@tcp:16:lhsmtool_posix.0 00000001:00080000:3.0:1783965094.404760:0:7523:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000001:00080000:3.0:1783965094.404779:0:7523:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000100:00100000:1.0:1783965094.409761:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e613b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9923189b-eb4a-470c-ab45-969435371000+6:2357:x1870622715061760:12345-192.168.204.12@tcp:16:lhsmtool_posix.0 Request processed in 33445us (34621us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965094.409776:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 31 00000100:00100000:1.0:1783965094.416117:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783965094.416229:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715062016 00000100:00100000:0.0:1783965094.416239:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715062016 00000100:00100000:0.0:1783965094.416359:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 81 00000100:00100000:0.0:1783965094.416371:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e438700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9923189b-eb4a-470c-ab45-969435371000+13:10422:x1870622715062016:12345-192.168.204.12@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1783965094.416424:0:5812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783965094.416452:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e800/0xe782b916994fd9d8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f002e expref: 13 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965094.416472:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9474186e7100) 00010000:00010000:0.0:1783965094.416477:0:5812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783965094.416507:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff947430c10a00/0xe782b916994fd9ed lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965094.416522:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947430c10a00/0xe782b916994fd9ed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965094.416532:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947430c10a00/0xe782b916994fd9ed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783965094.416831:0:5812:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c8b32d7a reply state 0000000042c4601e transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff947430c10a00/0xe782b916994fd9ed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783965094.416841:0:5812:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783965094.416954:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e438700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9923189b-eb4a-470c-ab45-969435371000+14:10422:x1870622715062016:12345-192.168.204.12@tcp:36:lhsmtool_posix.0 Request processed in 585us (847us total) trans 4294967355 rc 0/0 00000100:00100000:0.0:1783965094.416961:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 81 00000100:00100000:0.0:1783965094.421557:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00010000:00010000:3.0:1783965094.421640:0:3308:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff947430c10a00/0xe782b916994fd9ed lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965094.421669:0:3308:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff947430c10a00/0xe782b916994fd9ed lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965094.421677:0:3308:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff947430c10a00/0xe782b916994fd9ed lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965094.421683:0:3308:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947430c10a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1783965094.421689:0:3308:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947430c10a00/0xe782b916994fd9ed lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965094.421696:0:3308:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947430c10a00/0xe782b916994fd9ed lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965094.421716:0:3308:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9474186e7100) 00010000:00010000:3.0:1783965094.421778:0:3308:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783965094.421784:0:3308:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff947430c10a00/0xe782b916994fd9ed lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965094.421847:0:3308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947430c10a00/0xe782b916994fd9ed lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783965094.423679:0:6609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715062144 00000100:00100000:1.0:1783965094.423693:0:6609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715062144 00000100:00100000:1.0:1783965094.423763:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 32 00000100:00100000:1.0:1783965094.423774:0:6609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e541500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9923189b-eb4a-470c-ab45-969435371000+6:2360:x1870622715062144:12345-192.168.204.12@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1783965094.424294:0:6609:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1783965094.424299:0:6609:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1783965094 -> 1783965092 00002000:00010000:1.0:1783965094.424301:0:6609:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1783965090 00002000:00010000:1.0:1783965094.424303:0:6609:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1783965094 -> 1783965092 00002000:00010000:1.0:1783965094.424306:0:6609:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1783965094.424567:0:6609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e541500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9923189b-eb4a-470c-ab45-969435371000+7:2360:x1870622715062144:12345-192.168.204.12@tcp:2:lhsmtool_posix.0 Request processed in 792us (3016us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1783965094.424585:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 32 00000100:00100000:1.0:1783965094.428770:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965094.429092:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715062400 00000100:00100000:2.0:1783965094.429102:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715062400 00000100:00100000:2.0:1783965094.429246:0:6632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 82 00000100:00100000:2.0:1783965094.429259:0:6632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94741cc31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9923189b-eb4a-470c-ab45-969435371000+13:10422:x1870622715062400:12345-192.168.204.12@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1783965094.429359:0:6632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fc00/0xe782b916994fd9f4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965094.429378:0:6632:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26400/0xe782b916994fd9b5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0020 expref: 13 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965094.429388:0:6632:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fc00/0xe782b916994fd9f4 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965094.429449:0:6632:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26400/0xe782b916994fd9b5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0020 expref: 13 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965094.429462:0:6632:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26400/0xe782b916994fd9b5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0020 expref: 13 pid: 5811 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783965094.429478:0:6632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e610380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6632:1870622732908800:192.168.204.12@tcp:104: 00000100:00100000:2.0:1783965094.429572:0:6632:0:(client.c:2702:ptlrpc_set_wait()) set ffff94743fa8b900 going to sleep for 11 seconds 00000100:00100000:2.0:1783965094.439516:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965094.439836:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715062528 00000100:00100000:1.0:1783965094.439846:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715062528 00010000:00010000:1.0:1783965094.439887:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26400/0xe782b916994fd9b5 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0020 expref: 14 pid: 5811 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783965094.439941:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 43 00000100:00100000:1.0:1783965094.439950:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e613800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9923189b-eb4a-470c-ab45-969435371000+14:2360:x1870622715062528:12345-192.168.204.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783965094.439979:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783965094.439987:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26400/0xe782b916994fd9b5 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0020 expref: 14 pid: 5811 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965094.440010:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26400/0xe782b916994fd9b5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0020 expref: 14 pid: 5811 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965094.440036:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9474186e7100) 00010000:00010000:1.0:1783965094.440041:0:5797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fc00/0xe782b916994fd9f4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965094.440051:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fc00/0xe782b916994fd9f4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965094.440058:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fc00/0xe782b916994fd9f4 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965094.440075:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783965094.440132:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e613800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9923189b-eb4a-470c-ab45-969435371000+14:2360:x1870622715062528:12345-192.168.204.12@tcp:103:ldlm_bl.0 Request processed in 183us (626us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965094.440139:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 43 00010000:00010000:0.0:1783965094.441814:0:6632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26400/0xe782b916994fd9b5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0020 expref: 13 pid: 5811 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783965094.441837:0:6632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e610380 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6632:1870622732908800:192.168.204.12@tcp:104: 00010000:00010000:0.0:1783965094.441859:0:6632:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fc00/0xe782b916994fd9f4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965094.441869:0:6632:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fc00/0xe782b916994fd9f4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965094.441875:0:6632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fc00/0xe782b916994fd9f4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965094.441915:0:6632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fc00/0xe782b916994fd9f4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965094.441922:0:6632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fc00/0xe782b916994fd9f4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965094.441929:0:6632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fc00/0xe782b916994fd9f4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965094.441951:0:6632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743fb8fc00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1783965094.441956:0:6632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fc00/0xe782b916994fd9f4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965094.441964:0:6632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fc00/0xe782b916994fd9f4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965094.441978:0:6632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9474186e7100) 00010000:00010000:0.0:1783965094.441981:0:6632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1783965094.441984:0:6632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fc00/0xe782b916994fd9f4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965094.441991:0:6632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fc00/0xe782b916994fd9f4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783965094.442134:0:6632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94741cc31500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9923189b-eb4a-470c-ab45-969435371000+12:10422:x1870622715062400:12345-192.168.204.12@tcp:55:lhsmtool_posix.0 Request processed in 12877us (13374us total) trans 0 rc -22/-22 00000100:00100000:0.0:1783965094.442144:0:6632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 82 00000100:00100000:2.0:1783965094.452688:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965094.452833:0:8738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715062656 00000100:00100000:3.0:1783965094.452845:0:8738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715062656 00000100:00100000:3.0:1783965094.452910:0:8738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 33 00000100:00100000:3.0:1783965094.452921:0:8738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e610a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9923189b-eb4a-470c-ab45-969435371000+7:2359:x1870622715062656:12345-192.168.204.12@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1783965094.452968:0:8738:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000b6c5d4cf/0xe782b916994fd9fb lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965094.452989:0:8738:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c15d4080/0xe782b916994fd9e6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f003c expref: 7 pid: 8738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965094.453082:0:8738:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783965094.453087:0:8738:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783965094.453093:0:8738:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b6c5d4cf/0xe782b916994fd9fb lrc: 4/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965094.453132:0:8738:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c15d4080/0xe782b916994fd9e6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f003c expref: 7 pid: 8738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965094.453145:0:8738:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c15d4080/0xe782b916994fd9e6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f003c expref: 7 pid: 8738 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783965094.453163:0:8738:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947436e76300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8738:1870622732908928:192.168.204.12@tcp:104: 00000100:00100000:3.0:1783965094.455294:0:8738:0:(client.c:2702:ptlrpc_set_wait()) set ffff9474057dd180 going to sleep for 11 seconds 00000100:00100000:1.0:1783965094.460722:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965094.460861:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715062784 00000100:00100000:2.0:1783965094.460870:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715062784 00010000:00010000:2.0:1783965094.460923:0:5799:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c15d4080/0xe782b916994fd9e6 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f003c expref: 8 pid: 8738 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783965094.461009:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 44 00000100:00100000:2.0:1783965094.461020:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94741cc30380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9923189b-eb4a-470c-ab45-969435371000+8:2360:x1870622715062784:12345-192.168.204.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783965094.461035:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:3.0:1783965094.461056:0:8738:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947436e76300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8738:1870622732908928:192.168.204.12@tcp:104: 00010000:00010000:2.0:1783965094.461057:0:5799:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c15d4080/0xe782b916994fd9e6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f003c expref: 8 pid: 8738 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965094.461069:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c15d4080/0xe782b916994fd9e6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f003c expref: 8 pid: 8738 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965094.461079:0:8738:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b6c5d4cf/0xe782b916994fd9fb lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965094.461092:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c15d4080/0xe782b916994fd9e6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f003c expref: 8 pid: 8738 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965094.463169:0:5799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783965094.463179:0:5799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783965094.463190:0:5799:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b6c5d4cf/0xe782b916994fd9fb lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965094.463227:0:5799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b6c5d4cf/0xe782b916994fd9fb lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965094.463271:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783965094.463355:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94741cc30380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9923189b-eb4a-470c-ab45-969435371000+7:2360:x1870622715062784:12345-192.168.204.12@tcp:103:ldlm_bl.0 Request processed in 2333us (2637us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965094.463366:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 44 00010000:00010000:3.0:1783965094.463745:0:8738:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b6c5d4cf/0xe782b916994fd9fb lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965094.463757:0:8738:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b6c5d4cf/0xe782b916994fd9fb lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965094.463846:0:8738:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000b6c5d4cf/0xe782b916994fd9fb lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965094.463869:0:8738:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b6c5d4cf/0xe782b916994fd9fb lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965094.463878:0:8738:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b6c5d4cf/0xe782b916994fd9fb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965094.463886:0:8738:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947436f27600 already unused, calling callback (ffffffffc168d230) 00010000:00010000:3.0:1783965094.463905:0:8738:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b6c5d4cf/0xe782b916994fd9fb lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965094.463916:0:8738:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b6c5d4cf/0xe782b916994fd9fb lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965094.463934:0:8738:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b6c5d4cf/0xe782b916994fd9fb lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965094.463942:0:8738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b6c5d4cf/0xe782b916994fd9fb lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783965094.464013:0:8738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e610a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9923189b-eb4a-470c-ab45-969435371000+6:2359:x1870622715062656:12345-192.168.204.12@tcp:1:lhsmtool_posix.0 Request processed in 11092us (11334us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965094.464022:0:8738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 33 00000100:00100000:1.0:1783965094.469618:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965094.470642:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715063040 00000100:00100000:2.0:1783965094.470657:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715063040 00000100:00100000:2.0:1783965094.470726:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 83 00000100:00100000:2.0:1783965094.470737:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94741cc32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9923189b-eb4a-470c-ab45-969435371000+12:10422:x1870622715063040:12345-192.168.204.12@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1783965094.470837:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f400/0xe782b916994fda02 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965094.470857:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f400/0xe782b916994fda02 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965094.470869:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f400/0xe782b916994fda02 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965094.471139:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fe00/0xe782b916994fda09 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965094.471161:0:5813:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff947430c11000/0xe782b916994fd9c3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0027 expref: 13 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965094.471169:0:5813:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fe00/0xe782b916994fda09 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965094.471235:0:5813:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff947430c11000/0xe782b916994fd9c3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0027 expref: 13 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965094.471250:0:5813:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff947430c11000/0xe782b916994fd9c3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0027 expref: 13 pid: 6632 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783965094.471265:0:5813:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e611f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5813:1870622732909056:192.168.204.12@tcp:104: 00000100:00100000:2.0:1783965094.472555:0:5813:0:(client.c:2702:ptlrpc_set_wait()) set ffff94743fa8b300 going to sleep for 11 seconds 00000100:00100000:2.0:1783965094.477270:0:5813:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e611f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5813:1870622732909056:192.168.204.12@tcp:104: 00010000:00010000:2.0:1783965094.477300:0:5813:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fe00/0xe782b916994fda09 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783965094.483688:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783965094.483787:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715063168 00000100:00100000:0.0:1783965094.483797:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715063168 00010000:00010000:0.0:1783965094.483839:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff947430c11000/0xe782b916994fd9c3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0027 expref: 14 pid: 6632 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783965094.483886:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 45 00000100:00100000:0.0:1783965094.483907:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94741cc32a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9923189b-eb4a-470c-ab45-969435371000+14:2359:x1870622715063168:12345-192.168.204.12@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783965094.483923:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783965094.483931:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff947430c11000/0xe782b916994fd9c3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0027 expref: 14 pid: 6632 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965094.483964:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff947430c11000/0xe782b916994fd9c3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0027 expref: 14 pid: 6632 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965094.483989:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947430c11000/0xe782b916994fd9c3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0027 expref: 14 pid: 6632 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965094.484008:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9474186e7100) 00010000:00010000:0.0:1783965094.484014:0:5797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fe00/0xe782b916994fda09 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965094.484023:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fe00/0xe782b916994fda09 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965094.484032:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fe00/0xe782b916994fda09 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965094.484069:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783965094.484127:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94741cc32a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9923189b-eb4a-470c-ab45-969435371000+13:2359:x1870622715063168:12345-192.168.204.12@tcp:103:ldlm_bl.0 Request processed in 221us (449us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965094.484134:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 45 00010000:00010000:1.0:1783965094.484626:0:5813:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fe00/0xe782b916994fda09 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965094.484636:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fe00/0xe782b916994fda09 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783965094.484838:0:5813:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:1.0:1783965094.485007:0:5813:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:1.0:1783965094.485055:0:5813:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:1.0:1783965094.485143:0:5813:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94741cc30700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5813:1870622732909184:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1783965094.487390:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783965094.487582:0:5813:0:(client.c:2702:ptlrpc_set_wait()) set ffff947407abc3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783965094.494431:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732909184 00000100:00100000:2.0:1783965094.494448:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732909184 00000100:00100000:2.0:1783965094.494509:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783965094.494520:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94741cc33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5813:x1870622732909184:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1783965094.494659:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94741cc33b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5813:x1870622732909184:12345-0@lo:1000:mdt00_002.0 Request processed in 141us (7275us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965094.494668:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783965094.494846:0:5813:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:3.0:1783965094.494853:0:5813:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94743e43aa00, transno 4294967303 00000100:00100000:3.0:1783965094.494875:0:5813:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94741cc30700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5813:1870622732909184:0@lo:1000:mdt00_002.0 00000001:00080000:2.0:1783965094.495548:0:5813:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:2.0:1783965094.495640:0:5813:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e611f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5813:1870622732909312:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1783965094.495687:0:5813:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783965094.495721:0:5813:0:(client.c:2702:ptlrpc_set_wait()) set ffff94743fa8b780 going to sleep for 11 seconds 00000100:00100000:3.0:1783965094.495773:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732909312 00000100:00100000:3.0:1783965094.495788:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732909312 00000100:00100000:3.0:1783965094.495828:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783965094.495835:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e610380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5813:x1870622732909312:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1783965094.496017:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e610380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5813:x1870622732909312:12345-0@lo:1000:mdt00_002.0 Request processed in 182us (329us total) trans 4294967305 rc 0/0 00000100:00100000:3.0:1783965094.496024:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783965094.496332:0:5813:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e611f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5813:1870622732909312:0@lo:1000:mdt00_002.0 00010000:00010000:2.0:1783965094.496367:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fe00/0xe782b916994fda09 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965094.496379:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fe00/0xe782b916994fda09 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965094.496386:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fe00/0xe782b916994fda09 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965094.496392:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743fb8fe00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1783965094.496397:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fe00/0xe782b916994fda09 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965094.496405:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fe00/0xe782b916994fda09 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965094.496430:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9474186e7100) 00010000:00010000:2.0:1783965094.496434:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783965094.496438:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fe00/0xe782b916994fda09 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965094.496445:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fe00/0xe782b916994fda09 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965094.496483:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff947430c10e00/0xe782b916994fd93e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965094.496489:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff947430c10e00/0xe782b916994fd93e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965094.496504:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff947430c10e00/0xe782b916994fd93e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965094.496508:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947430c10e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1783965094.496512:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947430c10e00/0xe782b916994fd93e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965094.496517:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947430c10e00/0xe782b916994fd93e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965094.496525:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94740a90cb00) 00010000:00010000:2.0:1783965094.496528:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783965094.496531:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff947430c10e00/0xe782b916994fd93e lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965094.496537:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947430c10e00/0xe782b916994fd93e lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965094.496559:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e000/0xe782b916994fda10 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965094.496574:0:5813:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efa00/0xe782b916994fd95a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f000b expref: 16 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965094.496582:0:5813:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e000/0xe782b916994fda10 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965094.496609:0:5813:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efa00/0xe782b916994fd95a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f000b expref: 16 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965094.496635:0:5813:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efa00/0xe782b916994fd95a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f000b expref: 16 pid: 5812 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783965094.496647:0:5813:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e2a4700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5813:1870622732909440:192.168.204.12@tcp:104: 00000100:00100000:2.0:1783965094.496722:0:5813:0:(client.c:2702:ptlrpc_set_wait()) set ffff94743fa8b780 going to sleep for 11 seconds 00000100:00100000:2.0:1783965094.500380:0:5813:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e2a4700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5813:1870622732909440:192.168.204.12@tcp:104: 00000100:00100000:1.0:1783965094.500389:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00010000:00010000:2.0:1783965094.500424:0:5813:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e000/0xe782b916994fda10 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783965094.500566:0:8330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715063296 00000100:00100000:0.0:1783965094.500573:0:8330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715063296 00010000:00010000:0.0:1783965094.500615:0:8330:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efa00/0xe782b916994fd95a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f000b expref: 17 pid: 5812 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783965094.500657:0:8330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 46 00000100:00100000:0.0:1783965094.500666:0:8330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94741cc30700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9923189b-eb4a-470c-ab45-969435371000+17:2359:x1870622715063296:12345-192.168.204.12@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783965094.500698:0:8330:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783965094.500705:0:8330:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efa00/0xe782b916994fd95a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f000b expref: 17 pid: 5812 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965094.500717:0:8330:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efa00/0xe782b916994fd95a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f000b expref: 17 pid: 5812 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965094.500741:0:8330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efa00/0xe782b916994fd95a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f000b expref: 17 pid: 5812 timeout: 428 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965094.500764:0:8330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94740a90cb00) 00010000:00010000:0.0:1783965094.500768:0:8330:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e000/0xe782b916994fda10 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965094.500779:0:8330:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e000/0xe782b916994fda10 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965094.500786:0:8330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e000/0xe782b916994fda10 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965094.500815:0:8330:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783965094.500863:0:8330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94741cc30700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9923189b-eb4a-470c-ab45-969435371000+16:2359:x1870622715063296:12345-192.168.204.12@tcp:103:ldlm_bl.0 Request processed in 198us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965094.500870:0:8330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 46 00010000:00010000:1.0:1783965094.501063:0:5813:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e000/0xe782b916994fda10 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965094.501072:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e000/0xe782b916994fda10 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965094.501083:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e000/0xe782b916994fda10 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965094.501090:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e000/0xe782b916994fda10 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965094.501097:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e000/0xe782b916994fda10 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965094.501103:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743fb8e000 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1783965094.501107:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e000/0xe782b916994fda10 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965094.501114:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e000/0xe782b916994fda10 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965094.501123:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94740a90cb00) 00010000:00010000:1.0:1783965094.501133:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783965094.501137:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e000/0xe782b916994fda10 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965094.501144:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e000/0xe782b916994fda10 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965094.501156:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f400/0xe782b916994fda02 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965094.501162:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f400/0xe782b916994fda02 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965094.501167:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f400/0xe782b916994fda02 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965094.501173:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743fb8f400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1783965094.501176:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f400/0xe782b916994fda02 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965094.501181:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f400/0xe782b916994fda02 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965094.501189:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94740a90cb00) 00010000:00010000:1.0:1783965094.501191:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1783965094.501193:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f400/0xe782b916994fda02 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965094.502006:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f400/0xe782b916994fda02 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783965094.502674:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94741cc32680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9923189b-eb4a-470c-ab45-969435371000+15:10422:x1870622715063040:12345-192.168.204.12@tcp:57:lhsmtool_posix.0 Request processed in 31933us (33059us total) trans 4294967360 rc 0/0 00000100:00100000:0.0:1783965094.502684:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 83 00000020:00080000:0.0:1783965094.502689:0:5813:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1783965094.502753:0:11561:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1783965094.502758:0:11561:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1783965094.502803:0:11561:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1783965094.502810:0:11561:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1783965094.516976:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783965094.517145:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715063552 00000100:00100000:0.0:1783965094.517155:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715063552 00000100:00100000:3.0:1783965094.517240:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 20 00000100:00100000:3.0:1783965094.517253:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e43aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9923189b-eb4a-470c-ab45-969435371000+15:10422:x1870622715063552:12345-192.168.204.12@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1783965094.517997:0:5814:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1783965094.518433:0:5814:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:3.0:1783965094.518487:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27600/0xe782b916994fda17 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965094.518505:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27600/0xe782b916994fda17 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965094.518516:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27600/0xe782b916994fda17 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965094.518525:0:5814:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27600/0xe782b916994fda17 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965094.518532:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27600/0xe782b916994fda17 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965094.518549:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27600/0xe782b916994fda17 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965094.518573:0:5814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1783965094.518791:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e43aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9923189b-eb4a-470c-ab45-969435371000+17:10422:x1870622715063552:12345-192.168.204.12@tcp:35:lhsmtool_posix.0 Request processed in 1537us (1820us total) trans 4294967362 rc 0/0 00000100:00100000:3.0:1783965094.518801:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 20 00000020:00080000:3.0:1783965094.518806:0:5814:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1783965094.518926:0:5800:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783965094.518939:0:5800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27600/0xe782b916994fda17 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965094.518947:0:5800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947436f27600 already unused, calling callback (ffffffffc168d230) 00010000:00010000:1.0:1783965094.518951:0:5800:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27600/0xe782b916994fda17 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965094.518959:0:5800:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27600/0xe782b916994fda17 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965094.518972:0:5800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff94740b97a300) 00010000:00010000:1.0:1783965094.518975:0:5800:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1783965094.518979:0:5800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27600/0xe782b916994fda17 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965094.518984:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27600/0xe782b916994fda17 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965094.519011:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783965094.519013:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783965094.519015:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783965094.571711:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1783965095.533142:0:11561:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1783965095.533152:0:11561:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1783965095.533189:0:11561:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1783965095.533196:0:11561:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1783965095.600823:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1783965096.019969:0:6637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000001:00080000:1.0:1783965096.019988:0:6637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000040:00080000:3.0:1783965096.221095:0:11931:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1783965096.221105:0:11931:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1783965096.221142:0:11931:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1783965096.221148:0:11931:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1783965096.353576:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965096.356274:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715063808 00000100:00100000:3.0:1783965096.356294:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715063808 00000100:00080000:0.0:1783965096.356341:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783965096.356437:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 84 00000100:00100000:3.0:1783965096.356453:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e541180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9923189b-eb4a-470c-ab45-969435371000+17:10440:x1870622715063808:12345-192.168.204.12@tcp:101:lfs.0 00010000:00010000:3.0:1783965096.356487:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783965096.356516:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fda1e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5f0043 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965096.356911:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26600/0xe782b916994fda25 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965096.356943:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26600/0xe782b916994fda25 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965096.356959:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26600/0xe782b916994fda25 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783965096.356976:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:3.0:1783965096.357789:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fda1e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0043 expref: 20 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965096.357814:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26600/0xe782b916994fda25 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0043 expref: 19 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965096.357826:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9474186e7a00) 00010000:00010000:3.0:1783965096.357829:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1783965096.357834:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff947436f26600, rc 0) 00000100:00100000:3.0:1783965096.357956:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e541180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9923189b-eb4a-470c-ab45-969435371000+19:10440:x1870622715063808:12345-192.168.204.12@tcp:101:lfs.0 Request processed in 1506us (4597us total) trans 4294967363 rc 0/0 00000100:00100000:3.0:1783965096.357966:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 84 00000100:00100000:0.0:1783965096.360967:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965096.361131:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715063936 00000100:00100000:3.0:1783965096.361144:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715063936 00000100:00100000:3.0:1783965096.361285:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 85 00000100:00100000:3.0:1783965096.361300:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e543100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9923189b-eb4a-470c-ab45-969435371000+19:10440:x1870622715063936:12345-192.168.204.12@tcp:34:lfs.0 00010000:00010000:3.0:1783965096.361428:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fda33 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965096.361584:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fda33 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965096.361617:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fda33 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965096.361639:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27c00/0xe782b916994fda3a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965096.361647:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27c00/0xe782b916994fda3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965096.361654:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27c00/0xe782b916994fda3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965096.362708:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27000/0xe782b916994fda41 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965096.362726:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27000/0xe782b916994fda41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965096.362736:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27000/0xe782b916994fda41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783965096.362979:0:5812:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27000/0xe782b916994fda41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965096.362997:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fda33 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965096.363005:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fda33 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965096.363014:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fda33 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965096.363035:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947436f26e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1783965096.363040:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fda33 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965096.363050:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fda33 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965096.363066:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9474186e7a00) 00010000:00010000:3.0:1783965096.363070:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783965096.363076:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fda33 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965096.363084:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fda33 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965096.363100:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27c00/0xe782b916994fda3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965096.363105:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27c00/0xe782b916994fda3a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965096.363582:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27c00/0xe782b916994fda3a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965096.363591:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947436f27c00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1783965096.363595:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27c00/0xe782b916994fda3a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965096.363601:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27c00/0xe782b916994fda3a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965096.363624:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff94740b97a600) 00010000:00010000:3.0:1783965096.363627:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783965096.363631:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27c00/0xe782b916994fda3a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965096.363638:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27c00/0xe782b916994fda3a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965096.363662:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27000/0xe782b916994fda41 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965096.363669:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27000/0xe782b916994fda41 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965096.363674:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27000/0xe782b916994fda41 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965096.363678:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947436f27000 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1783965096.363682:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27000/0xe782b916994fda41 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965096.363687:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27000/0xe782b916994fda41 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965096.363694:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94740b97aa00) 00010000:00010000:3.0:1783965096.363696:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783965096.363699:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27000/0xe782b916994fda41 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965096.363704:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27000/0xe782b916994fda41 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783965096.364743:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e543100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9923189b-eb4a-470c-ab45-969435371000+19:10440:x1870622715063936:12345-192.168.204.12@tcp:34:lfs.0 Request processed in 3432us (3779us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965096.364759:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 85 00000100:00100000:2.0:1783965096.423872:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783965096.423976:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715064192 00000100:00100000:0.0:1783965096.423986:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715064192 00000100:00100000:0.0:1783965096.424048:0:6632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 86 00000100:00100000:0.0:1783965096.424060:0:6632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e2a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9923189b-eb4a-470c-ab45-969435371000+19:10443:x1870622715064192:12345-192.168.204.12@tcp:101:lfs.0 00010000:00010000:0.0:1783965096.424083:0:6632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783965096.424107:0:6632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947430c10e00/0xe782b916994fda48 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5f004a expref: -99 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965096.424193:0:6632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff947430c11000/0xe782b916994fda4f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965096.424231:0:6632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947430c11000/0xe782b916994fda4f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965096.424243:0:6632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947430c11000/0xe782b916994fda4f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965096.424259:0:6632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff947430c11400/0xe782b916994fda56 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965096.424267:0:6632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947430c11400/0xe782b916994fda56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965096.424274:0:6632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947430c11400/0xe782b916994fda56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965096.424633:0:6632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff947430c10a00/0xe782b916994fda5d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965096.424652:0:6632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947430c10a00/0xe782b916994fda5d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965096.424661:0:6632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947430c10a00/0xe782b916994fda5d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783965096.424672:0:6632:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:0.0:1783965096.424775:0:6632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff947430c11000/0xe782b916994fda4f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965096.424783:0:6632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff947430c11000/0xe782b916994fda4f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965096.424790:0:6632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff947430c11000/0xe782b916994fda4f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965096.424796:0:6632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947430c11000 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1783965096.424800:0:6632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947430c11000/0xe782b916994fda4f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965096.424808:0:6632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947430c11000/0xe782b916994fda4f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965096.424821:0:6632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9474186e7a00) 00010000:00010000:0.0:1783965096.424824:0:6632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783965096.424828:0:6632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff947430c11000/0xe782b916994fda4f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965096.424834:0:6632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947430c11000/0xe782b916994fda4f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965096.424846:0:6632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff947430c11400/0xe782b916994fda56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965096.424870:0:6632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff947430c11400/0xe782b916994fda56 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965096.424876:0:6632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff947430c11400/0xe782b916994fda56 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965096.424880:0:6632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947430c11400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1783965096.424883:0:6632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947430c11400/0xe782b916994fda56 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965096.424889:0:6632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947430c11400/0xe782b916994fda56 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965096.424897:0:6632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff94740a90c900) 00010000:00010000:0.0:1783965096.424900:0:6632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783965096.424903:0:6632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff947430c11400/0xe782b916994fda56 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965096.424909:0:6632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947430c11400/0xe782b916994fda56 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965096.424954:0:6632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947430c10e00/0xe782b916994fda48 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f004a expref: 22 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965096.424970:0:6632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff947430c10a00/0xe782b916994fda5d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f004a expref: 21 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965096.424977:0:6632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94740a90c300) 00010000:00010000:0.0:1783965096.424979:0:6632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783965096.424988:0:6632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff947430c10a00, rc 0) 00000100:00100000:0.0:1783965096.425065:0:6632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e2a4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9923189b-eb4a-470c-ab45-969435371000+21:10443:x1870622715064192:12345-192.168.204.12@tcp:101:lfs.0 Request processed in 1007us (1211us total) trans 4294967364 rc 0/0 00000100:00100000:0.0:1783965096.425073:0:6632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 86 00000100:00100000:0.0:1783965096.433620:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965096.433696:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715064320 00000100:00100000:2.0:1783965096.433712:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715064320 00000100:00100000:2.0:1783965096.433800:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 87 00000100:00100000:2.0:1783965096.433813:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e541880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9923189b-eb4a-470c-ab45-969435371000+21:10443:x1870622715064320:12345-192.168.204.12@tcp:54:lfs.0 00010000:00010000:2.0:1783965096.433901:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f600/0xe782b916994fda6b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965096.433920:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f600/0xe782b916994fda6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965096.433935:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f600/0xe782b916994fda6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965096.433979:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f600/0xe782b916994fda6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965096.433986:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f600/0xe782b916994fda6b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965096.434007:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f600/0xe782b916994fda6b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965096.434013:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743fb8f600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1783965096.434017:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f600/0xe782b916994fda6b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965096.434024:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f600/0xe782b916994fda6b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965096.434036:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94740a90c300) 00010000:00010000:2.0:1783965096.434039:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783965096.434044:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f600/0xe782b916994fda6b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965096.434050:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f600/0xe782b916994fda6b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783965096.434140:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e541880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9923189b-eb4a-470c-ab45-969435371000+21:10443:x1870622715064320:12345-192.168.204.12@tcp:54:lfs.0 Request processed in 329us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965096.434147:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 87 00000100:00100000:3.0:1783965096.443145:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783965096.443402:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715064576 00000100:00100000:0.0:1783965096.443413:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715064576 00000100:00100000:0.0:1783965096.443477:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 21 00000100:00100000:0.0:1783965096.443487:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947406389850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9923189b-eb4a-470c-ab45-969435371000+21:10443:x1870622715064576:12345-192.168.204.12@tcp:35:lfs.0 00000100:00100000:0.0:1783965096.443732:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947406389850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9923189b-eb4a-470c-ab45-969435371000+22:10443:x1870622715064576:12345-192.168.204.12@tcp:35:lfs.0 Request processed in 246us (597us total) trans 4294967365 rc 0/0 00000100:00100000:0.0:1783965096.443740:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 21 00000100:00100000:0.0:1783965096.490332:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965096.490655:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715064832 00000100:00100000:3.0:1783965096.490669:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715064832 00000100:00100000:3.0:1783965096.490749:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 88 00000100:00100000:3.0:1783965096.490761:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e540700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9923189b-eb4a-470c-ab45-969435371000+22:9963:x1870622715064832:12345-192.168.204.12@tcp:101:bash.0 00010000:00010000:3.0:1783965096.490793:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783965096.490821:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27000/0xe782b916994fda72 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5f0051 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965096.491009:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27c00/0xe782b916994fda79 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965096.491028:0:5811:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff947430c10a00/0xe782b916994fda5d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f004a expref: 23 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965096.491038:0:5811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27c00/0xe782b916994fda79 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965096.491085:0:5811:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff947430c10a00/0xe782b916994fda5d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f004a expref: 23 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965096.491102:0:5811:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff947430c10a00/0xe782b916994fda5d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f004a expref: 23 pid: 6632 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783965096.491136:0:5811:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947436e76300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5811:1870622732909568:192.168.204.12@tcp:104: 00000100:00100000:2.0:1783965096.491623:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e2a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ae0997f7-3a15-4fc6-865a-35b2f101956e:3322:1870622732909696:0@lo:400:kworker.0 00000100:00100000:1.0:1783965096.491638:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e2a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3324:1870622732909952:0@lo:400:kworker.0 00000100:00100000:0.0:1783965096.491758:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e2a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3323:1870622732909824:0@lo:400:kworker.0 00000100:00100000:3.0:1783965096.492294:0:5811:0:(client.c:2702:ptlrpc_set_wait()) set ffff9474057dd3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783965096.492351:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e2a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3325:1870622732910080:0@lo:400:kworker.0 00000100:00100000:1.0:1783965096.492895:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783965096.493054:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947437072a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3324:1870622732910464:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783965096.493096:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783965096.493131:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732910464 00000100:00100000:1.0:1783965096.493139:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732910464 00000100:00100000:1.0:1783965096.493217:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1783965096.493241:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947437072300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3324:x1870622732910464:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783965096.493300:0:6611:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783965096.493612:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947437072300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3324:x1870622732910464:12345-0@lo:13:osp-pre-1-0.0 Request processed in 115us (255us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965096.493623:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1783965096.493689:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947437072a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3324:1870622732910464:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783965096.493721:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732909952 00000100:00100000:1.0:1783965096.493724:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732909952 00000100:00100000:1.0:1783965096.493758:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1783965096.493765:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e43aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3324:x1870622732909952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783965096.493811:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e43aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3324:x1870622732909952:12345-0@lo:400:kworker.0 Request processed in 47us (920us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965096.493819:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1783965096.493849:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e2a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3324:1870622732909952:0@lo:400:kworker.0 00000100:00080000:1.0:1783965096.493915:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783965096.493922:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783965096.497572:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783965096.497658:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e2a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3322:1870622732910208:0@lo:400:kworker.0 00000100:00100000:2.0:1783965096.497732:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783965096.497766:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732909696 00000100:00100000:1.0:1783965096.497782:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732909696 00000100:00100000:1.0:1783965096.497881:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1783965096.497892:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947408ec8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae0997f7-3a15-4fc6-865a-35b2f101956e+19:3322:x1870622732909696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783965096.497993:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947408ec8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae0997f7-3a15-4fc6-865a-35b2f101956e+19:3322:x1870622732909696:12345-0@lo:400:kworker.0 Request processed in 103us (429us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965096.498002:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:1.0:1783965096.498052:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732910208 00000100:00100000:1.0:1783965096.498056:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732910208 00000100:00100000:1.0:1783965096.498098:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1783965096.498125:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e2a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3322:x1870622732910208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783965096.498163:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e2a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3322:x1870622732910208:12345-0@lo:400:kworker.0 Request processed in 41us (431us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965096.498170:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00080000:1.0:1783965096.498188:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783965096.499284:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783965096.499330:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e2a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3323:1870622732910336:0@lo:400:kworker.0 00000100:00100000:1.0:1783965096.499383:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783965096.501513:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e2a5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ae0997f7-3a15-4fc6-865a-35b2f101956e:3322:1870622732909696:0@lo:400:kworker.0 00000100:00100000:2.0:1783965096.501535:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e2a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3322:1870622732910208:0@lo:400:kworker.0 00000100:00100000:0.0:1783965096.501823:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732910336 00000100:00100000:0.0:1783965096.501838:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732910336 00000100:00100000:0.0:1783965096.501930:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1783965096.501942:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947437073480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3323:x1870622732910336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783965096.502077:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947437073480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3323:x1870622732910336:12345-0@lo:400:kworker.0 Request processed in 137us (2692us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965096.502084:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1783965096.502127:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732909824 00000100:00100000:0.0:1783965096.502132:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732909824 00000100:00100000:2.0:1783965096.502160:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e2a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3323:1870622732910336:0@lo:400:kworker.0 00000100:00100000:0.0:1783965096.502173:0:6632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1783965096.502181:0:6632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947437072a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3323:x1870622732909824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783965096.502250:0:6632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947437072a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3323:x1870622732909824:12345-0@lo:400:kworker.0 Request processed in 70us (2983us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965096.502269:0:6632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1783965096.502489:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e2a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3323:1870622732909824:0@lo:400:kworker.0 00000100:00100000:3.0:1783965096.503073:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783965096.504197:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965096.504712:0:5811:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947436e76300 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5811:1870622732909568:192.168.204.12@tcp:104: 00010000:00010000:3.0:1783965096.504748:0:5811:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27c00/0xe782b916994fda79 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783965096.504874:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715064960 00000100:00100000:2.0:1783965096.504884:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715064960 00010000:00010000:2.0:1783965096.504930:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff947430c10a00/0xe782b916994fda5d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f004a expref: 24 pid: 6632 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783965096.504974:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 47 00000100:00100000:2.0:1783965096.504983:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e543b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9923189b-eb4a-470c-ab45-969435371000+24:2360:x1870622715064960:12345-192.168.204.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783965096.505002:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783965096.505010:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff947430c10a00/0xe782b916994fda5d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f004a expref: 24 pid: 6632 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965096.505024:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff947430c10a00/0xe782b916994fda5d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f004a expref: 24 pid: 6632 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965096.505051:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947430c10a00/0xe782b916994fda5d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f004a expref: 24 pid: 6632 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965096.505073:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94740a90c300) 00010000:00010000:2.0:1783965096.505078:0:5797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27c00/0xe782b916994fda79 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965096.505088:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27c00/0xe782b916994fda79 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965096.505095:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27c00/0xe782b916994fda79 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965096.505140:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783965096.505242:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e543b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9923189b-eb4a-470c-ab45-969435371000+23:2360:x1870622715064960:12345-192.168.204.12@tcp:103:ldlm_bl.0 Request processed in 259us (1052us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965096.505250:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 47 00010000:00010000:2.0:1783965096.505914:0:5811:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27c00/0xe782b916994fda79 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965096.505926:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27c00/0xe782b916994fda79 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783965096.505952:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:2.0:1783965096.506167:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27000/0xe782b916994fda72 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0051 expref: 24 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965096.506187:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27c00/0xe782b916994fda79 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0051 expref: 23 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965096.506197:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94740a90c300) 00000100:00100000:1.0:1783965096.506285:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732910080 00000100:00100000:1.0:1783965096.506294:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732910080 00000100:00100000:1.0:1783965096.506350:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1783965096.506358:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436e77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3325:x1870622732910080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783965096.506453:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436e77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3325:x1870622732910080:12345-0@lo:400:kworker.0 Request processed in 97us (3384us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965096.506461:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1783965096.506507:0:3325:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:1.0:1783965096.506514:0:3325:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967301 00000004:00080000:1.0:1783965096.506536:0:3325:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff947436307b80, transno 4294967301 00000100:00100000:1.0:1783965096.506549:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e2a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3325:1870622732910080:0@lo:400:kworker.0 00000100:00080000:0.0:1783965096.506998:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1783965096.508084:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1783965096.508101:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff947436f27c00, rc 0) 00000100:00100000:2.0:1783965096.508260:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e540700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9923189b-eb4a-470c-ab45-969435371000+23:9963:x1870622715064832:12345-192.168.204.12@tcp:101:bash.0 Request processed in 17495us (17936us total) trans 4294967366 rc 0/0 00000100:00100000:2.0:1783965096.508326:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 88 00000100:00100000:0.0:1783965096.513798:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965096.513925:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715065216 00000100:00100000:1.0:1783965096.513938:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715065216 00000100:00100000:1.0:1783965096.514048:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 89 00000100:00100000:1.0:1783965096.514060:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e541c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9923189b-eb4a-470c-ab45-969435371000+23:9963:x1870622715065216:12345-192.168.204.12@tcp:36:bash.0 00010000:00010000:1.0:1783965096.514564:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994fda87 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965096.514588:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994fda87 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965096.514620:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994fda87 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783965096.514681:0:5812:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:1.0:1783965096.514708:0:5812:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e56b8eca reply state 00000000b42283bf transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994fda87 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783965096.514719:0:5812:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1783965096.514770:0:5812:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:1.0:1783965096.514920:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e541c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9923189b-eb4a-470c-ab45-969435371000+27:9963:x1870622715065216:12345-192.168.204.12@tcp:36:bash.0 Request processed in 860us (1134us total) trans 4294967369 rc 0/0 00000100:00100000:1.0:1783965096.514929:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 89 00000020:00080000:1.0:1783965096.514935:0:5812:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1783965096.517712:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00010000:00010000:2.0:1783965096.517760:0:3309:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994fda87 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965096.517775:0:3309:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994fda87 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965096.517806:0:3309:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994fda87 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965096.517813:0:3309:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743d9ee800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1783965096.517819:0:3309:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994fda87 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965096.517829:0:3309:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994fda87 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965096.517849:0:3309:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94740a90c300) 00010000:00010000:2.0:1783965096.517865:0:3309:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783965096.517872:0:3309:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994fda87 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965096.517879:0:3309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994fda87 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783965096.518708:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715065344 00000100:00100000:0.0:1783965096.518725:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715065344 00000100:00100000:0.0:1783965096.518802:0:6632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 90 00000100:00100000:0.0:1783965096.518815:0:6632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436e76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9923189b-eb4a-470c-ab45-969435371000+26:9963:x1870622715065344:12345-192.168.204.12@tcp:101:bash.0 00010000:00010000:0.0:1783965096.518847:0:6632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783965096.518884:0:6632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947430c10e00/0xe782b916994fda8e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5f0058 expref: -99 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965096.518964:0:6632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947430c10e00/0xe782b916994fda8e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0058 expref: 27 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965096.518982:0:6632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff947430c10e00/0xe782b916994fda8e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0058 expref: 27 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965096.519005:0:6632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94740a90c300) 00010000:00010000:0.0:1783965096.519008:0:6632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783965096.519011:0:6632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff947430c10e00, rc 0) 00000100:00100000:0.0:1783965096.519092:0:6632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436e76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9923189b-eb4a-470c-ab45-969435371000+27:9963:x1870622715065344:12345-192.168.204.12@tcp:101:bash.0 Request processed in 280us (1395us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965096.519101:0:6632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 90 00000100:00100000:0.0:1783965096.521734:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965096.521823:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715065472 00000100:00100000:3.0:1783965096.521834:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715065472 00000100:00100000:3.0:1783965096.521931:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 34 00000100:00100000:3.0:1783965096.521943:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e542d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9923189b-eb4a-470c-ab45-969435371000+6:9963:x1870622715065472:12345-192.168.204.12@tcp:101:bash.0 00010000:00010000:3.0:1783965096.521967:0:6606:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783965096.521993:0:6606:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006127a45f/0xe782b916994fda95 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5f005f expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783965096.522026:0:6606:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a5525a4, atime: 0x6a5525a2, ctime: 0x6a5525a4, blocks: 0xb 00010000:00010000:3.0:1783965096.522054:0:6606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=330s v=(0 0) 00010000:00010000:3.0:1783965096.522059:0:6606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783965096.522069:0:6606:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006127a45f/0xe782b916994fda95 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f005f expref: 7 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965096.522089:0:6606:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006127a45f/0xe782b916994fda95 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f005f expref: 7 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965096.522120:0:6606:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff947436f26e00, rc 0) 00000100:00100000:3.0:1783965096.522185:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e542d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9923189b-eb4a-470c-ab45-969435371000+7:9963:x1870622715065472:12345-192.168.204.12@tcp:101:bash.0 Request processed in 244us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965096.522193:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 34 00000100:00080000:0.0:1783965096.522354:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783965096.524071:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783965096.524488:0:6612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715065600 00000100:00100000:0.0:1783965096.524516:0:6612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715065600 00002000:00010000:0.0:1783965096.524567:0:6612:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:0.0:1783965096.524573:0:6612:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff947436e75500 with x1870622715065600 ext(0->18446744073709551615) 00002000:00010000:0.0:1783965096.524587:0:6612:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff947436e75500. 00000100:00100000:0.0:1783965096.524622:0:6612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 1 00000100:00100000:0.0:1783965096.524635:0:6612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436e75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9923189b-eb4a-470c-ab45-969435371000+7:2360:x1870622715065600:12345-192.168.204.12@tcp:10:bash.0 00002000:00010000:0.0:1783965096.525031:0:6612:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1783965096.525035:0:6612:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1783965092 -> 1783965096 00002000:00010000:0.0:1783965096.525038:0:6612:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 1783965090 -> 1783965090 00002000:00010000:0.0:1783965096.525040:0:6612:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1783965092 -> 1783965096 00002000:00010000:0.0:1783965096.525042:0:6612:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1783965096.525124:0:6612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436e75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9923189b-eb4a-470c-ab45-969435371000+8:2360:x1870622715065600:12345-192.168.204.12@tcp:10:bash.0 Request processed in 491us (1065us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1783965096.525132:0:6612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 1 00002000:00010000:0.0:1783965096.525136:0:6612:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:0.0:1783965096.525139:0:6612:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff947436e75500 with x1870622715065600 ext(0->18446744073709551615) 00002000:00010000:0.0:1783965096.525143:0:6612:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff947436e75500. 00000100:00100000:0.0:1783965096.608753:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965096.608900:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715065728 00000100:00100000:1.0:1783965096.608914:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715065728 00000100:00100000:1.0:1783965096.609028:0:6632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 91 00000100:00100000:1.0:1783965096.609041:0:6632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e540a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9923189b-eb4a-470c-ab45-969435371000+27:10457:x1870622715065728:12345-192.168.204.12@tcp:34:lfs.0 00010000:00010000:1.0:1783965096.609147:0:6632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eea00/0xe782b916994fda9c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965096.609168:0:6632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eea00/0xe782b916994fda9c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965096.609182:0:6632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eea00/0xe782b916994fda9c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965096.609223:0:6632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994fdaa3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965096.609231:0:6632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994fdaa3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965096.609256:0:6632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994fdaa3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965096.609813:0:6632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efa00/0xe782b916994fdaaa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965096.609827:0:6632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efa00/0xe782b916994fdaaa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965096.609834:0:6632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efa00/0xe782b916994fdaaa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783965096.609903:0:6632:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efa00/0xe782b916994fdaaa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965096.609916:0:6632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eea00/0xe782b916994fda9c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965096.609924:0:6632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eea00/0xe782b916994fda9c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965096.609932:0:6632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eea00/0xe782b916994fda9c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965096.609939:0:6632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743d9eea00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1783965096.609945:0:6632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eea00/0xe782b916994fda9c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965096.609954:0:6632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eea00/0xe782b916994fda9c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965096.609968:0:6632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9474186e7a00) 00010000:00010000:1.0:1783965096.609979:0:6632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783965096.609986:0:6632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eea00/0xe782b916994fda9c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965096.609992:0:6632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eea00/0xe782b916994fda9c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965096.610015:0:6632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994fdaa3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965096.610021:0:6632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994fdaa3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965096.610028:0:6632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994fdaa3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965096.610033:0:6632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743d9ee800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1783965096.610036:0:6632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994fdaa3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965096.610042:0:6632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994fdaa3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965096.610051:0:6632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff947407b5cd00) 00010000:00010000:1.0:1783965096.610053:0:6632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783965096.610056:0:6632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994fdaa3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965096.610062:0:6632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994fdaa3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965096.610080:0:6632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efa00/0xe782b916994fdaaa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965096.610092:0:6632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efa00/0xe782b916994fdaaa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965096.610098:0:6632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efa00/0xe782b916994fdaaa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965096.610103:0:6632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743d9efa00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1783965096.610106:0:6632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efa00/0xe782b916994fdaaa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965096.610112:0:6632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efa00/0xe782b916994fdaaa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965096.610120:0:6632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94740a90c300) 00010000:00010000:1.0:1783965096.610123:0:6632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783965096.610126:0:6632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efa00/0xe782b916994fdaaa lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965096.610132:0:6632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efa00/0xe782b916994fdaaa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783965096.610351:0:6632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e540a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9923189b-eb4a-470c-ab45-969435371000+27:10457:x1870622715065728:12345-192.168.204.12@tcp:34:lfs.0 Request processed in 1307us (1984us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965096.610362:0:6632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 91 00010000:00010000:3.0:1783965096.619397:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783965096.647663:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965096.647799:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715065984 00000100:00100000:1.0:1783965096.647813:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715065984 00000100:00100000:1.0:1783965096.647908:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 92 00000100:00100000:1.0:1783965096.647921:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436e75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9923189b-eb4a-470c-ab45-969435371000+27:10460:x1870622715065984:12345-192.168.204.12@tcp:101:lfs.0 00010000:00010000:1.0:1783965096.647961:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783965096.648011:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efa00/0xe782b916994fdab1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5f0066 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965096.648113:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994fdab8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965096.648133:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994fdab8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965096.648148:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994fdab8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965096.648166:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eea00/0xe782b916994fdabf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965096.648173:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eea00/0xe782b916994fdabf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965096.648179:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eea00/0xe782b916994fdabf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965096.648640:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef200/0xe782b916994fdac6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965096.648652:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef200/0xe782b916994fdac6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965096.648661:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef200/0xe782b916994fdac6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783965096.648673:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1783965096.648800:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994fdab8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965096.648825:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994fdab8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965096.648832:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994fdab8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965096.648840:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743d9ee800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1783965096.648845:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994fdab8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965096.648866:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994fdab8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965096.648882:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9474186e7a00) 00010000:00010000:1.0:1783965096.648885:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783965096.648891:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994fdab8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965096.648898:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994fdab8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965096.648921:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eea00/0xe782b916994fdabf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965096.648927:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eea00/0xe782b916994fdabf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965096.648933:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eea00/0xe782b916994fdabf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965096.648938:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743d9eea00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1783965096.648949:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eea00/0xe782b916994fdabf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965096.648956:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eea00/0xe782b916994fdabf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965096.648964:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff947407b5cd00) 00010000:00010000:1.0:1783965096.648967:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783965096.648970:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eea00/0xe782b916994fdabf lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965096.648977:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eea00/0xe782b916994fdabf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965096.649036:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efa00/0xe782b916994fdab1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0066 expref: 30 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965096.649061:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef200/0xe782b916994fdac6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0066 expref: 29 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965096.649070:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94740a90c300) 00010000:00010000:1.0:1783965096.649073:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1783965096.649076:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94743d9ef200, rc 0) 00000100:00100000:1.0:1783965096.649158:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436e75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9923189b-eb4a-470c-ab45-969435371000+29:10460:x1870622715065984:12345-192.168.204.12@tcp:101:lfs.0 Request processed in 1240us (1511us total) trans 4294967370 rc 0/0 00000100:00100000:1.0:1783965096.649168:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 92 00000100:00100000:0.0:1783965096.652737:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965096.652865:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715066112 00000100:00100000:3.0:1783965096.652877:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715066112 00000100:00100000:3.0:1783965096.652954:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 93 00000100:00100000:3.0:1783965096.652966:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e540000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9923189b-eb4a-470c-ab45-969435371000+29:10460:x1870622715066112:12345-192.168.204.12@tcp:54:lfs.0 00010000:00010000:3.0:1783965096.653061:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fdad4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965096.653083:0:5811:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27c00/0xe782b916994fda79 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0051 expref: 29 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965096.653094:0:5811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fdad4 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965096.653137:0:5811:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27c00/0xe782b916994fda79 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0051 expref: 29 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965096.653153:0:5811:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27c00/0xe782b916994fda79 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0051 expref: 29 pid: 5811 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783965096.653245:0:5811:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947436e77100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5811:1870622732910592:192.168.204.12@tcp:104: 00000100:00100000:2.0:1783965096.653907:0:5811:0:(client.c:2702:ptlrpc_set_wait()) set ffff9474057dd3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783965096.657285:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783965096.657448:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715066368 00000100:00100000:0.0:1783965096.657462:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715066368 00000100:00100000:0.0:1783965096.657535:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 22 00000100:00100000:0.0:1783965096.657548:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436e75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9923189b-eb4a-470c-ab45-969435371000+30:5571:x1870622715066368:12345-192.168.204.12@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1783965096.660558:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436e75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9923189b-eb4a-470c-ab45-969435371000+31:5571:x1870622715066368:12345-192.168.204.12@tcp:35:ldlm_bl.0 Request processed in 2995us (3282us total) trans 4294967371 rc 0/0 00000100:00100000:0.0:1783965096.660576:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 22 00000100:00100000:0.0:1783965096.665338:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783965096.665437:0:5811:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947436e77100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5811:1870622732910592:192.168.204.12@tcp:104: 00010000:00010000:0.0:1783965096.665477:0:5811:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fdad4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783965096.666498:0:8330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715066496 00000100:00100000:3.0:1783965096.666513:0:8330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715066496 00010000:00010000:3.0:1783965096.666577:0:8330:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27c00/0xe782b916994fda79 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0051 expref: 31 pid: 5811 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783965096.666641:0:8330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 48 00000100:00100000:3.0:1783965096.666654:0:8330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e541f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9923189b-eb4a-470c-ab45-969435371000+31:2360:x1870622715066496:12345-192.168.204.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783965096.666676:0:8330:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783965096.666686:0:8330:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27c00/0xe782b916994fda79 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0051 expref: 31 pid: 5811 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965096.666701:0:8330:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27c00/0xe782b916994fda79 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0051 expref: 31 pid: 5811 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965096.666729:0:8330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27c00/0xe782b916994fda79 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0051 expref: 31 pid: 5811 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965096.666750:0:8330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94740a90c300) 00010000:00010000:3.0:1783965096.666756:0:8330:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fdad4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965096.666767:0:8330:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fdad4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965096.666799:0:8330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fdad4 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965096.666839:0:8330:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783965096.666925:0:8330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e541f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9923189b-eb4a-470c-ab45-969435371000+30:2360:x1870622715066496:12345-192.168.204.12@tcp:103:ldlm_bl.0 Request processed in 274us (1607us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965096.666934:0:8330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 48 00010000:00010000:0.0:1783965096.666964:0:5811:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fdad4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965096.666972:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fdad4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965096.667013:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fdad4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965096.667020:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fdad4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965096.667027:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fdad4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965096.667033:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947436f26200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1783965096.667038:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fdad4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965096.667045:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fdad4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965096.667056:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94740a90c300) 00010000:00010000:0.0:1783965096.667059:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783965096.667062:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fdad4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965096.667079:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fdad4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783965096.667140:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e540000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9923189b-eb4a-470c-ab45-969435371000+29:10460:x1870622715066112:12345-192.168.204.12@tcp:54:lfs.0 Request processed in 14175us (14420us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965096.667149:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 93 00000100:00100000:0.0:1783965096.669568:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965096.669654:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715066752 00000100:00100000:3.0:1783965096.669667:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715066752 00000100:00100000:3.0:1783965096.669734:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 23 00000100:00100000:3.0:1783965096.669748:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e540380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9923189b-eb4a-470c-ab45-969435371000+29:10460:x1870622715066752:12345-192.168.204.12@tcp:35:lfs.0 00000100:00100000:3.0:1783965096.670493:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e540380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9923189b-eb4a-470c-ab45-969435371000+30:10460:x1870622715066752:12345-192.168.204.12@tcp:35:lfs.0 Request processed in 744us (935us total) trans 4294967372 rc 0/0 00000100:00100000:3.0:1783965096.670505:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 23 00000100:00100000:3.0:1783965096.744520:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965096.744604:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715067008 00000100:00100000:1.0:1783965096.744619:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715067008 00000100:00100000:1.0:1783965096.744708:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 94 00000100:00100000:1.0:1783965096.744721:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436e74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9923189b-eb4a-470c-ab45-969435371000+30:10471:x1870622715067008:12345-192.168.204.12@tcp:101:cat.0 00010000:00010000:1.0:1783965096.744779:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783965096.744811:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efa00/0xe782b916994fdadb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5f006d expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965096.745036:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eea00/0xe782b916994fdae2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965096.745057:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eea00/0xe782b916994fdae2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965096.745071:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eea00/0xe782b916994fdae2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965096.745089:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994fdae9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965096.745096:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994fdae9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965096.745103:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994fdae9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965096.745673:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef400/0xe782b916994fdaf0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965096.745684:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef400/0xe782b916994fdaf0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965096.745691:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef400/0xe782b916994fdaf0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783965096.745702:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:1.0:1783965096.745817:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eea00/0xe782b916994fdae2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965096.745825:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eea00/0xe782b916994fdae2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965096.745831:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eea00/0xe782b916994fdae2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965096.745837:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743d9eea00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1783965096.745841:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eea00/0xe782b916994fdae2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965096.745858:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eea00/0xe782b916994fdae2 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965096.745872:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9474186e7a00) 00010000:00010000:1.0:1783965096.745875:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783965096.745879:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eea00/0xe782b916994fdae2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965096.746022:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eea00/0xe782b916994fdae2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965096.746043:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994fdae9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965096.746050:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994fdae9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965096.746056:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994fdae9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965096.746060:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743d9ee800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1783965096.746070:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994fdae9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965096.746076:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994fdae9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965096.746085:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff947407b5cd00) 00010000:00010000:1.0:1783965096.746087:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783965096.746090:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994fdae9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965096.746096:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994fdae9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965096.746164:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efa00/0xe782b916994fdadb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f006d expref: 33 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965096.746189:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef400/0xe782b916994fdaf0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f006d expref: 32 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965096.746197:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94740a90c300) 00010000:00010000:1.0:1783965096.746462:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783965096.746467:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94743d9ef400, rc 0) 00000100:00100000:1.0:1783965096.746566:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436e74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9923189b-eb4a-470c-ab45-969435371000+32:10471:x1870622715067008:12345-192.168.204.12@tcp:101:cat.0 Request processed in 1846us (2062us total) trans 4294967373 rc 0/0 00000100:00100000:1.0:1783965096.746577:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 94 00000100:00100000:0.0:1783965096.752966:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965096.753138:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715067264 00000100:00100000:3.0:1783965096.753155:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715067264 00000100:00100000:3.0:1783965096.753259:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 24 00000100:00100000:3.0:1783965096.753280:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e542680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9923189b-eb4a-470c-ab45-969435371000+32:10471:x1870622715067264:12345-192.168.204.12@tcp:35:cat.0 00000100:00100000:3.0:1783965096.753639:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e542680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9923189b-eb4a-470c-ab45-969435371000+33:10471:x1870622715067264:12345-192.168.204.12@tcp:35:cat.0 Request processed in 361us (687us total) trans 4294967374 rc 0/0 00000100:00100000:3.0:1783965096.753649:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 24 00000100:00100000:0.0:1783965096.778780:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965096.778918:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715067520 00000100:00100000:1.0:1783965096.778933:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715067520 00000100:00100000:1.0:1783965096.779017:0:6632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 95 00000100:00100000:1.0:1783965096.779029:0:6632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e540e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9923189b-eb4a-470c-ab45-969435371000+33:10472:x1870622715067520:12345-192.168.204.12@tcp:36:rm.0 00010000:00010000:1.0:1783965096.779136:0:6632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1783965096.779179:0:6632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef400/0xe782b916994fdaf0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f006d expref: 33 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965096.779687:0:6632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef200/0xe782b916994fdac6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0066 expref: 32 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965096.779705:0:6632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947430c10e00/0xe782b916994fda8e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0058 expref: 31 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965096.779719:0:6632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff94740a90c300) 00010000:00010000:1.0:1783965096.779733:0:6632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783965096.779763:0:6632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efa00/0xe782b916994fdafe lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965096.779781:0:6632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efa00/0xe782b916994fdafe lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965096.779792:0:6632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efa00/0xe782b916994fdafe lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965096.779811:0:6632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994fdb05 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965096.779818:0:6632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994fdb05 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965096.779826:0:6632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994fdb05 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965096.780653:0:6632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eea00/0xe782b916994fdb0c lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965096.780669:0:6632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eea00/0xe782b916994fdb0c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965096.780678:0:6632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eea00/0xe782b916994fdb0c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783965096.781673:0:6632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:1.0:1783965096.781687:0:6632:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 331010484218ns, next at 332010480657ns, rc = 0 00010000:00010000:1.0:1783965096.781773:0:6632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee200/0xe782b916994fdb13 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965096.781787:0:6632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee200/0xe782b916994fdb13 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965096.781797:0:6632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee200/0xe782b916994fdb13 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965096.781807:0:6632:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee200/0xe782b916994fdb13 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965096.781813:0:6632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee200/0xe782b916994fdb13 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965096.781820:0:6632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee200/0xe782b916994fdb13 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965096.782264:0:6632:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783965096.782536:0:5800:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783965096.782546:0:5800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee200/0xe782b916994fdb13 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965096.782553:0:6632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eea00/0xe782b916994fdb0c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965096.782573:0:6632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eea00/0xe782b916994fdb0c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965096.782578:0:6632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eea00/0xe782b916994fdb0c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965096.782579:0:5800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743d9ee200 already unused, calling callback (ffffffffc168d230) 00010000:00010000:1.0:1783965096.782584:0:6632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743d9eea00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1783965096.782585:0:5800:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee200/0xe782b916994fdb13 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965096.782587:0:6632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eea00/0xe782b916994fdb0c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965096.782594:0:5800:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee200/0xe782b916994fdb13 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965096.782595:0:6632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eea00/0xe782b916994fdb0c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965096.782612:0:5800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff947407b5c800) 00010000:00010000:2.0:1783965096.782621:0:5800:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1783965096.782625:0:6632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff947407b5c800) 00010000:00010000:2.0:1783965096.782627:0:5800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee200/0xe782b916994fdb13 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965096.782627:0:6632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1783965096.782630:0:6632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eea00/0xe782b916994fdb0c lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965096.782636:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee200/0xe782b916994fdb13 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT flags: 0x44819480000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965096.782636:0:6632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eea00/0xe782b916994fdb0c lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965096.782662:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783965096.782663:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783965096.782665:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783965096.782669:0:6632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efa00/0xe782b916994fdafe lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965096.782674:0:6632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efa00/0xe782b916994fdafe lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965096.782680:0:6632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efa00/0xe782b916994fdafe lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965096.782686:0:6632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743d9efa00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1783965096.782695:0:6632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efa00/0xe782b916994fdafe lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965096.782702:0:6632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efa00/0xe782b916994fdafe lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965096.782711:0:6632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9474186e7a00) 00010000:00010000:1.0:1783965096.782714:0:6632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783965096.782717:0:6632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efa00/0xe782b916994fdafe lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965096.782723:0:6632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efa00/0xe782b916994fdafe lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783965096.782747:0:6632:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008f4516d4 reply state 00000000250c81ca transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994fdb05 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783965096.782758:0:6632:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783965096.783054:0:6632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e540e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9923189b-eb4a-470c-ab45-969435371000+32:10472:x1870622715067520:12345-192.168.204.12@tcp:36:rm.0 Request processed in 4021us (4284us total) trans 4294967375 rc 0/0 00000100:00100000:1.0:1783965096.783064:0:6632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 95 00010000:00010000:3.0:1783965096.785558:0:3308:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994fdb05 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965096.785583:0:3308:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994fdb05 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965096.785610:0:3308:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994fdb05 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965096.785617:0:3308:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743d9ee800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1783965096.785622:0:3308:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994fdb05 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965096.785631:0:3308:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994fdb05 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965096.785652:0:3308:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff947407b5cd00) 00010000:00010000:3.0:1783965096.785656:0:3308:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783965096.785661:0:3308:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994fdb05 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965096.785667:0:3308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994fdb05 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783965096.829944:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965096.830353:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715067776 00000100:00100000:2.0:1783965096.830376:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715067776 00000100:00100000:2.0:1783965096.830587:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 96 00000100:00100000:2.0:1783965096.830599:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e543800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9923189b-eb4a-470c-ab45-969435371000+31:10478:x1870622715067776:12345-192.168.204.12@tcp:101:bash.0 00010000:00010000:2.0:1783965096.830634:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783965096.830665:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fa00/0xe782b916994fdb1a lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5f0074 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965096.830835:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e800/0xe782b916994fdb21 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965096.830865:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e800/0xe782b916994fdb21 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965096.831023:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e800/0xe782b916994fdb21 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965096.831046:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f800/0xe782b916994fdb28 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965096.831054:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f800/0xe782b916994fdb28 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965096.831079:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f800/0xe782b916994fdb28 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783965096.832180:0:5813:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:2.0:1783965096.832649:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8ec00/0xe782b916994fdb2f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965096.832668:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8ec00/0xe782b916994fdb2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965096.832680:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8ec00/0xe782b916994fdb2f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965096.832725:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e800/0xe782b916994fdb21 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965096.832733:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e800/0xe782b916994fdb21 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965096.832740:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e800/0xe782b916994fdb21 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965096.832747:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743fb8e800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1783965096.832752:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e800/0xe782b916994fdb21 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965096.832760:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e800/0xe782b916994fdb21 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965096.832773:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9474186e7a00) 00010000:00010000:2.0:1783965096.832777:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783965096.832793:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e800/0xe782b916994fdb21 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965096.832799:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e800/0xe782b916994fdb21 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783965096.832816:0:5813:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000013d68fc0 reply state 0000000051b5f4cd transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f800/0xe782b916994fdb28 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783965096.832826:0:5813:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1783965096.833192:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fa00/0xe782b916994fdb1a lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0074 expref: 34 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965096.833616:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8ec00/0xe782b916994fdb2f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0074 expref: 33 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965096.833626:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff947402a2d900) 00010000:00010000:2.0:1783965096.833629:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783965096.833631:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94743fb8ec00, rc 0) 00000100:00100000:2.0:1783965096.833733:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e543800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9923189b-eb4a-470c-ab45-969435371000+34:10478:x1870622715067776:12345-192.168.204.12@tcp:101:bash.0 Request processed in 3135us (3802us total) trans 4294967376 rc 0/0 00000100:00100000:2.0:1783965096.833744:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 96 00010000:00010000:2.0:1783965096.835767:0:3309:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f800/0xe782b916994fdb28 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965096.835786:0:3309:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f800/0xe782b916994fdb28 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965096.835793:0:3309:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f800/0xe782b916994fdb28 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965096.835819:0:3309:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743fb8f800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1783965096.835824:0:3309:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f800/0xe782b916994fdb28 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965096.835831:0:3309:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f800/0xe782b916994fdb28 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965096.835864:0:3309:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff947402a2d300) 00010000:00010000:2.0:1783965096.835867:0:3309:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783965096.835872:0:3309:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f800/0xe782b916994fdb28 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965096.835878:0:3309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f800/0xe782b916994fdb28 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783965096.838535:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965096.838831:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715067904 00000100:00100000:1.0:1783965096.838855:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715067904 00000100:00100000:1.0:1783965096.839177:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 35 00000100:00100000:1.0:1783965096.839190:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e542a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9923189b-eb4a-470c-ab45-969435371000+5:2360:x1870622715067904:12345-192.168.204.12@tcp:101:bash.0 00000100:00080000:0.0:1783965096.839393:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1783965096.839399:0:6608:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783965096.839489:0:6608:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000047c71529/0xe782b916994fdb3d lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5f007b expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783965096.839528:0:6608:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783965096.839581:0:6608:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=331s v=(0 0) 00010000:00010000:1.0:1783965096.839586:0:6608:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783965096.839599:0:6608:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000047c71529/0xe782b916994fdb3d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f007b expref: 6 pid: 6608 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965096.839624:0:6608:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000047c71529/0xe782b916994fdb3d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f007b expref: 6 pid: 6608 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965096.839640:0:6608:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94743d9efa00, rc 0) 00000100:00100000:1.0:1783965096.839730:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e542a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9923189b-eb4a-470c-ab45-969435371000+6:2360:x1870622715067904:12345-192.168.204.12@tcp:101:bash.0 Request processed in 543us (1209us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965096.839739:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 35 00000100:00100000:1.0:1783965096.855455:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965096.855562:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715068032 00000100:00100000:3.0:1783965096.855577:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715068032 00000100:00100000:3.0:1783965096.855656:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 36 00000100:00100000:3.0:1783965096.855669:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947437071500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9923189b-eb4a-470c-ab45-969435371000+6:10478:x1870622715068032:12345-192.168.204.12@tcp:101:bash.0 00010000:00010000:3.0:1783965096.855695:0:6606:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783965096.855722:0:6606:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004e5086dd/0xe782b916994fdb44 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5f0082 expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965096.855766:0:6606:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000047c71529/0xe782b916994fdb3d lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f007b expref: 7 pid: 6608 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965096.855800:0:6606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783965096.855806:0:6606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783965096.855813:0:6606:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004e5086dd/0xe782b916994fdb44 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0082 expref: 7 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965096.855875:0:6606:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000047c71529/0xe782b916994fdb3d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f007b expref: 7 pid: 6608 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965096.855892:0:6606:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000047c71529/0xe782b916994fdb3d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f007b expref: 7 pid: 6608 timeout: 431 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783965096.855910:0:6606:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947436e77b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6606:1870622732910720:192.168.204.12@tcp:104: 00000100:00100000:3.0:1783965096.856101:0:6606:0:(client.c:2702:ptlrpc_set_wait()) set ffff9474057dd3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783965096.865059:0:6606:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947436e77b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6606:1870622732910720:192.168.204.12@tcp:104: 00010000:00010000:3.0:1783965096.865114:0:6606:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000004e5086dd/0xe782b916994fdb44 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0082 expref: 7 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965096.865142:0:6606:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff947436f27c00, rc 0) 00000100:00100000:3.0:1783965096.865401:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947437071500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9923189b-eb4a-470c-ab45-969435371000+7:10478:x1870622715068032:12345-192.168.204.12@tcp:101:bash.0 Request processed in 9732us (9961us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965096.865412:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 36 00000100:00100000:1.0:1783965096.867728:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965096.867843:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715068160 00000100:00100000:2.0:1783965096.867865:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715068160 00010000:00010000:2.0:1783965096.867932:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000047c71529/0xe782b916994fdb3d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f007b expref: 7 pid: 6608 timeout: 431 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783965096.867986:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 49 00000100:00100000:2.0:1783965096.867999:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94741843f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9923189b-eb4a-470c-ab45-969435371000+7:2360:x1870622715068160:12345-192.168.204.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783965096.868018:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783965096.868051:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000047c71529/0xe782b916994fdb3d lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f007b expref: 7 pid: 6608 timeout: 431 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965096.868067:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000047c71529/0xe782b916994fdb3d lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f007b expref: 7 pid: 6608 timeout: 431 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965096.868119:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000047c71529/0xe782b916994fdb3d lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f007b expref: 7 pid: 6608 timeout: 431 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965096.868152:0:5797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783965096.868159:0:5797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783965096.868169:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000004e5086dd/0xe782b916994fdb44 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0082 expref: 6 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965096.868181:0:5797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004e5086dd/0xe782b916994fdb44 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0082 expref: 6 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965096.868301:0:5797:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000004e5086dd/0xe782b916994fdb44 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0082 expref: 6 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783965096.868320:0:5797:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e2a4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5797:1870622732910848:192.168.204.12@tcp:105: 00000100:00100000:2.0:1783965096.868437:0:5797:0:(client.c:2702:ptlrpc_set_wait()) set ffff9474259eecc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783965096.875285:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965096.875722:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715068416 00000100:00100000:3.0:1783965096.875737:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715068416 00000100:00100000:3.0:1783965096.875810:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 25 00000100:00100000:3.0:1783965096.875841:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947437071180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9923189b-eb4a-470c-ab45-969435371000+33:10478:x1870622715068416:12345-192.168.204.12@tcp:35:bash.0 00000100:00100000:3.0:1783965096.877011:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947437071180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9923189b-eb4a-470c-ab45-969435371000+34:10478:x1870622715068416:12345-192.168.204.12@tcp:35:bash.0 Request processed in 1165us (1733us total) trans 4294967377 rc 0/0 00000100:00100000:3.0:1783965096.877023:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 25 00000100:00100000:2.0:1783965096.877211:0:5797:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e2a4000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5797:1870622732910848:192.168.204.12@tcp:105: 00010000:00010000:2.0:1783965096.877244:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783965096.877286:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94741843f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9923189b-eb4a-470c-ab45-969435371000+6:2360:x1870622715068160:12345-192.168.204.12@tcp:103:ldlm_bl.0 Request processed in 9289us (9573us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965096.877296:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 49 00000100:00100000:1.0:1783965097.010931:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783965097.013082:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715068544 00000100:00100000:0.0:1783965097.013099:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715068544 00000100:00100000:1.0:1783965097.013519:0:6632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 97 00000100:00100000:1.0:1783965097.013533:0:6632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947437073100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9923189b-eb4a-470c-ab45-969435371000+34:10495:x1870622715068544:12345-192.168.204.12@tcp:101:lfs.0 00010000:00010000:1.0:1783965097.013562:0:6632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783965097.013586:0:6632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efe00/0xe782b916994fdb4b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5f0089 expref: -99 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.013664:0:6632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee400/0xe782b916994fdb52 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.013675:0:6632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee400/0xe782b916994fdb52 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.013692:0:6632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee400/0xe782b916994fdb52 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783965097.013745:0:6632:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:1.0:1783965097.013748:0:6632:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1783965097.013763:0:6632:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee400/0xe782b916994fdb52 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.013782:0:6632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efe00/0xe782b916994fdb4b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0089 expref: 36 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.013802:0:6632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee400/0xe782b916994fdb52 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0089 expref: 35 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.013808:0:6632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9474186e7a00) 00010000:00010000:1.0:1783965097.013810:0:6632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783965097.013813:0:6632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94743d9ee400, rc 0) 00000100:00100000:1.0:1783965097.013900:0:6632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947437073100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9923189b-eb4a-470c-ab45-969435371000+35:10495:x1870622715068544:12345-192.168.204.12@tcp:101:lfs.0 Request processed in 370us (2984us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965097.013908:0:6632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 97 00000100:00100000:1.0:1783965097.023908:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965097.024809:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715068800 00000100:00100000:2.0:1783965097.024822:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715068800 00000100:00100000:2.0:1783965097.024901:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 98 00000100:00100000:2.0:1783965097.024923:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947437071880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9923189b-eb4a-470c-ab45-969435371000+35:10495:x1870622715068800:12345-192.168.204.12@tcp:101:lfs.0 00010000:00010000:2.0:1783965097.024946:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783965097.024970:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f800/0xe782b916994fdb59 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5f0090 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965097.025097:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fa00/0xe782b916994fdb60 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965097.025509:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fa00/0xe782b916994fdb60 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965097.025523:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fa00/0xe782b916994fdb60 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783965097.025537:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1783965097.025692:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f800/0xe782b916994fdb59 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0090 expref: 38 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965097.025713:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fa00/0xe782b916994fdb60 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0090 expref: 37 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965097.025723:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff947402a2d900) 00010000:00010000:2.0:1783965097.025725:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783965097.025729:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94743fb8fa00, rc 0) 00000100:00100000:2.0:1783965097.025910:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947437071880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9923189b-eb4a-470c-ab45-969435371000+37:10495:x1870622715068800:12345-192.168.204.12@tcp:101:lfs.0 Request processed in 988us (2013us total) trans 4294967378 rc 0/0 00000100:00100000:2.0:1783965097.025919:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 98 00000100:00100000:0.0:1783965097.030761:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783965097.030877:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965097.030977:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715069056 00000100:00100000:2.0:1783965097.030988:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715069056 00000100:00100000:2.0:1783965097.031074:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 99 00000100:00100000:2.0:1783965097.031085:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e543b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9923189b-eb4a-470c-ab45-969435371000+37:10495:x1870622715069056:12345-192.168.204.12@tcp:101:lfs.0 00000100:00100000:3.0:1783965097.031159:0:8330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715069184 00000100:00100000:3.0:1783965097.031177:0:8330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715069184 00000100:00100000:3.0:1783965097.031403:0:8330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 6 00000100:00100000:3.0:1783965097.031614:0:8330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e541f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9923189b-eb4a-470c-ab45-969435371000+38:2358:x1870622715069184:12345-192.168.204.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783965097.031636:0:8330:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783965097.031674:0:8330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fa00/0xe782b916994fdb60 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0090 expref: 38 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965097.031707:0:8330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff947402a2d900) 00010000:00010000:2.0:1783965097.031707:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783965097.031717:0:8330:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783965097.031733:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e800/0xe782b916994fdb6e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5f0097 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783965097.031807:0:8330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e541f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9923189b-eb4a-470c-ab45-969435371000+38:2358:x1870622715069184:12345-192.168.204.12@tcp:103:ldlm_bl.0 Request processed in 198us (935us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965097.031819:0:8330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 6 00010000:00010000:2.0:1783965097.031828:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e400/0xe782b916994fdb75 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965097.032397:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e400/0xe782b916994fdb75 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965097.032415:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e400/0xe782b916994fdb75 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783965097.032435:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1783965097.032733:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e800/0xe782b916994fdb6e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0097 expref: 39 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965097.032754:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e400/0xe782b916994fdb75 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0097 expref: 38 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965097.032763:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff947402a2d900) 00010000:00010000:2.0:1783965097.032767:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1783965097.032771:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94743fb8e400, rc 0) 00000100:00100000:2.0:1783965097.033045:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e543b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9923189b-eb4a-470c-ab45-969435371000+38:10495:x1870622715069056:12345-192.168.204.12@tcp:101:lfs.0 Request processed in 1959us (2293us total) trans 4294967379 rc 0/0 00000100:00100000:2.0:1783965097.033054:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 99 00000100:00100000:0.0:1783965097.043802:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965097.044581:0:8738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715069312 00000100:00100000:3.0:1783965097.044601:0:8738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715069312 00000100:00100000:0.0:1783965097.045286:0:8738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 37 00000100:00100000:0.0:1783965097.045303:0:8738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e613800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9923189b-eb4a-470c-ab45-969435371000+6:2360:x1870622715069312:12345-192.168.204.12@tcp:1:lfs.0 00010000:00010000:0.0:1783965097.045359:0:8738:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000040f2f922/0xe782b916994fdb83 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965097.045383:0:8738:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000004e5086dd/0xe782b916994fdb44 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0082 expref: 6 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965097.045392:0:8738:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783965097.045409:0:8738:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783965097.045414:0:8738:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000040f2f922/0xe782b916994fdb83 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965097.045453:0:8738:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000004e5086dd/0xe782b916994fdb44 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0082 expref: 6 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965097.045467:0:8738:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000004e5086dd/0xe782b916994fdb44 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0082 expref: 6 pid: 6606 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783965097.045483:0:8738:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e612680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8738:1870622732910976:192.168.204.12@tcp:104: 00000100:00100000:0.0:1783965097.045584:0:8738:0:(client.c:2702:ptlrpc_set_wait()) set ffff947429f80b40 going to sleep for 11 seconds 00000100:00100000:0.0:1783965097.053017:0:8738:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e612680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8738:1870622732910976:192.168.204.12@tcp:104: 00010000:00010000:0.0:1783965097.053046:0:8738:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000040f2f922/0xe782b916994fdb83 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783965097.056714:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965097.056930:0:6613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715069440 00000100:00100000:2.0:1783965097.056968:0:6613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715069440 00002000:00100000:2.0:1783965097.057046:0:6613:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff94743e612680 x1870622715069440/t0(0) o4->9923189b-eb4a-470c-ab45-969435371000@192.168.204.12@tcp:523/0 lens 504/0 e 0 to 0 dl 1783965108 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783965097.057060:0:6613:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff94743e612680 with x1870622715069440 ext(0->8) 00010000:00010000:2.0:1783965097.057073:0:6613:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000004e5086dd/0xe782b916994fdb44 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0082 expref: 7 pid: 6606 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965097.057095:0:6613:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000004e5086dd/0xe782b916994fdb44 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0082 expref: 7 pid: 6606 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783965097.057106:0:6613:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff94743e612680 00000100:00100000:2.0:1783965097.057151:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 1 00000100:00100000:2.0:1783965097.057164:0:6613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e612680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9923189b-eb4a-470c-ab45-969435371000+7:2359:x1870622715069440:12345-192.168.204.12@tcp:4:lfs.0 00000100:00100000:2.0:1783965097.057879:0:6613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e612680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9923189b-eb4a-470c-ab45-969435371000+9:2359:x1870622715069440:12345-192.168.204.12@tcp:4:lfs.0 Request processed in 713us (1180us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1783965097.057890:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 1 00002000:00100000:2.0:1783965097.057900:0:6613:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff94743e612680 x1870622715069440/t4294967302(0) o4->9923189b-eb4a-470c-ab45-969435371000@192.168.204.12@tcp:523/0 lens 504/448 e 0 to 0 dl 1783965108 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783965097.057910:0:6613:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff94743e612680 with x1870622715069440 ext(0->8) 00010000:00010000:2.0:1783965097.057919:0:6613:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000004e5086dd/0xe782b916994fdb44 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0082 expref: 9 pid: 6606 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965097.057934:0:6613:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000004e5086dd/0xe782b916994fdb44 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0082 expref: 9 pid: 6606 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783965097.057942:0:6613:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff94743e612680 00000100:00100000:1.0:1783965097.061174:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783965097.062778:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715069568 00000100:00100000:0.0:1783965097.062802:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715069568 00010000:00010000:0.0:1783965097.062887:0:5798:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000004e5086dd/0xe782b916994fdb44 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0082 expref: 9 pid: 6606 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783965097.062936:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 50 00000100:00100000:0.0:1783965097.062948:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947437070700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9923189b-eb4a-470c-ab45-969435371000+9:2360:x1870622715069568:12345-192.168.204.12@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783965097.062971:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1783965097.062997:0:5798:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1783965097.063018:0:5798:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1783965096 00002000:00010000:0.0:1783965097.063020:0:5798:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1783965096 00002000:00010000:0.0:1783965097.063022:0:5798:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1783965096 00010000:00010000:0.0:1783965097.063029:0:5798:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000004e5086dd/0xe782b916994fdb44 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0082 expref: 9 pid: 6606 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965097.063046:0:5798:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000004e5086dd/0xe782b916994fdb44 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0082 expref: 9 pid: 6606 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965097.063076:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004e5086dd/0xe782b916994fdb44 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0082 expref: 9 pid: 6606 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965097.063099:0:5798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783965097.063104:0:5798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783965097.063112:0:5798:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000040f2f922/0xe782b916994fdb83 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965097.063124:0:5798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000040f2f922/0xe782b916994fdb83 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965097.063172:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783965097.063536:0:8738:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000040f2f922/0xe782b916994fdb83 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.063549:0:8738:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000040f2f922/0xe782b916994fdb83 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.063597:0:8738:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000040f2f922/0xe782b916994fdb83 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.063607:0:8738:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000040f2f922/0xe782b916994fdb83 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.063616:0:8738:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000040f2f922/0xe782b916994fdb83 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.063625:0:8738:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947430c11400 already unused, calling callback (ffffffffc168d230) 00010000:00010000:1.0:1783965097.063630:0:8738:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000040f2f922/0xe782b916994fdb83 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.063641:0:8738:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000040f2f922/0xe782b916994fdb83 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.063655:0:8738:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000040f2f922/0xe782b916994fdb83 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.063665:0:8738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000040f2f922/0xe782b916994fdb83 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783965097.064658:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947437070700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9923189b-eb4a-470c-ab45-969435371000+8:2360:x1870622715069568:12345-192.168.204.12@tcp:103:ldlm_bl.0 Request processed in 1697us (3486us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965097.064674:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 50 00000100:00100000:1.0:1783965097.064798:0:8738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e613800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9923189b-eb4a-470c-ab45-969435371000+7:2360:x1870622715069312:12345-192.168.204.12@tcp:1:lfs.0 Request processed in 19500us (21005us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965097.064808:0:8738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 37 00000100:00100000:1.0:1783965097.070701:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783965097.070850:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715069824 00000100:00100000:0.0:1783965097.070866:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715069824 00000100:00100000:0.0:1783965097.070988:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 26 00000100:00100000:0.0:1783965097.071001:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94740638b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9923189b-eb4a-470c-ab45-969435371000+38:10495:x1870622715069824:12345-192.168.204.12@tcp:35:lfs.0 00000004:00010000:0.0:1783965097.071113:0:5815:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e400/0xe782b916994fdb75 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0097 expref: 38 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783965097.071536:0:5815:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:0.0:1783965097.071588:0:5815:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:0.0:1783965097.072002:0:5815:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:0.0:1783965097.072068:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff947430c10e00/0xe782b916994fdb8a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965097.072086:0:5815:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8ec00/0xe782b916994fdb2f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0074 expref: 42 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965097.072098:0:5815:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff947430c10e00/0xe782b916994fdb8a lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965097.072145:0:5815:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8ec00/0xe782b916994fdb2f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0074 expref: 42 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965097.072163:0:5815:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8ec00/0xe782b916994fdb2f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0074 expref: 42 pid: 5813 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783965097.072181:0:5815:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947407297100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5815:1870622732911104:192.168.204.12@tcp:104: 00000100:00100000:0.0:1783965097.072321:0:5815:0:(client.c:2702:ptlrpc_set_wait()) set ffff947429f80180 going to sleep for 11 seconds 00000100:00100000:3.0:1783965097.078836:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965097.079000:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715069952 00000100:00100000:1.0:1783965097.079014:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715069952 00010000:00010000:1.0:1783965097.079073:0:5799:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8ec00/0xe782b916994fdb2f lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0074 expref: 43 pid: 5813 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783965097.079138:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 51 00000100:00100000:1.0:1783965097.079150:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436e77b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9923189b-eb4a-470c-ab45-969435371000+43:2359:x1870622715069952:12345-192.168.204.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783965097.079173:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783965097.079182:0:5799:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8ec00/0xe782b916994fdb2f lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0074 expref: 43 pid: 5813 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.079232:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8ec00/0xe782b916994fdb2f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0074 expref: 43 pid: 5813 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.079268:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff947402a2d900) 00010000:00010000:1.0:1783965097.079275:0:5799:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff947430c10e00/0xe782b916994fdb8a lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.079288:0:5799:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff947430c10e00/0xe782b916994fdb8a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.079297:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947430c10e00/0xe782b916994fdb8a lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.079323:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783965097.079394:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436e77b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9923189b-eb4a-470c-ab45-969435371000+43:2359:x1870622715069952:12345-192.168.204.12@tcp:103:ldlm_bl.0 Request processed in 246us (583us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965097.079403:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 51 00010000:00010000:0.0:1783965097.081811:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8ec00/0xe782b916994fdb2f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0074 expref: 42 pid: 5813 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783965097.081864:0:5815:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947407297100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5815:1870622732911104:192.168.204.12@tcp:104: 00010000:00010000:0.0:1783965097.081898:0:5815:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff947430c10e00/0xe782b916994fdb8a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965097.081932:0:5815:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff947430c10e00/0xe782b916994fdb8a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965097.081939:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947430c10e00/0xe782b916994fdb8a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783965097.082349:0:5815:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:0.0:1783965097.082655:0:5815:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:0.0:1783965097.082800:0:5815:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947407297100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5815:1870622732911232:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1783965097.082897:0:5815:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783965097.082942:0:5815:0:(client.c:2702:ptlrpc_set_wait()) set ffff94741cede6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783965097.083088:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732911232 00000100:00100000:3.0:1783965097.083105:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732911232 00000100:00100000:3.0:1783965097.083168:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783965097.083179:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947429f47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5815:x1870622732911232:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1783965097.083323:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947429f47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5815:x1870622732911232:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 146us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965097.083342:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783965097.083700:0:5815:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947407297100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5815:1870622732911232:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1783965097.084461:0:5815:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:1.0:1783965097.084553:0:5815:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947437073b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5815:1870622732911360:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1783965097.084606:0:5815:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783965097.084632:0:5815:0:(client.c:2702:ptlrpc_set_wait()) set ffff94743709ef00 going to sleep for 11 seconds 00000100:00100000:3.0:1783965097.084782:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732911360 00000100:00100000:3.0:1783965097.084790:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732911360 00000100:00100000:3.0:1783965097.084836:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783965097.084855:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947437071c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5815:x1870622732911360:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1783965097.085055:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947437071c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5815:x1870622732911360:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 211us (448us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1783965097.085063:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783965097.085251:0:5815:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947437073b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5815:1870622732911360:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1783965097.085469:0:5815:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:1.0:1783965097.085523:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff947430c10e00/0xe782b916994fdb8a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.085536:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff947430c10e00/0xe782b916994fdb8a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.085545:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff947430c10e00/0xe782b916994fdb8a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.085552:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947430c10e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1783965097.085558:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947430c10e00/0xe782b916994fdb8a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.085566:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947430c10e00/0xe782b916994fdb8a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.085602:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff947402a2d900) 00010000:00010000:1.0:1783965097.085605:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1783965097.085610:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff947430c10e00/0xe782b916994fdb8a lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.085617:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947430c10e00/0xe782b916994fdb8a lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783965097.085875:0:5815:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1783965097.086034:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:1.0:1783965097.086049:0:5815:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 331314847003ns, next at 332314844314ns, rc = 0 00000001:00080000:1.0:1783965097.086056:0:5815:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:1.0:1783965097.086724:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff947402a2d900) 00010000:00010000:1.0:1783965097.086732:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1783965097.086744:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e400/0xe782b916994fdb75 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0097 expref: 46 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783965097.086974:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94740638b450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9923189b-eb4a-470c-ab45-969435371000+45:10495:x1870622715069824:12345-192.168.204.12@tcp:35:lfs.0 Request processed in 15974us (16287us total) trans 4294967388 rc 0/0 00000100:00100000:1.0:1783965097.086986:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 26 00000020:00080000:1.0:1783965097.086992:0:5815:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1783965097.090636:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783965097.091965:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715070080 00000100:00100000:0.0:1783965097.091985:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715070080 00000100:00100000:0.0:1783965097.092067:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 100 00000100:00100000:0.0:1783965097.092079:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436e75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9923189b-eb4a-470c-ab45-969435371000+45:10495:x1870622715070080:12345-192.168.204.12@tcp:101:lfs.0 00010000:00010000:0.0:1783965097.092111:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783965097.092143:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947430c10a00/0xe782b916994fdb91 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5f009e expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965097.092355:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947430c10a00/0xe782b916994fdb91 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f009e expref: 46 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965097.092432:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff947430c10a00/0xe782b916994fdb91 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f009e expref: 46 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965097.092517:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94740a90c900) 00010000:00010000:0.0:1783965097.092521:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1783965097.092541:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff947430c10a00, rc 0) 00000100:00100000:0.0:1783965097.092609:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436e75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9923189b-eb4a-470c-ab45-969435371000+46:10495:x1870622715070080:12345-192.168.204.12@tcp:101:lfs.0 Request processed in 531us (1987us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965097.092617:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 100 00000100:00100000:2.0:1783965097.095679:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965097.095956:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715070336 00000100:00100000:3.0:1783965097.095969:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715070336 00000100:00100000:3.0:1783965097.096038:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 27 00000100:00100000:3.0:1783965097.096050:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e2a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9923189b-eb4a-470c-ab45-969435371000+46:10495:x1870622715070336:12345-192.168.204.12@tcp:35:lfs.0 00000100:00100000:0.0:1783965097.096852:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e2a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9923189b-eb4a-470c-ab45-969435371000+47:10495:x1870622715070336:12345-192.168.204.12@tcp:35:lfs.0 Request processed in 792us (1176us total) trans 4294967389 rc 0/0 00000100:00100000:0.0:1783965097.096867:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 27 00000100:00100000:2.0:1783965097.171868:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965097.172338:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715070464 00000100:00100000:1.0:1783965097.172352:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715070464 00000100:00100000:1.0:1783965097.172434:0:6632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 101 00000100:00100000:1.0:1783965097.172446:0:6632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e2a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9923189b-eb4a-470c-ab45-969435371000+47:10505:x1870622715070464:12345-192.168.204.12@tcp:34:lfs.0 00010000:00010000:1.0:1783965097.172560:0:6632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eee00/0xe782b916994fdb98 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.172582:0:6632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eee00/0xe782b916994fdb98 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.172598:0:6632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eee00/0xe782b916994fdb98 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.172690:0:6632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee000/0xe782b916994fdb9f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.172725:0:6632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee000/0xe782b916994fdb9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.172734:0:6632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee000/0xe782b916994fdb9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.172889:0:6632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eec00/0xe782b916994fdba6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.172898:0:6632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eec00/0xe782b916994fdba6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.172905:0:6632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eec00/0xe782b916994fdba6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783965097.173029:0:6632:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eec00/0xe782b916994fdba6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.173044:0:6632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eee00/0xe782b916994fdb98 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.173051:0:6632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eee00/0xe782b916994fdb98 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.173059:0:6632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eee00/0xe782b916994fdb98 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.173066:0:6632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743d9eee00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1783965097.173071:0:6632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eee00/0xe782b916994fdb98 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.173080:0:6632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eee00/0xe782b916994fdb98 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.173102:0:6632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9474186e7a00) 00010000:00010000:1.0:1783965097.173105:0:6632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783965097.173111:0:6632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eee00/0xe782b916994fdb98 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.173117:0:6632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eee00/0xe782b916994fdb98 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.173142:0:6632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee000/0xe782b916994fdb9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.173150:0:6632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee000/0xe782b916994fdb9f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.173156:0:6632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee000/0xe782b916994fdb9f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.173161:0:6632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743d9ee000 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1783965097.173164:0:6632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee000/0xe782b916994fdb9f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.173170:0:6632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee000/0xe782b916994fdb9f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.173177:0:6632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff947407b5c500) 00010000:00010000:1.0:1783965097.173179:0:6632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783965097.173182:0:6632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee000/0xe782b916994fdb9f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.173189:0:6632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee000/0xe782b916994fdb9f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.174518:0:6632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eec00/0xe782b916994fdba6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.174528:0:6632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eec00/0xe782b916994fdba6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.174536:0:6632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eec00/0xe782b916994fdba6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.174541:0:6632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743d9eec00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1783965097.174545:0:6632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eec00/0xe782b916994fdba6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.174553:0:6632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eec00/0xe782b916994fdba6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.174568:0:6632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94740a90c900) 00010000:00010000:1.0:1783965097.174571:0:6632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783965097.174575:0:6632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eec00/0xe782b916994fdba6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.174582:0:6632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eec00/0xe782b916994fdba6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783965097.174807:0:6632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e2a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9923189b-eb4a-470c-ab45-969435371000+47:10505:x1870622715070464:12345-192.168.204.12@tcp:34:lfs.0 Request processed in 2355us (2958us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965097.174819:0:6632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 101 00000100:00100000:0.0:1783965097.225382:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965097.225554:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715070720 00000100:00100000:2.0:1783965097.225567:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715070720 00000100:00100000:2.0:1783965097.225710:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 102 00000100:00100000:2.0:1783965097.225723:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9474072a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9923189b-eb4a-470c-ab45-969435371000+47:10508:x1870622715070720:12345-192.168.204.12@tcp:101:lfs.0 00010000:00010000:2.0:1783965097.225750:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783965097.225778:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f800/0xe782b916994fdbad lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5f00a5 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965097.225880:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fa00/0xe782b916994fdbb4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965097.225898:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fa00/0xe782b916994fdbb4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965097.225912:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fa00/0xe782b916994fdbb4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965097.225929:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f600/0xe782b916994fdbbb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965097.225936:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f600/0xe782b916994fdbbb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965097.225943:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f600/0xe782b916994fdbbb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965097.226099:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fc00/0xe782b916994fdbc2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965097.226108:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fc00/0xe782b916994fdbc2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965097.226134:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fc00/0xe782b916994fdbc2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783965097.226146:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1783965097.228077:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fa00/0xe782b916994fdbb4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965097.228098:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fa00/0xe782b916994fdbb4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965097.228107:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fa00/0xe782b916994fdbb4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965097.228113:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743fb8fa00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1783965097.228119:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fa00/0xe782b916994fdbb4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965097.228128:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fa00/0xe782b916994fdbb4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965097.228149:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9474186e7a00) 00010000:00010000:2.0:1783965097.228153:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783965097.228160:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fa00/0xe782b916994fdbb4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965097.228167:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fa00/0xe782b916994fdbb4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965097.228190:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f600/0xe782b916994fdbbb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965097.228196:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f600/0xe782b916994fdbbb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965097.228754:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f600/0xe782b916994fdbbb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965097.228761:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743fb8f600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1783965097.228764:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f600/0xe782b916994fdbbb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965097.228771:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f600/0xe782b916994fdbbb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965097.228780:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff947402a2d300) 00010000:00010000:2.0:1783965097.228783:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783965097.228786:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f600/0xe782b916994fdbbb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965097.228793:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f600/0xe782b916994fdbbb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965097.228874:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f800/0xe782b916994fdbad lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f00a5 expref: 50 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965097.228891:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fc00/0xe782b916994fdbc2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f00a5 expref: 49 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965097.228900:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94740a90c900) 00010000:00010000:2.0:1783965097.228902:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783965097.228905:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94743fb8fc00, rc 0) 00000100:00100000:2.0:1783965097.229032:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9474072a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9923189b-eb4a-470c-ab45-969435371000+49:10508:x1870622715070720:12345-192.168.204.12@tcp:101:lfs.0 Request processed in 3310us (3662us total) trans 4294967390 rc 0/0 00000100:00100000:2.0:1783965097.229050:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 102 00000100:00100000:3.0:1783965097.237922:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965097.238381:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715070848 00000100:00100000:2.0:1783965097.238395:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715070848 00000100:00100000:2.0:1783965097.238472:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 103 00000100:00100000:2.0:1783965097.238485:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436e75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9923189b-eb4a-470c-ab45-969435371000+49:10508:x1870622715070848:12345-192.168.204.12@tcp:54:lfs.0 00010000:00010000:2.0:1783965097.238579:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f800/0xe782b916994fdbd0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965097.238602:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f800/0xe782b916994fdbd0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965097.238616:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f800/0xe782b916994fdbd0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965097.238650:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f800/0xe782b916994fdbd0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965097.238658:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f800/0xe782b916994fdbd0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965097.238665:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f800/0xe782b916994fdbd0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965097.238671:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743fb8f800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1783965097.238676:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f800/0xe782b916994fdbd0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965097.238683:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f800/0xe782b916994fdbd0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965097.238697:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94740a90c900) 00010000:00010000:2.0:1783965097.238719:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783965097.238726:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f800/0xe782b916994fdbd0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965097.238734:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f800/0xe782b916994fdbd0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783965097.238834:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436e75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9923189b-eb4a-470c-ab45-969435371000+49:10508:x1870622715070848:12345-192.168.204.12@tcp:54:lfs.0 Request processed in 351us (926us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965097.238851:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 103 00000100:00100000:1.0:1783965097.246763:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783965097.246899:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715071104 00000100:00100000:0.0:1783965097.246912:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715071104 00000100:00100000:0.0:1783965097.246996:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 28 00000100:00100000:0.0:1783965097.247008:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947437071180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9923189b-eb4a-470c-ab45-969435371000+49:10508:x1870622715071104:12345-192.168.204.12@tcp:35:lfs.0 00000100:00100000:0.0:1783965097.247726:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947437071180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9923189b-eb4a-470c-ab45-969435371000+50:10508:x1870622715071104:12345-192.168.204.12@tcp:35:lfs.0 Request processed in 715us (974us total) trans 4294967391 rc 0/0 00000100:00100000:0.0:1783965097.247736:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 28 00000100:00100000:0.0:1783965097.326536:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965097.326671:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715071360 00000100:00100000:2.0:1783965097.326683:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715071360 00000100:00100000:2.0:1783965097.326759:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 104 00000100:00100000:2.0:1783965097.326771:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9474072a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9923189b-eb4a-470c-ab45-969435371000+50:10518:x1870622715071360:12345-192.168.204.12@tcp:101:bash.0 00010000:00010000:2.0:1783965097.326805:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783965097.326809:0:5813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1783965097.326857:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee400/0xe782b916994fdb52 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0089 expref: 50 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965097.326888:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9474186e7a00) 00010000:00010000:2.0:1783965097.326893:0:5813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783965097.326911:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f800/0xe782b916994fdbd7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5f00ac expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965097.327051:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f600/0xe782b916994fdbde lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965097.327067:0:5813:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fc00/0xe782b916994fdbc2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f00a5 expref: 50 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965097.327101:0:5813:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f600/0xe782b916994fdbde lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965097.327140:0:5813:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fc00/0xe782b916994fdbc2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f00a5 expref: 50 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965097.327155:0:5813:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fc00/0xe782b916994fdbc2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f00a5 expref: 50 pid: 5812 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783965097.327172:0:5813:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e2a6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5813:1870622732911488:192.168.204.12@tcp:104: 00000100:00100000:2.0:1783965097.327771:0:5813:0:(client.c:2702:ptlrpc_set_wait()) set ffff947429f840c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783965097.334316:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965097.334667:0:5813:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e2a6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5813:1870622732911488:192.168.204.12@tcp:104: 00010000:00010000:2.0:1783965097.334702:0:5813:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f600/0xe782b916994fdbde lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783965097.334794:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715071488 00000100:00100000:0.0:1783965097.334804:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715071488 00010000:00010000:0.0:1783965097.334875:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fc00/0xe782b916994fdbc2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f00a5 expref: 51 pid: 5812 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783965097.334920:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 52 00000100:00100000:0.0:1783965097.334930:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436e77100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9923189b-eb4a-470c-ab45-969435371000+51:2359:x1870622715071488:12345-192.168.204.12@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783965097.334950:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783965097.334958:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fc00/0xe782b916994fdbc2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f00a5 expref: 51 pid: 5812 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965097.335005:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fc00/0xe782b916994fdbc2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f00a5 expref: 51 pid: 5812 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965097.335033:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fc00/0xe782b916994fdbc2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f00a5 expref: 51 pid: 5812 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965097.335052:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94740a90c900) 00010000:00010000:0.0:1783965097.335057:0:5797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f600/0xe782b916994fdbde lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965097.335069:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f600/0xe782b916994fdbde lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965097.335078:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f600/0xe782b916994fdbde lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965097.335111:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783965097.335186:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436e77100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9923189b-eb4a-470c-ab45-969435371000+50:2359:x1870622715071488:12345-192.168.204.12@tcp:103:ldlm_bl.0 Request processed in 256us (885us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965097.335195:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 52 00010000:00010000:3.0:1783965097.335905:0:5813:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f600/0xe782b916994fdbde lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965097.335919:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f600/0xe782b916994fdbde lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783965097.335948:0:5813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1783965097.336165:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f800/0xe782b916994fdbd7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f00ac expref: 51 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965097.336188:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f600/0xe782b916994fdbde lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f00ac expref: 50 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965097.336763:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94740a90c900) 00010000:00010000:3.0:1783965097.336768:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1783965097.336772:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94743fb8f600, rc 0) 00000100:00100000:3.0:1783965097.337047:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9474072a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9923189b-eb4a-470c-ab45-969435371000+50:10518:x1870622715071360:12345-192.168.204.12@tcp:101:bash.0 Request processed in 10275us (10523us total) trans 4294967392 rc 0/0 00000100:00100000:3.0:1783965097.337058:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 104 00000100:00100000:2.0:1783965097.344689:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783965097.350951:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715071744 00000100:00100000:0.0:1783965097.351097:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715071744 00000100:00100000:1.0:1783965097.351652:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 105 00000100:00100000:1.0:1783965097.351666:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e2a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9923189b-eb4a-470c-ab45-969435371000+50:10518:x1870622715071744:12345-192.168.204.12@tcp:36:bash.0 00010000:00010000:1.0:1783965097.352096:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efe00/0xe782b916994fdbec lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.352120:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efe00/0xe782b916994fdbec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.352135:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efe00/0xe782b916994fdbec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783965097.352196:0:5811:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:1.0:1783965097.352266:0:5811:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000921387aa reply state 0000000030431f0e transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efe00/0xe782b916994fdbec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783965097.352277:0:5811:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783965097.352429:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e2a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9923189b-eb4a-470c-ab45-969435371000+53:10518:x1870622715071744:12345-192.168.204.12@tcp:36:bash.0 Request processed in 765us (7752us total) trans 4294967394 rc 0/0 00000100:00100000:1.0:1783965097.352438:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 105 00000020:00080000:1.0:1783965097.352444:0:5811:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1783965097.354751:0:3308:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efe00/0xe782b916994fdbec lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965097.354774:0:3308:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efe00/0xe782b916994fdbec lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965097.354784:0:3308:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efe00/0xe782b916994fdbec lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965097.354791:0:3308:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743d9efe00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1783965097.354797:0:3308:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efe00/0xe782b916994fdbec lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965097.354833:0:3308:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efe00/0xe782b916994fdbec lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965097.354863:0:3308:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94740a90c900) 00010000:00010000:2.0:1783965097.354867:0:3308:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783965097.354873:0:3308:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efe00/0xe782b916994fdbec lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965097.354880:0:3308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efe00/0xe782b916994fdbec lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783965097.357518:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965097.357580:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715071872 00000100:00100000:2.0:1783965097.357594:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715071872 00000100:00100000:2.0:1783965097.357686:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 106 00000100:00100000:2.0:1783965097.357698:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e2a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9923189b-eb4a-470c-ab45-969435371000+52:10518:x1870622715071872:12345-192.168.204.12@tcp:101:bash.0 00010000:00010000:2.0:1783965097.357736:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783965097.357770:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e000/0xe782b916994fdbf3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5f00b3 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965097.357910:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f400/0xe782b916994fdbfa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965097.357930:0:5813:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f600/0xe782b916994fdbde lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f00ac expref: 53 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965097.357940:0:5813:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f400/0xe782b916994fdbfa lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965097.358021:0:5813:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f600/0xe782b916994fdbde lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f00ac expref: 53 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965097.358039:0:5813:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f600/0xe782b916994fdbde lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f00ac expref: 53 pid: 5813 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783965097.358057:0:5813:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e2a4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5813:1870622732911616:192.168.204.12@tcp:104: 00000100:00100000:2.0:1783965097.358157:0:5813:0:(client.c:2702:ptlrpc_set_wait()) set ffff947429f840c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783965097.363582:0:5813:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e2a4a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5813:1870622732911616:192.168.204.12@tcp:104: 00010000:00010000:2.0:1783965097.363627:0:5813:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f400/0xe782b916994fdbfa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783965097.365915:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783965097.368925:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715072000 00000100:00100000:0.0:1783965097.368946:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715072000 00010000:00010000:0.0:1783965097.369022:0:5799:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f600/0xe782b916994fdbde lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f00ac expref: 54 pid: 5813 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783965097.369082:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 53 00000100:00100000:0.0:1783965097.369114:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e2a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9923189b-eb4a-470c-ab45-969435371000+54:2359:x1870622715072000:12345-192.168.204.12@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783965097.369136:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783965097.369145:0:5799:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f600/0xe782b916994fdbde lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f00ac expref: 54 pid: 5813 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965097.369161:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f600/0xe782b916994fdbde lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f00ac expref: 54 pid: 5813 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965097.369191:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f600/0xe782b916994fdbde lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f00ac expref: 54 pid: 5813 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965097.369242:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94740a90c900) 00010000:00010000:0.0:1783965097.369248:0:5799:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f400/0xe782b916994fdbfa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965097.369260:0:5799:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f400/0xe782b916994fdbfa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965097.369270:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f400/0xe782b916994fdbfa lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965097.369304:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783965097.369387:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e2a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9923189b-eb4a-470c-ab45-969435371000+53:2359:x1870622715072000:12345-192.168.204.12@tcp:103:ldlm_bl.0 Request processed in 275us (3485us total) trans 0 rc 0/0 00010000:00010000:2.0:1783965097.369748:0:5813:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f400/0xe782b916994fdbfa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965097.369758:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f400/0xe782b916994fdbfa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783965097.369844:0:5813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1783965097.369850:0:5813:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1783965097.369880:0:5813:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f400/0xe782b916994fdbfa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965097.369921:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e000/0xe782b916994fdbf3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f00b3 expref: 54 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965097.369942:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f400/0xe782b916994fdbfa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f00b3 expref: 53 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965097.369960:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94740a90c900) 00010000:00010000:2.0:1783965097.369963:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783965097.369966:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94743fb8f400, rc 0) 00000100:00100000:2.0:1783965097.370017:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e2a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9923189b-eb4a-470c-ab45-969435371000+53:10518:x1870622715071872:12345-192.168.204.12@tcp:101:bash.0 Request processed in 12321us (12514us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965097.370025:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 106 00000100:00100000:2.0:1783965097.374750:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965097.374937:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715072256 00000100:00100000:3.0:1783965097.374950:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715072256 00000100:00100000:3.0:1783965097.375136:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 29 00000100:00100000:3.0:1783965097.375149:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e2a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9923189b-eb4a-470c-ab45-969435371000+53:10518:x1870622715072256:12345-192.168.204.12@tcp:35:bash.0 00000100:00100000:3.0:1783965097.375533:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e2a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9923189b-eb4a-470c-ab45-969435371000+54:10518:x1870622715072256:12345-192.168.204.12@tcp:35:bash.0 Request processed in 385us (796us total) trans 4294967395 rc 0/0 00000100:00100000:3.0:1783965097.375543:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 29 00000100:00100000:0.0:1783965097.375625:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 53 00000100:00100000:1.0:1783965097.437173:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783965097.437387:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715072384 00000100:00100000:0.0:1783965097.437401:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715072384 00000100:00100000:0.0:1783965097.437470:0:6632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 107 00000100:00100000:0.0:1783965097.437482:0:6632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947437072d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9923189b-eb4a-470c-ab45-969435371000+53:10524:x1870622715072384:12345-192.168.204.12@tcp:101:lfs.0 00010000:00010000:0.0:1783965097.437532:0:6632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783965097.437559:0:6632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947430c11400/0xe782b916994fdc01 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5f00ba expref: -99 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965097.437659:0:6632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff947430c11000/0xe782b916994fdc08 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965097.437677:0:6632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947430c11000/0xe782b916994fdc08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965097.437693:0:6632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947430c11000/0xe782b916994fdc08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783965097.437774:0:6632:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:0.0:1783965097.437779:0:6632:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1783965097.437808:0:6632:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff947430c11000/0xe782b916994fdc08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965097.437850:0:6632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947430c11400/0xe782b916994fdc01 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f00ba expref: 55 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965097.437874:0:6632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff947430c11000/0xe782b916994fdc08 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f00ba expref: 54 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965097.437885:0:6632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9474186e7a00) 00010000:00010000:0.0:1783965097.437888:0:6632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783965097.437893:0:6632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff947430c11000, rc 0) 00000100:00100000:0.0:1783965097.437984:0:6632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947437072d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9923189b-eb4a-470c-ab45-969435371000+54:10524:x1870622715072384:12345-192.168.204.12@tcp:101:lfs.0 Request processed in 502us (826us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965097.437993:0:6632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 107 00000100:00100000:2.0:1783965097.445491:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965097.445617:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715072512 00000100:00100000:1.0:1783965097.445631:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715072512 00000100:00100000:1.0:1783965097.445709:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 108 00000100:00100000:1.0:1783965097.445721:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e2a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9923189b-eb4a-470c-ab45-969435371000+54:10524:x1870622715072512:12345-192.168.204.12@tcp:101:lfs.0 00010000:00010000:1.0:1783965097.445748:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783965097.445777:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef400/0xe782b916994fdc0f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5f00c1 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.445891:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef200/0xe782b916994fdc16 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.445929:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef200/0xe782b916994fdc16 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.445944:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef200/0xe782b916994fdc16 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.445964:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eea00/0xe782b916994fdc1d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.445971:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eea00/0xe782b916994fdc1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.445979:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eea00/0xe782b916994fdc1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.446115:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994fdc24 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.446124:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994fdc24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.446131:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994fdc24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783965097.446177:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1783965097.446183:0:5811:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1783965097.446253:0:5811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994fdc24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.446268:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994fdc24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.446289:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef200/0xe782b916994fdc16 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.446295:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef200/0xe782b916994fdc16 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.446303:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef200/0xe782b916994fdc16 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.446310:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743d9ef200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1783965097.446315:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef200/0xe782b916994fdc16 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.446323:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef200/0xe782b916994fdc16 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.446339:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9474186e7a00) 00010000:00010000:1.0:1783965097.446343:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783965097.446349:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef200/0xe782b916994fdc16 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.446356:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef200/0xe782b916994fdc16 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.446379:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eea00/0xe782b916994fdc1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.446386:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eea00/0xe782b916994fdc1d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.446392:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eea00/0xe782b916994fdc1d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.446405:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743d9eea00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1783965097.446408:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eea00/0xe782b916994fdc1d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.446414:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eea00/0xe782b916994fdc1d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.446423:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff947407b5c500) 00010000:00010000:1.0:1783965097.446425:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783965097.446428:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eea00/0xe782b916994fdc1d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.446433:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eea00/0xe782b916994fdc1d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.446478:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef400/0xe782b916994fdc0f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f00c1 expref: 56 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.446494:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994fdc24 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f00c1 expref: 55 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.446501:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94740a90c900) 00010000:00010000:1.0:1783965097.446503:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783965097.446507:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94743d9ee800, rc 0) 00000100:00100000:1.0:1783965097.446601:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e2a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9923189b-eb4a-470c-ab45-969435371000+55:10524:x1870622715072512:12345-192.168.204.12@tcp:101:lfs.0 Request processed in 882us (1126us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965097.446610:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 108 00000100:00100000:2.0:1783965097.452417:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965097.452512:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965097.456182:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715072896 00000100:00100000:1.0:1783965097.456368:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715072896 00000100:00100000:1.0:1783965097.456469:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 7 00000100:00100000:1.0:1783965097.456481:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94741cc32a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9923189b-eb4a-470c-ab45-969435371000+55:2359:x1870622715072896:12345-192.168.204.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783965097.456504:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783965097.456541:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994fdc24 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f00c1 expref: 55 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.456571:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94740a90c900) 00010000:00010000:1.0:1783965097.456577:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783965097.456667:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94741cc32a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9923189b-eb4a-470c-ab45-969435371000+54:2359:x1870622715072896:12345-192.168.204.12@tcp:103:ldlm_bl.0 Request processed in 187us (4153us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965097.456676:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 7 00000100:00100000:0.0:1783965097.457426:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715072768 00000100:00100000:0.0:1783965097.457441:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715072768 00000100:00100000:0.0:1783965097.457599:0:6632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 109 00000100:00100000:0.0:1783965097.457611:0:6632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94741cc30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9923189b-eb4a-470c-ab45-969435371000+54:10524:x1870622715072768:12345-192.168.204.12@tcp:101:lfs.0 00010000:00010000:0.0:1783965097.457635:0:6632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783965097.457658:0:6632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947430c11400/0xe782b916994fdc2b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5f00c8 expref: -99 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965097.457788:0:6632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff947430c10e00/0xe782b916994fdc32 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965097.457807:0:6632:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f400/0xe782b916994fdbfa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f00b3 expref: 55 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965097.457817:0:6632:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff947430c10e00/0xe782b916994fdc32 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965097.457901:0:6632:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f400/0xe782b916994fdbfa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f00b3 expref: 55 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965097.457918:0:6632:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f400/0xe782b916994fdbfa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f00b3 expref: 55 pid: 5813 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783965097.457935:0:6632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947436e38e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6632:1870622732911744:192.168.204.12@tcp:104: 00000100:00100000:0.0:1783965097.458045:0:6632:0:(client.c:2702:ptlrpc_set_wait()) set ffff94741ceded80 going to sleep for 11 seconds 00000100:00100000:0.0:1783965097.466937:0:6632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947436e38e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6632:1870622732911744:192.168.204.12@tcp:104: 00010000:00010000:0.0:1783965097.466978:0:6632:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff947430c10e00/0xe782b916994fdc32 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783965097.468059:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965097.468854:0:8330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715073024 00000100:00100000:3.0:1783965097.468870:0:8330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715073024 00010000:00010000:3.0:1783965097.468932:0:8330:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f400/0xe782b916994fdbfa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f00b3 expref: 56 pid: 5813 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783965097.468989:0:8330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 54 00000100:00100000:3.0:1783965097.469001:0:8330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94741843f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9923189b-eb4a-470c-ab45-969435371000+56:2360:x1870622715073024:12345-192.168.204.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783965097.469022:0:8330:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783965097.469031:0:8330:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f400/0xe782b916994fdbfa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f00b3 expref: 56 pid: 5813 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965097.469045:0:8330:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f400/0xe782b916994fdbfa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f00b3 expref: 56 pid: 5813 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965097.469092:0:8330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f400/0xe782b916994fdbfa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f00b3 expref: 56 pid: 5813 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965097.469113:0:8330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94740a90c900) 00010000:00010000:3.0:1783965097.469119:0:8330:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff947430c10e00/0xe782b916994fdc32 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965097.469130:0:8330:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff947430c10e00/0xe782b916994fdc32 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965097.469139:0:8330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947430c10e00/0xe782b916994fdc32 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965097.469382:0:8330:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783965097.469474:0:8330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94741843f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9923189b-eb4a-470c-ab45-969435371000+55:2360:x1870622715073024:12345-192.168.204.12@tcp:103:ldlm_bl.0 Request processed in 473us (1422us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965097.469484:0:8330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 54 00010000:00010000:0.0:1783965097.470660:0:6632:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff947430c10e00/0xe782b916994fdc32 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965097.470676:0:6632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947430c10e00/0xe782b916994fdc32 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783965097.470704:0:6632:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1783965097.470989:0:6632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947430c11400/0xe782b916994fdc2b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f00c8 expref: 56 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965097.471013:0:6632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff947430c10e00/0xe782b916994fdc32 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f00c8 expref: 55 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965097.471022:0:6632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94740a90c900) 00010000:00010000:0.0:1783965097.471025:0:6632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1783965097.471028:0:6632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff947430c10e00, rc 0) 00000100:00100000:0.0:1783965097.471142:0:6632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94741cc30380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9923189b-eb4a-470c-ab45-969435371000+55:10524:x1870622715072768:12345-192.168.204.12@tcp:101:lfs.0 Request processed in 13534us (18737us total) trans 4294967396 rc 0/0 00000100:00100000:0.0:1783965097.471152:0:6632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 109 00000100:00100000:2.0:1783965097.474018:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965097.474257:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715073280 00000100:00100000:1.0:1783965097.474414:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715073280 00000100:00100000:1.0:1783965097.474507:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 8 00000100:00100000:1.0:1783965097.474520:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94741cc30700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9923189b-eb4a-470c-ab45-969435371000+55:10524:x1870622715073280:12345-192.168.204.12@tcp:103:lfs.0 00010000:00010000:1.0:1783965097.474543:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783965097.474586:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947430c10a00/0xe782b916994fdb91 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f009e expref: 55 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.474614:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94740a90c900) 00010000:00010000:1.0:1783965097.474620:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783965097.474894:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94741cc30700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9923189b-eb4a-470c-ab45-969435371000+54:10524:x1870622715073280:12345-192.168.204.12@tcp:103:lfs.0 Request processed in 374us (889us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965097.474905:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 8 00000100:00100000:0.0:1783965097.479947:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965097.481289:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715073408 00000100:00100000:1.0:1783965097.481309:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715073408 00000100:00100000:1.0:1783965097.481412:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 110 00000100:00100000:1.0:1783965097.481423:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436e38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9923189b-eb4a-470c-ab45-969435371000+54:10524:x1870622715073408:12345-192.168.204.12@tcp:58:lfs.0 00010000:00010000:1.0:1783965097.481590:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994fdc40 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.481613:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994fdc40 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.481627:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994fdc40 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783965097.481912:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:1.0:1783965097.482039:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436e38e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9923189b-eb4a-470c-ab45-969435371000+54:10524:x1870622715073408:12345-192.168.204.12@tcp:58:lfs.0 Request processed in 615us (2105us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965097.482048:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 110 00000100:00100000:3.0:1783965097.487850:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965097.489646:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715073536 00000100:00100000:2.0:1783965097.489669:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715073536 00000100:00100000:2.0:1783965097.489774:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 111 00000100:00100000:2.0:1783965097.489787:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436e77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9923189b-eb4a-470c-ab45-969435371000+54:10524:x1870622715073536:12345-192.168.204.12@tcp:101:lfs.0 00010000:00010000:2.0:1783965097.489815:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783965097.489855:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e000/0xe782b916994fdc47 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5f00cf expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965097.489934:0:5812:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994fdc40 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965097.489948:0:5812:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e000/0xe782b916994fdc47 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f00cf expref: 55 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965097.490006:0:5812:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994fdc40 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965097.490024:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e000/0xe782b916994fdc47 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f00cf expref: 55 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965097.490040:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94740a90c900) 00010000:00010000:2.0:1783965097.490043:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783965097.490047:0:5812:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e000/0xe782b916994fdc47 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f00cf expref: 55 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965097.490056:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94743fb8e000, rc 0) 00000100:00100000:2.0:1783965097.490152:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436e77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9923189b-eb4a-470c-ab45-969435371000+55:10524:x1870622715073536:12345-192.168.204.12@tcp:101:lfs.0 Request processed in 368us (2327us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965097.490160:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 111 00000040:00080000:0.0:1783965097.581189:0:11561:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1783965097.581238:0:11561:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783965097.581334:0:11561:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:0.0:1783965097.581344:0:11561:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1783965097.581530:0:11561:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947436e3b800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11561:1870622732911872:192.168.204.12@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1783965097.581679:0:11561:0:(client.c:2702:ptlrpc_set_wait()) set ffff94741cede780 going to sleep for 11 seconds 00000100:00100000:3.0:1783965097.584690:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965097.585035:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715073664 00000100:00100000:2.0:1783965097.585049:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715073664 00000100:00100000:2.0:1783965097.585137:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 112 00000100:00100000:2.0:1783965097.585148:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436e77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9923189b-eb4a-470c-ab45-969435371000+56:10525:x1870622715073664:12345-192.168.204.12@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1783965097.585193:0:5813:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1783965097.585397:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436e77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9923189b-eb4a-470c-ab45-969435371000+56:10525:x1870622715073664:12345-192.168.204.12@tcp:53:lhsmtool_posix.0 Request processed in 250us (720us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965097.585405:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 112 00000100:00100000:0.0:1783965097.585634:0:11561:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947436e3b800 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11561:1870622732911872:192.168.204.12@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1783965097.590318:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965097.590515:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715073792 00000100:00100000:1.0:1783965097.590528:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715073792 00000100:00100000:1.0:1783965097.590598:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 113 00000100:00100000:1.0:1783965097.590610:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94741cc32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9923189b-eb4a-470c-ab45-969435371000+55:10525:x1870622715073792:12345-192.168.204.12@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1783965097.590699:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eea00/0xe782b916994fdc4e lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.590720:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eea00/0xe782b916994fdc4e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.590733:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eea00/0xe782b916994fdc4e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965097.593128:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f600/0xe782b916994fdc55 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965097.593169:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f600/0xe782b916994fdc55 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965097.593183:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f600/0xe782b916994fdc55 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965097.593632:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fe00/0xe782b916994fdc5c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965097.593645:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fe00/0xe782b916994fdc5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965097.593652:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fe00/0xe782b916994fdc5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783965097.593698:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1783965097.593703:0:5812:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1783965097.593717:0:5812:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fe00/0xe782b916994fdc5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965097.593728:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eea00/0xe782b916994fdc4e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965097.593736:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eea00/0xe782b916994fdc4e lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965097.593742:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eea00/0xe782b916994fdc4e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965097.593748:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743d9eea00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1783965097.593751:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eea00/0xe782b916994fdc4e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965097.593765:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eea00/0xe782b916994fdc4e lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965097.593778:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9474186e7d00) 00010000:00010000:2.0:1783965097.593781:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783965097.593785:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eea00/0xe782b916994fdc4e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965097.593791:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eea00/0xe782b916994fdc4e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965097.593811:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f600/0xe782b916994fdc55 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965097.593816:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f600/0xe782b916994fdc55 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965097.593822:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f600/0xe782b916994fdc55 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965097.593827:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743fb8f600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1783965097.593839:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f600/0xe782b916994fdc55 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965097.593847:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f600/0xe782b916994fdc55 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965097.593854:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff947402a2d300) 00010000:00010000:2.0:1783965097.593856:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783965097.593859:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f600/0xe782b916994fdc55 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965097.593876:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f600/0xe782b916994fdc55 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965097.593894:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fe00/0xe782b916994fdc5c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965097.593899:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fe00/0xe782b916994fdc5c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965097.593904:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fe00/0xe782b916994fdc5c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965097.593909:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743fb8fe00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1783965097.593912:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fe00/0xe782b916994fdc5c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965097.593918:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fe00/0xe782b916994fdc5c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965097.593926:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94740a90c900) 00010000:00010000:2.0:1783965097.593928:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783965097.593930:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fe00/0xe782b916994fdc5c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965097.593936:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fe00/0xe782b916994fdc5c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783965097.595946:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94741cc32a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9923189b-eb4a-470c-ab45-969435371000+55:10525:x1870622715073792:12345-192.168.204.12@tcp:34:lhsmtool_posix.0 Request processed in 5326us (5630us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965097.595972:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 113 00000100:00100000:0.0:1783965097.600370:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965097.600820:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715074048 00000100:00100000:2.0:1783965097.600837:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715074048 00000100:00100000:2.0:1783965097.600895:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 114 00000100:00100000:2.0:1783965097.600904:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436e3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9923189b-eb4a-470c-ab45-969435371000+55:10525:x1870622715074048:12345-192.168.204.12@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783965097.600924:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783965097.600943:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fe00/0xe782b916994fdc63 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5f00d6 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965097.601040:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f600/0xe782b916994fdc6a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965097.601054:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f600/0xe782b916994fdc6a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965097.601065:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f600/0xe782b916994fdc6a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783965097.601076:0:5813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1783965097.601167:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f600/0xe782b916994fdc6a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965097.601175:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f600/0xe782b916994fdc6a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965097.601181:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f600/0xe782b916994fdc6a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965097.601187:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743fb8f600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1783965097.601190:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f600/0xe782b916994fdc6a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965097.601198:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f600/0xe782b916994fdc6a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965097.601502:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94740a90c900) 00010000:00010000:2.0:1783965097.601505:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1783965097.601509:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f600/0xe782b916994fdc6a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965097.601516:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f600/0xe782b916994fdc6a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965097.601557:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fe00/0xe782b916994fdc63 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f00d6 expref: 57 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965097.601567:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9474186e7d00) 00010000:00010000:2.0:1783965097.601569:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783965097.601573:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fe00/0xe782b916994fdc63 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f00d6 expref: 57 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965097.601581:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94743fb8fe00, rc 0) 00000100:00100000:2.0:1783965097.601650:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436e3b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9923189b-eb4a-470c-ab45-969435371000+56:10525:x1870622715074048:12345-192.168.204.12@tcp:101:lhsmtool_posix.0 Request processed in 747us (1299us total) trans 4294967397 rc 301/301 00000100:00100000:2.0:1783965097.601657:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 114 00000100:00100000:0.0:1783965097.614330:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965097.617494:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715074176 00000100:00100000:1.0:1783965097.617508:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715074176 00000100:00100000:1.0:1783965097.617607:0:6632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 115 00000100:00100000:1.0:1783965097.617617:0:6632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436e3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9923189b-eb4a-470c-ab45-969435371000+56:10525:x1870622715074176:12345-192.168.204.12@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1783965097.617652:0:6632:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1783965097.617769:0:6632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436e3aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9923189b-eb4a-470c-ab45-969435371000+56:10525:x1870622715074176:12345-192.168.204.12@tcp:53:lhsmtool_posix.0 Request processed in 153us (3450us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965097.617777:0:6632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 115 00000100:00100000:2.0:1783965097.627453:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965097.627613:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715074432 00000100:00100000:1.0:1783965097.629125:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715074432 00000100:00100000:1.0:1783965097.629227:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 116 00000100:00100000:1.0:1783965097.629239:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e2c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9923189b-eb4a-470c-ab45-969435371000+56:10525:x1870622715074432:12345-192.168.204.12@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783965097.629463:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783965097.629467:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1783965097.629630:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947430c11000/0xe782b916994fdc08 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f00ba expref: 56 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.629653:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9474186e7a00) 00010000:00010000:1.0:1783965097.629658:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783965097.629673:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef200/0xe782b916994fdc78 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5f00dd expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783965097.631407:0:5811:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:1.0:1783965097.631626:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee200/0xe782b916994fdc7f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.631643:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee200/0xe782b916994fdc7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.631777:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee200/0xe782b916994fdc7f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.632046:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef200/0xe782b916994fdc78 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f00dd expref: 58 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.632072:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee200/0xe782b916994fdc7f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f00dd expref: 57 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.632081:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff947407b5c500) 00010000:00010000:1.0:1783965097.632084:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783965097.632087:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94743d9ee200, rc 0) 00000100:00100000:1.0:1783965097.632160:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e2c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9923189b-eb4a-470c-ab45-969435371000+57:10525:x1870622715074432:12345-192.168.204.12@tcp:101:lhsmtool_posix.0 Request processed in 2924us (4718us total) trans 4294967398 rc 0/0 00000100:00100000:1.0:1783965097.632170:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 116 00000100:00100000:0.0:1783965097.638310:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965097.638767:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715074688 00000100:00100000:1.0:1783965097.638777:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715074688 00000100:00100000:1.0:1783965097.638850:0:6632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 117 00000100:00100000:1.0:1783965097.638861:0:6632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436e3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9923189b-eb4a-470c-ab45-969435371000+57:10525:x1870622715074688:12345-192.168.204.12@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1783965097.639400:0:6632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783965097.639430:0:6632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee200/0xe782b916994fdc7f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f00dd expref: 57 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.639452:0:6632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff947407b5c500) 00010000:00010000:1.0:1783965097.639465:0:6632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783965097.639486:0:6632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef600/0xe782b916994fdc8d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.639500:0:6632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef600/0xe782b916994fdc8d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.639521:0:6632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef600/0xe782b916994fdc8d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.639536:0:6632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eea00/0xe782b916994fdc94 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x3c03d48e bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.639543:0:6632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eea00/0xe782b916994fdc94 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x3c03d48e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.639549:0:6632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eea00/0xe782b916994fdc94 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x3c03d48e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.639630:0:6632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef600/0xe782b916994fdc8d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.639637:0:6632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef600/0xe782b916994fdc8d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.639643:0:6632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef600/0xe782b916994fdc8d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.639649:0:6632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743d9ef600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1783965097.639653:0:6632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef600/0xe782b916994fdc8d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.640845:0:6632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef600/0xe782b916994fdc8d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.640871:0:6632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9474186e7a00) 00010000:00010000:1.0:1783965097.640874:0:6632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783965097.640879:0:6632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef600/0xe782b916994fdc8d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.640900:0:6632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef600/0xe782b916994fdc8d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.641177:0:6632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eea00/0xe782b916994fdc94 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x3c03d48e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.641185:0:6632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eea00/0xe782b916994fdc94 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x3c03d48e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.641191:0:6632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eea00/0xe782b916994fdc94 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x3c03d48e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.641196:0:6632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743d9eea00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1783965097.641223:0:6632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eea00/0xe782b916994fdc94 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x3c03d48e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.641285:0:6632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eea00/0xe782b916994fdc94 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x3c03d48e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.641296:0:6632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x3c03d48e (ffff947407b5ca00) 00010000:00010000:1.0:1783965097.641299:0:6632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783965097.641303:0:6632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eea00/0xe782b916994fdc94 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x3c03d48e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.641310:0:6632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eea00/0xe782b916994fdc94 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x3c03d48e bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783965097.641432:0:6632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436e3a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9923189b-eb4a-470c-ab45-969435371000+56:10525:x1870622715074688:12345-192.168.204.12@tcp:36:lhsmtool_posix.0 Request processed in 2568us (3128us total) trans 0 rc -2/-2 00000100:00100000:1.0:1783965097.641442:0:6632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 117 00010000:00010000:3.0:1783965097.643451:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783965097.650686:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965097.650867:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715074816 00000100:00100000:2.0:1783965097.650879:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715074816 00000100:00100000:2.0:1783965097.651090:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 118 00000100:00100000:2.0:1783965097.651107:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436e3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9923189b-eb4a-470c-ab45-969435371000+56:10525:x1870622715074816:12345-192.168.204.12@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783965097.651130:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783965097.651154:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f600/0xe782b916994fdc9b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5f00e4 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965097.651457:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fa00/0xe782b916994fdca2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965097.651474:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fa00/0xe782b916994fdca2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965097.651487:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fa00/0xe782b916994fdca2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965097.651672:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f600/0xe782b916994fdc9b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f00e4 expref: 58 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965097.651694:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fa00/0xe782b916994fdca2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f00e4 expref: 57 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965097.651703:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff947402a2d300) 00010000:00010000:2.0:1783965097.651706:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1783965097.651709:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94743fb8fa00, rc 0) 00000100:00100000:2.0:1783965097.651815:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436e3b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9923189b-eb4a-470c-ab45-969435371000+57:10525:x1870622715074816:12345-192.168.204.12@tcp:101:lhsmtool_posix.0 Request processed in 714us (1138us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965097.651824:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 118 00000100:00100000:2.0:1783965097.662511:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783965097.662688:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715075072 00000100:00100000:0.0:1783965097.662700:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715075072 00000100:00100000:0.0:1783965097.662768:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 119 00000100:00100000:0.0:1783965097.662779:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e2c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9923189b-eb4a-470c-ab45-969435371000+57:10525:x1870622715075072:12345-192.168.204.12@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1783965097.662876:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fc200/0xe782b916994fdca9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965097.663091:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fc200/0xe782b916994fdca9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965097.663105:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fc200/0xe782b916994fdca9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783965097.663398:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00010000:0.0:1783965097.663489:0:5812:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000cc406e25 reply state 000000000070b299 transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fc200/0xe782b916994fdca9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783965097.663498:0:5812:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783965097.663725:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e2c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9923189b-eb4a-470c-ab45-969435371000+59:10525:x1870622715075072:12345-192.168.204.12@tcp:36:lhsmtool_posix.0 Request processed in 946us (1223us total) trans 4294967399 rc 0/0 00000100:00100000:0.0:1783965097.663733:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 119 00000100:00100000:0.0:1783965097.675535:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965097.675849:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715075200 00010000:00010000:2.0:1783965097.675853:0:3309:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fc200/0xe782b916994fdca9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783965097.675868:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715075200 00010000:00010000:2.0:1783965097.675873:0:3309:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fc200/0xe782b916994fdca9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965097.675885:0:3309:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fc200/0xe782b916994fdca9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965097.675914:0:3309:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743e2fc200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1783965097.675921:0:3309:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fc200/0xe782b916994fdca9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965097.675932:0:3309:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fc200/0xe782b916994fdca9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965097.675956:0:3309:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff947402a2d300) 00010000:00010000:2.0:1783965097.675960:0:3309:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1783965097.675965:0:3309:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fc200/0xe782b916994fdca9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965097.675973:0:3309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fc200/0xe782b916994fdca9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783965097.675987:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 120 00000100:00100000:1.0:1783965097.676000:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436e39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9923189b-eb4a-470c-ab45-969435371000+58:10525:x1870622715075200:12345-192.168.204.12@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783965097.676026:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783965097.676051:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eea00/0xe782b916994fdcb0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5f00eb expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.676113:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eea00/0xe782b916994fdcb0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f00eb expref: 59 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.676129:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eea00/0xe782b916994fdcb0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f00eb expref: 59 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.676150:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff947402a2d300) 00010000:00010000:1.0:1783965097.676153:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783965097.676157:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94743d9eea00, rc 0) 00000100:00100000:1.0:1783965097.676271:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436e39500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9923189b-eb4a-470c-ab45-969435371000+59:10525:x1870622715075200:12345-192.168.204.12@tcp:101:lhsmtool_posix.0 Request processed in 274us (750us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965097.676278:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 120 00000100:00100000:3.0:1783965097.680464:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783965097.680651:0:6609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715075328 00000100:00100000:0.0:1783965097.680665:0:6609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715075328 00000100:00100000:0.0:1783965097.680740:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 38 00000100:00100000:0.0:1783965097.680773:0:6609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436e75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9923189b-eb4a-470c-ab45-969435371000+8:2360:x1870622715075328:12345-192.168.204.12@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1783965097.682775:0:6609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436e75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9923189b-eb4a-470c-ab45-969435371000+9:2360:x1870622715075328:12345-192.168.204.12@tcp:2:lhsmtool_posix.0 Request processed in 1989us (2312us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1783965097.682790:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 38 00000100:00100000:2.0:1783965097.687770:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965097.687979:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715075584 00000100:00100000:1.0:1783965097.687993:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715075584 00000100:00100000:3.0:1783965097.688474:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 30 00000100:00100000:3.0:1783965097.688491:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e2c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9923189b-eb4a-470c-ab45-969435371000+59:10525:x1870622715075584:12345-192.168.204.12@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1783965097.688992:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e2c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9923189b-eb4a-470c-ab45-969435371000+60:10525:x1870622715075584:12345-192.168.204.12@tcp:35:lhsmtool_posix.0 Request processed in 503us (1234us total) trans 4294967400 rc 0/0 00000100:00100000:3.0:1783965097.689002:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 30 00000100:00100000:3.0:1783965097.692372:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783965097.692484:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715075840 00000100:00100000:0.0:1783965097.692497:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715075840 00000100:00100000:0.0:1783965097.692575:0:6632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 121 00000100:00100000:0.0:1783965097.692587:0:6632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436e76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9923189b-eb4a-470c-ab45-969435371000+60:10525:x1870622715075840:12345-192.168.204.12@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1783965097.692735:0:6632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436e76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9923189b-eb4a-470c-ab45-969435371000+60:10525:x1870622715075840:12345-192.168.204.12@tcp:57:lhsmtool_posix.0 Request processed in 149us (389us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965097.692743:0:6632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 121 00000100:00100000:0.0:1783965097.696866:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965097.697097:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715075968 00000100:00100000:1.0:1783965097.697112:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715075968 00000100:00100000:1.0:1783965097.697187:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 122 00000100:00100000:1.0:1783965097.697230:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436e39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9923189b-eb4a-470c-ab45-969435371000+60:10525:x1870622715075968:12345-192.168.204.12@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783965097.697271:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783965097.697316:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef600/0xe782b916994fdcb7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5f00f2 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.697445:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee200/0xe782b916994fdcbe lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.697462:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee200/0xe782b916994fdcbe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.697475:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee200/0xe782b916994fdcbe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783965097.697521:0:5811:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1783965097.697544:0:5811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee200/0xe782b916994fdcbe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.697575:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef600/0xe782b916994fdcb7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f00f2 expref: 62 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.697606:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee200/0xe782b916994fdcbe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f00f2 expref: 61 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.697617:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff947402a2d300) 00010000:00010000:1.0:1783965097.697620:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1783965097.697624:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94743d9ee200, rc 0) 00000100:00100000:1.0:1783965097.697702:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436e39180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9923189b-eb4a-470c-ab45-969435371000+61:10525:x1870622715075968:12345-192.168.204.12@tcp:101:lhsmtool_posix.0 Request processed in 504us (851us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965097.697711:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 122 00000100:00100000:3.0:1783965097.702331:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965097.702559:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715076096 00000100:00100000:1.0:1783965097.702576:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715076096 00000100:00100000:1.0:1783965097.702658:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 39 00000100:00100000:1.0:1783965097.702670:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436e74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9923189b-eb4a-470c-ab45-969435371000+9:2359:x1870622715076096:12345-192.168.204.12@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783965097.702697:0:6608:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783965097.702730:0:6608:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d7be2fb8/0xe782b916994fdcc5 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5f00f9 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783965097.702764:0:6608:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a5525a9, blocks: 0x1 00010000:00010000:1.0:1783965097.702791:0:6608:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=331s v=(0 0) 00010000:00010000:1.0:1783965097.702796:0:6608:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783965097.702807:0:6608:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d7be2fb8/0xe782b916994fdcc5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f00f9 expref: 10 pid: 6608 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.702839:0:6608:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000d7be2fb8/0xe782b916994fdcc5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f00f9 expref: 10 pid: 6608 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.702856:0:6608:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94743d9ef200, rc 0) 00000100:00100000:1.0:1783965097.702947:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436e74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9923189b-eb4a-470c-ab45-969435371000+10:2359:x1870622715076096:12345-192.168.204.12@tcp:101:lhsmtool_posix.0 Request processed in 279us (631us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965097.702955:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 39 00000100:00100000:0.0:1783965097.716773:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965097.717421:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715076352 00000100:00100000:2.0:1783965097.717437:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715076352 00000100:00100000:2.0:1783965097.717592:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 123 00000100:00100000:2.0:1783965097.717605:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436e3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9923189b-eb4a-470c-ab45-969435371000+61:10525:x1870622715076352:12345-192.168.204.12@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1783965097.717764:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436e3b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9923189b-eb4a-470c-ab45-969435371000+61:10525:x1870622715076352:12345-192.168.204.12@tcp:57:lhsmtool_posix.0 Request processed in 160us (1005us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965097.717773:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 123 00000100:00100000:2.0:1783965097.725728:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965097.726118:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715076480 00000100:00100000:3.0:1783965097.726132:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715076480 00000100:00100000:3.0:1783965097.726266:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 40 00000100:00100000:3.0:1783965097.726278:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e2c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9923189b-eb4a-470c-ab45-969435371000+10:10525:x1870622715076480:12345-192.168.204.12@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783965097.726306:0:6606:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783965097.726334:0:6606:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e214443b/0xe782b916994fdccc lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5f0100 expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965097.726397:0:6606:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000d7be2fb8/0xe782b916994fdcc5 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f00f9 expref: 11 pid: 6608 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965097.726410:0:6606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783965097.726416:0:6606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783965097.726422:0:6606:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e214443b/0xe782b916994fdccc lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0100 expref: 11 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965097.726721:0:6606:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000d7be2fb8/0xe782b916994fdcc5 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f00f9 expref: 11 pid: 6608 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965097.726740:0:6606:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000d7be2fb8/0xe782b916994fdcc5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f00f9 expref: 11 pid: 6608 timeout: 431 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783965097.726760:0:6606:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947436e76a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6606:1870622732912000:192.168.204.12@tcp:104: 00000100:00100000:2.0:1783965097.727354:0:6606:0:(client.c:2702:ptlrpc_set_wait()) set ffff9474057ddb40 going to sleep for 11 seconds 00000100:00100000:3.0:1783965097.733861:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965097.734384:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715076608 00000100:00100000:1.0:1783965097.734398:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715076608 00010000:00010000:1.0:1783965097.734468:0:5799:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000d7be2fb8/0xe782b916994fdcc5 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f00f9 expref: 12 pid: 6608 timeout: 431 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783965097.734523:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 55 00000100:00100000:1.0:1783965097.734537:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e2a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9923189b-eb4a-470c-ab45-969435371000+12:2359:x1870622715076608:12345-192.168.204.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783965097.734568:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783965097.734601:0:5799:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000d7be2fb8/0xe782b916994fdcc5 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f00f9 expref: 12 pid: 6608 timeout: 431 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.734616:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000d7be2fb8/0xe782b916994fdcc5 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f00f9 expref: 12 pid: 6608 timeout: 431 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.734695:0:5799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783965097.734702:0:5799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783965097.734725:0:5799:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e214443b/0xe782b916994fdccc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0100 expref: 12 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.734738:0:5799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e214443b/0xe782b916994fdccc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0100 expref: 12 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.734822:0:5799:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000e214443b/0xe782b916994fdccc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0100 expref: 12 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783965097.734875:0:5799:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947437070a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5799:1870622732912128:192.168.204.12@tcp:105: 00000100:00100000:1.0:1783965097.735034:0:5799:0:(client.c:2702:ptlrpc_set_wait()) set ffff94743709e780 going to sleep for 11 seconds 00010000:00010000:2.0:1783965097.738664:0:6606:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d7be2fb8/0xe782b916994fdcc5 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f00f9 expref: 12 pid: 6608 timeout: 431 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783965097.738740:0:6606:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947436e76a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6606:1870622732912000:192.168.204.12@tcp:104: 00010000:00010000:2.0:1783965097.738784:0:6606:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e214443b/0xe782b916994fdccc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0100 expref: 11 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965097.738804:0:6606:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff947436f27800, rc 0) 00000100:00100000:2.0:1783965097.738917:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e2c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9923189b-eb4a-470c-ab45-969435371000+11:10525:x1870622715076480:12345-192.168.204.12@tcp:101:lhsmtool_posix.0 Request processed in 12640us (13204us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965097.738927:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 40 00000100:00100000:1.0:1783965097.742523:0:5799:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947437070a80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5799:1870622732912128:192.168.204.12@tcp:105: 00010000:00010000:1.0:1783965097.742561:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783965097.742639:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e2a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9923189b-eb4a-470c-ab45-969435371000+10:2359:x1870622715076608:12345-192.168.204.12@tcp:103:ldlm_bl.0 Request processed in 8107us (8795us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965097.742650:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 55 00000100:00100000:0.0:1783965097.745294:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965097.745394:0:6614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715076736 00000100:00100000:1.0:1783965097.745407:0:6614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715076736 00002000:00100000:1.0:1783965097.745475:0:6614:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff947436e39880 x1870622715076736/t0(0) o4->9923189b-eb4a-470c-ab45-969435371000@192.168.204.12@tcp:523/0 lens 504/0 e 0 to 0 dl 1783965108 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783965097.745486:0:6614:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff947436e39880 with x1870622715076736 ext(0->12) 00002000:00010000:1.0:1783965097.745493:0:6614:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff947436e39880 00000100:00100000:1.0:1783965097.745520:0:6614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 2 00000100:00100000:1.0:1783965097.745528:0:6614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436e39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9923189b-eb4a-470c-ab45-969435371000+10:2360:x1870622715076736:12345-192.168.204.12@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1783965097.746335:0:6614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436e39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9923189b-eb4a-470c-ab45-969435371000+12:2360:x1870622715076736:12345-192.168.204.12@tcp:4:lhsmtool_posix.0 Request processed in 799us (1050us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1783965097.746347:0:6614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 2 00002000:00100000:1.0:1783965097.746357:0:6614:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff947436e39880 x1870622715076736/t4294967308(0) o4->9923189b-eb4a-470c-ab45-969435371000@192.168.204.12@tcp:523/0 lens 504/448 e 0 to 0 dl 1783965108 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783965097.746367:0:6614:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff947436e39880 with x1870622715076736 ext(0->12) 00002000:00010000:1.0:1783965097.746373:0:6614:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff947436e39880 00000100:00100000:0.0:1783965097.748616:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965097.748756:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715076864 00000100:00100000:1.0:1783965097.748768:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715076864 00000100:00100000:3.0:1783965097.748880:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 124 00000100:00100000:3.0:1783965097.748946:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436e38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9923189b-eb4a-470c-ab45-969435371000+61:10525:x1870622715076864:12345-192.168.204.12@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1783965097.798284:0:5835:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967399 is committed 00000004:00080000:1.0:1783965097.798373:0:5835:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:1.0:1783965097.798403:0:5835:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff94743709ed80 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:1.0:1783965097.798410:0:5835:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff94743e433100 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff94743709e840 00000020:00080000:1.0:1783965097.798413:0:5835:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff94743e433000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff947436498000 00000004:00080000:1.0:1783965097.798432:0:5835:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:1.0:1783965097.798496:0:5835:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9474057dd9c0 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:1.0:1783965097.798500:0:5835:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff947411145d00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9474057dd180 00000020:00080000:1.0:1783965097.798524:0:5835:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff947411145700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff94743e565800 00000001:00080000:1.0:1783965097.798537:0:5835:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000100:00100000:1.0:1783965097.798749:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436e38700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9923189b-eb4a-470c-ab45-969435371000+15:10525:x1870622715076864:12345-192.168.204.12@tcp:44:lhsmtool_posix.0 Request processed in 49800us (50141us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965097.798775:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 124 00000020:00080000:3.0:1783965097.799554:0:5846:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:3.0:1783965097.799811:0:5846:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:0.0:1783965097.800334:0:3323:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783965097.801933:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947436e3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3325:1870622732912256:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1783965097.802037:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783965097.802821:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732912256 00000100:00100000:2.0:1783965097.802844:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732912256 00000100:00100000:2.0:1783965097.802913:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1783965097.802924:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94741cccec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3325:x1870622732912256:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1783965097.802961:0:6608:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00010000:00010000:2.0:1783965097.802995:0:6608:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000007f90b2/0xe782b916994fdcd3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965097.803023:0:6608:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006127a45f/0xe782b916994fda95 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f005f expref: 11 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965097.803033:0:6608:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1783965097.803038:0:6608:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783965097.803043:0:6608:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000007f90b2/0xe782b916994fdcd3 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965097.803106:0:6608:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006127a45f/0xe782b916994fda95 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f005f expref: 11 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965097.803123:0:6608:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006127a45f/0xe782b916994fda95 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f005f expref: 11 pid: 6606 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783965097.803140:0:6608:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e2c2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6608:1870622732912512:192.168.204.12@tcp:104: 00000100:00100000:2.0:1783965097.803265:0:6608:0:(client.c:2702:ptlrpc_set_wait()) set ffff947429f849c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783965097.804595:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965097.804722:0:6609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715076992 00000100:00100000:1.0:1783965097.804730:0:6609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715076992 00000100:00100000:1.0:1783965097.804781:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 42 00000100:00100000:1.0:1783965097.804790:0:6609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e216300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9923189b-eb4a-470c-ab45-969435371000+12:2359:x1870622715076992:12345-192.168.204.12@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1783965097.810660:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e2c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3323:1870622732912384:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1783965097.810775:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783965097.811052:0:8738:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:1.0:1783965097.811064:0:8738:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:1.0:1783965097.814915:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965097.814959:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715077120 00000100:00100000:1.0:1783965097.814971:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715077120 00010000:00010000:1.0:1783965097.815028:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006127a45f/0xe782b916994fda95 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f005f expref: 13 pid: 6606 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783965097.815075:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 56 00000100:00100000:1.0:1783965097.815087:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947437070a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9923189b-eb4a-470c-ab45-969435371000+13:2360:x1870622715077120:12345-192.168.204.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783965097.815107:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783965097.815113:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006127a45f/0xe782b916994fda95 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f005f expref: 13 pid: 6606 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.815129:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006127a45f/0xe782b916994fda95 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f005f expref: 13 pid: 6606 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.815174:0:5797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1783965097.815180:0:5797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1783965097.815231:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000007f90b2/0xe782b916994fdcd3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.815245:0:5797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000007f90b2/0xe782b916994fdcd3 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.815272:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783965097.815343:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947437070a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9923189b-eb4a-470c-ab45-969435371000+13:2360:x1870622715077120:12345-192.168.204.12@tcp:103:ldlm_bl.0 Request processed in 256us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965097.815362:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 56 00000100:00100000:1.0:1783965097.815407:0:8738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732912384 00000100:00100000:1.0:1783965097.815412:0:8738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732912384 00010000:00010000:0.0:1783965097.816361:0:6608:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006127a45f/0xe782b916994fda95 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f005f expref: 12 pid: 6606 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783965097.816387:0:6608:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e2c2300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6608:1870622732912512:192.168.204.12@tcp:104: 00010000:00010000:0.0:1783965097.816413:0:6608:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000007f90b2/0xe782b916994fdcd3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965097.816441:0:6608:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000007f90b2/0xe782b916994fdcd3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965097.816449:0:6608:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000007f90b2/0xe782b916994fdcd3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965097.816461:0:6608:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000007f90b2/0xe782b916994fdcd3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965097.816469:0:6608:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000007f90b2/0xe782b916994fdcd3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965097.816498:0:6608:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783965097.816911:0:5800:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783965097.816921:0:5800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000007f90b2/0xe782b916994fdcd3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965097.816931:0:5800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743fb8e400 already unused, calling callback (ffffffffc168d230) 00010000:00010000:3.0:1783965097.816936:0:5800:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000007f90b2/0xe782b916994fdcd3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965097.816948:0:5800:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000007f90b2/0xe782b916994fdcd3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965097.816969:0:5800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000007f90b2/0xe782b916994fdcd3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965097.816977:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000007f90b2/0xe782b916994fdcd3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965097.816997:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783965097.816999:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783965097.817001:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783965097.819031:0:11945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1783965097.819051:0:11945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436e39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3323:x1870622732912384:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1783965097.819093:0:11945:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00002000:00010000:1.0:1783965097.819138:0:11945:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a5525a8, atime: 0x6a5525a8, ctime: 0x6a5525a8, blocks: 0x1 00010000:00010000:1.0:1783965097.819147:0:11945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047c71529/0xe782b916994fdcda lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.819166:0:11945:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=332s v=(0 0) 00000100:00100000:0.0:1783965097.819171:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94741cccec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3325:x1870622732912256:12345-0@lo:6:osp-syn-1-0.0 Request processed in 16247us (17133us total) trans 4294967309 rc 0/0 00010000:00010000:1.0:1783965097.819172:0:11945:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783965097.819180:0:11945:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000047c71529/0xe782b916994fdcda lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783965097.819180:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00010000:1.0:1783965097.819237:0:11945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000047c71529/0xe782b916994fdcda lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 11945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.819248:0:11945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000047c71529/0xe782b916994fdcda lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 11945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.819256:0:11945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000047c71529/0xe782b916994fdcda lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 11945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.819280:0:11945:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783965097.819299:0:5801:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783965097.819305:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000047c71529/0xe782b916994fdcda lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.819313:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743d9efa00 already unused, calling callback (ffffffffc168d230) 00010000:00010000:1.0:1783965097.819317:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000047c71529/0xe782b916994fdcda lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 11945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.819326:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000047c71529/0xe782b916994fdcda lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 11945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.819343:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000047c71529/0xe782b916994fdcda lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.819351:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000047c71529/0xe782b916994fdcda lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 11945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.819387:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783965097.819389:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783965097.819390:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1783965097.819758:0:3325:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff947436e3bb80/2, rc 0, transno 4294967309 00000100:00100000:3.0:1783965097.819778:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947436e3bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3325:1870622732912256:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1783965097.819879:0:11945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436e39c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3323:x1870622732912384:12345-0@lo:6:osp-syn-0-0.0 Request processed in 835us (9105us total) trans 4294967304 rc 0/0 00000100:00100000:1.0:1783965097.819889:0:11945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000004:00080000:2.0:1783965097.820461:0:3323:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94743e2c2a00/2, rc 0, transno 4294967304 00000100:00100000:2.0:1783965097.820472:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e2c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3323:1870622732912384:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1783965097.856389:0:6609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e216300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9923189b-eb4a-470c-ab45-969435371000+11:2359:x1870622715076992:12345-192.168.204.12@tcp:16:lhsmtool_posix.0 Request processed in 51582us (51783us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965097.856407:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 42 00000001:00080000:0.0:1783965097.857058:0:7523:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967307 is committed 00000001:00080000:0.0:1783965097.857080:0:7523:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000001:00080000:0.0:1783965097.857097:0:7523:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000100:00100000:1.0:1783965097.867747:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965097.867838:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715077376 00000100:00100000:2.0:1783965097.867850:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715077376 00000100:00100000:2.0:1783965097.867926:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 125 00000100:00100000:2.0:1783965097.867938:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947437070000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9923189b-eb4a-470c-ab45-969435371000+15:10525:x1870622715077376:12345-192.168.204.12@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1783965097.868015:0:5812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783965097.868050:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee200/0xe782b916994fdcbe lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f00f2 expref: 15 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965097.868081:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff947402a2d300) 00010000:00010000:2.0:1783965097.868086:0:5812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783965097.868122:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8ec00/0xe782b916994fdce1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965097.868138:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8ec00/0xe782b916994fdce1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965097.868170:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8ec00/0xe782b916994fdce1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783965097.868906:0:5812:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007fa2d74e reply state 0000000096e39d69 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8ec00/0xe782b916994fdce1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783965097.868924:0:5812:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783965097.870675:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947437070000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9923189b-eb4a-470c-ab45-969435371000+16:10525:x1870622715077376:12345-192.168.204.12@tcp:36:lhsmtool_posix.0 Request processed in 2723us (2926us total) trans 4294967401 rc 0/0 00000100:00100000:2.0:1783965097.870689:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 125 00010000:00010000:3.0:1783965097.874273:0:3308:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8ec00/0xe782b916994fdce1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965097.874295:0:3308:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8ec00/0xe782b916994fdce1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965097.874304:0:3308:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8ec00/0xe782b916994fdce1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965097.874311:0:3308:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743fb8ec00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1783965097.874317:0:3308:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8ec00/0xe782b916994fdce1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965097.874326:0:3308:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8ec00/0xe782b916994fdce1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965097.874346:0:3308:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff947402a2d300) 00010000:00010000:3.0:1783965097.874350:0:3308:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783965097.874355:0:3308:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8ec00/0xe782b916994fdce1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965097.874363:0:3308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8ec00/0xe782b916994fdce1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783965097.875507:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965097.875617:0:8738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715077504 00000100:00100000:2.0:1783965097.875631:0:8738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715077504 00000100:00100000:2.0:1783965097.875724:0:8738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 44 00000100:00100000:2.0:1783965097.875738:0:8738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e217480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9923189b-eb4a-470c-ab45-969435371000+6:2357:x1870622715077504:12345-192.168.204.12@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1783965097.876035:0:8738:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1783965097.876040:0:8738:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1783965097 00002000:00010000:2.0:1783965097.876042:0:8738:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1783965096 00002000:00010000:2.0:1783965097.876044:0:8738:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1783965097 -> 1783965097 00002000:00010000:2.0:1783965097.876047:0:8738:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1783965097.876129:0:8738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e217480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9923189b-eb4a-470c-ab45-969435371000+7:2357:x1870622715077504:12345-192.168.204.12@tcp:2:lhsmtool_posix.0 Request processed in 393us (632us total) trans 4294967310 rc 0/0 00000100:00100000:2.0:1783965097.876138:0:8738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 44 00000100:00100000:2.0:1783965097.881564:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965097.881701:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715077760 00000100:00100000:1.0:1783965097.881714:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715077760 00000100:00100000:1.0:1783965097.881903:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 126 00000100:00100000:1.0:1783965097.881917:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e2c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9923189b-eb4a-470c-ab45-969435371000+15:10525:x1870622715077760:12345-192.168.204.12@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1783965097.882404:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efe00/0xe782b916994fdce8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.882428:0:5811:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fa00/0xe782b916994fdca2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f00e4 expref: 15 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.882508:0:5811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efe00/0xe782b916994fdce8 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.882561:0:5811:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fa00/0xe782b916994fdca2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f00e4 expref: 15 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.882578:0:5811:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fa00/0xe782b916994fdca2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f00e4 expref: 15 pid: 5813 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783965097.882615:0:5811:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947437071f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5811:1870622732912640:192.168.204.12@tcp:104: 00000100:00100000:1.0:1783965097.882818:0:5811:0:(client.c:2702:ptlrpc_set_wait()) set ffff94743709ee40 going to sleep for 11 seconds 00000100:00100000:1.0:1783965097.889114:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965097.889328:0:5811:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947437071f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5811:1870622732912640:192.168.204.12@tcp:104: 00010000:00010000:2.0:1783965097.889377:0:5811:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efe00/0xe782b916994fdce8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783965097.889504:0:8330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715077888 00000100:00100000:3.0:1783965097.889514:0:8330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715077888 00010000:00010000:3.0:1783965097.889564:0:8330:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fa00/0xe782b916994fdca2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f00e4 expref: 16 pid: 5813 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783965097.889614:0:8330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 57 00000100:00100000:3.0:1783965097.889623:0:8330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947437070380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9923189b-eb4a-470c-ab45-969435371000+16:2359:x1870622715077888:12345-192.168.204.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783965097.889652:0:8330:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783965097.889661:0:8330:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fa00/0xe782b916994fdca2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f00e4 expref: 16 pid: 5813 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965097.889674:0:8330:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fa00/0xe782b916994fdca2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f00e4 expref: 16 pid: 5813 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965097.889702:0:8330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fa00/0xe782b916994fdca2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f00e4 expref: 16 pid: 5813 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965097.889724:0:8330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff947402a2d300) 00010000:00010000:3.0:1783965097.889729:0:8330:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efe00/0xe782b916994fdce8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965097.889740:0:8330:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efe00/0xe782b916994fdce8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965097.889749:0:8330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efe00/0xe782b916994fdce8 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965097.889781:0:8330:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783965097.889810:0:5811:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efe00/0xe782b916994fdce8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965097.889818:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efe00/0xe782b916994fdce8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965097.889862:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efe00/0xe782b916994fdce8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965097.889872:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efe00/0xe782b916994fdce8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965097.889879:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efe00/0xe782b916994fdce8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965097.889886:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743d9efe00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1783965097.889890:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efe00/0xe782b916994fdce8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965097.889898:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efe00/0xe782b916994fdce8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965097.889907:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff947402a2d300) 00010000:00010000:2.0:1783965097.889910:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1783965097.889914:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efe00/0xe782b916994fdce8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965097.889920:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efe00/0xe782b916994fdce8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783965097.889941:0:8330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947437070380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9923189b-eb4a-470c-ab45-969435371000+15:2359:x1870622715077888:12345-192.168.204.12@tcp:103:ldlm_bl.0 Request processed in 318us (842us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965097.889949:0:8330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 57 00000100:00100000:2.0:1783965097.889975:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e2c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9923189b-eb4a-470c-ab45-969435371000+14:10525:x1870622715077760:12345-192.168.204.12@tcp:55:lhsmtool_posix.0 Request processed in 8062us (8548us total) trans 0 rc -22/-22 00000100:00100000:2.0:1783965097.889991:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 126 00000100:00100000:3.0:1783965097.892678:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783965097.893076:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715078016 00000100:00100000:0.0:1783965097.893089:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715078016 00000100:00100000:0.0:1783965097.893257:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 45 00000100:00100000:0.0:1783965097.893270:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e215500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9923189b-eb4a-470c-ab45-969435371000+7:2358:x1870622715078016:12345-192.168.204.12@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1783965097.893334:0:6608:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000bb47407d/0xe782b916994fdcef lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965097.893393:0:6608:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e214443b/0xe782b916994fdccc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0100 expref: 7 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965097.893403:0:6608:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1783965097.893408:0:6608:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1783965097.893414:0:6608:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bb47407d/0xe782b916994fdcef lrc: 4/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965097.893460:0:6608:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e214443b/0xe782b916994fdccc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0100 expref: 7 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965097.893478:0:6608:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e214443b/0xe782b916994fdccc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0100 expref: 7 pid: 6606 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783965097.893497:0:6608:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947436e3ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6608:1870622732912768:192.168.204.12@tcp:104: 00000100:00100000:0.0:1783965097.893604:0:6608:0:(client.c:2702:ptlrpc_set_wait()) set ffff94743fb230c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783965097.896086:0:6608:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947436e3ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6608:1870622732912768:192.168.204.12@tcp:104: 00010000:00010000:2.0:1783965097.896124:0:6608:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000bb47407d/0xe782b916994fdcef lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783965097.898109:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965097.898260:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715078144 00000100:00100000:1.0:1783965097.898272:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715078144 00010000:00010000:1.0:1783965097.898326:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e214443b/0xe782b916994fdccc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0100 expref: 8 pid: 6606 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783965097.898385:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 58 00000100:00100000:1.0:1783965097.898397:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e215180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9923189b-eb4a-470c-ab45-969435371000+8:2360:x1870622715078144:12345-192.168.204.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783965097.898418:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783965097.898452:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e214443b/0xe782b916994fdccc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0100 expref: 8 pid: 6606 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.898468:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e214443b/0xe782b916994fdccc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0100 expref: 8 pid: 6606 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.898499:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e214443b/0xe782b916994fdccc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0100 expref: 8 pid: 6606 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.898521:0:5797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1783965097.898525:0:5797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1783965097.898533:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000bb47407d/0xe782b916994fdcef lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.898568:0:5797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bb47407d/0xe782b916994fdcef lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.898599:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783965097.898671:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e215180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9923189b-eb4a-470c-ab45-969435371000+7:2360:x1870622715078144:12345-192.168.204.12@tcp:103:ldlm_bl.0 Request processed in 276us (576us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965097.898679:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 58 00010000:00010000:0.0:1783965097.898769:0:6608:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000bb47407d/0xe782b916994fdcef lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965097.898779:0:6608:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bb47407d/0xe782b916994fdcef lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965097.898810:0:6608:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000bb47407d/0xe782b916994fdcef lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965097.898841:0:6608:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bb47407d/0xe782b916994fdcef lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965097.898850:0:6608:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bb47407d/0xe782b916994fdcef lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965097.898858:0:6608:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743e2fd400 already unused, calling callback (ffffffffc168d230) 00010000:00010000:0.0:1783965097.898863:0:6608:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bb47407d/0xe782b916994fdcef lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965097.898874:0:6608:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bb47407d/0xe782b916994fdcef lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965097.898890:0:6608:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bb47407d/0xe782b916994fdcef lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965097.898898:0:6608:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bb47407d/0xe782b916994fdcef lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783965097.898964:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e215500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9923189b-eb4a-470c-ab45-969435371000+6:2358:x1870622715078016:12345-192.168.204.12@tcp:1:lhsmtool_posix.0 Request processed in 5696us (6301us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965097.898972:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 45 00000100:00100000:0.0:1783965097.904299:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965097.904528:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715078400 00000100:00100000:1.0:1783965097.904543:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715078400 00000100:00100000:1.0:1783965097.904614:0:6632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 127 00000100:00100000:1.0:1783965097.904625:0:6632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436e38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9923189b-eb4a-470c-ab45-969435371000+14:10525:x1870622715078400:12345-192.168.204.12@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1783965097.904727:0:6632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efc00/0xe782b916994fdcf6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.904749:0:6632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efc00/0xe782b916994fdcf6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.904762:0:6632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efc00/0xe782b916994fdcf6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.905041:0:6632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eee00/0xe782b916994fdcfd lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.905053:0:6632:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eea00/0xe782b916994fdcb0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f00eb expref: 15 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.905062:0:6632:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eee00/0xe782b916994fdcfd lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.905121:0:6632:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eea00/0xe782b916994fdcb0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f00eb expref: 15 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.905138:0:6632:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eea00/0xe782b916994fdcb0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f00eb expref: 15 pid: 5811 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783965097.905157:0:6632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947437072680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6632:1870622732912896:192.168.204.12@tcp:104: 00000100:00100000:1.0:1783965097.905367:0:6632:0:(client.c:2702:ptlrpc_set_wait()) set ffff94743709e180 going to sleep for 11 seconds 00000100:00100000:1.0:1783965097.909725:0:6632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947437072680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6632:1870622732912896:192.168.204.12@tcp:104: 00010000:00010000:1.0:1783965097.909766:0:6632:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eee00/0xe782b916994fdcfd lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783965097.914486:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965097.914787:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715078528 00000100:00100000:1.0:1783965097.914801:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715078528 00010000:00010000:1.0:1783965097.914866:0:5799:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eea00/0xe782b916994fdcb0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f00eb expref: 16 pid: 5811 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783965097.914911:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 59 00000100:00100000:1.0:1783965097.914920:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436e38000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9923189b-eb4a-470c-ab45-969435371000+16:2359:x1870622715078528:12345-192.168.204.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783965097.914941:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783965097.914948:0:5799:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eea00/0xe782b916994fdcb0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f00eb expref: 16 pid: 5811 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.914961:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eea00/0xe782b916994fdcb0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f00eb expref: 16 pid: 5811 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.915011:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eea00/0xe782b916994fdcb0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f00eb expref: 16 pid: 5811 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.915038:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff947402a2d300) 00010000:00010000:1.0:1783965097.915045:0:5799:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eee00/0xe782b916994fdcfd lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.915055:0:5799:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eee00/0xe782b916994fdcfd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.915063:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eee00/0xe782b916994fdcfd lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.915105:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783965097.915421:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436e38000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9923189b-eb4a-470c-ab45-969435371000+15:2359:x1870622715078528:12345-192.168.204.12@tcp:103:ldlm_bl.0 Request processed in 499us (948us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965097.915430:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 59 00010000:00010000:0.0:1783965097.915504:0:6632:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eee00/0xe782b916994fdcfd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965097.915521:0:6632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eee00/0xe782b916994fdcfd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783965097.915764:0:6632:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:0.0:1783965097.915966:0:6632:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:0.0:1783965097.916020:0:6632:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:0.0:1783965097.916133:0:6632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947436e39f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6632:1870622732913024:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1783965097.916251:0:6632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783965097.916293:0:6632:0:(client.c:2702:ptlrpc_set_wait()) set ffff94743fb233c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783965097.916721:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732913024 00000100:00100000:1.0:1783965097.916731:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732913024 00000100:00100000:1.0:1783965097.916788:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783965097.916798:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436e38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6632:x1870622732913024:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1783965097.916915:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436e38380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6632:x1870622732913024:12345-0@lo:1000:mdt00_003.0 Request processed in 113us (658us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965097.916922:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1783965097.917012:0:6632:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:3.0:1783965097.917020:0:6632:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967305 00000100:00100000:3.0:1783965097.917048:0:6632:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff947436e3bb80 x1870622732912256/t4294967309(4294967309) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1783965113 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783965097.917076:0:6632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947436e39f80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6632:1870622732913024:0@lo:1000:mdt00_003.0 00000001:00080000:3.0:1783965097.917692:0:6632:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:3.0:1783965097.917782:0:6632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e217100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6632:1870622732913152:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1783965097.917844:0:6632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783965097.917872:0:6632:0:(client.c:2702:ptlrpc_set_wait()) set ffff947436de0600 going to sleep for 11 seconds 00000100:00100000:1.0:1783965097.918263:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732913152 00000100:00100000:1.0:1783965097.918272:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732913152 00000100:00100000:1.0:1783965097.918308:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783965097.918316:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e215880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6632:x1870622732913152:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1783965097.918580:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e215880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6632:x1870622732913152:12345-0@lo:1000:mdt00_003.0 Request processed in 264us (734us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1783965097.918588:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1783965097.918836:0:6632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e217100 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6632:1870622732913152:0@lo:1000:mdt00_003.0 00010000:00010000:3.0:1783965097.918883:0:6632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eee00/0xe782b916994fdcfd lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965097.918895:0:6632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eee00/0xe782b916994fdcfd lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965097.918904:0:6632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eee00/0xe782b916994fdcfd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965097.918911:0:6632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743d9eee00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1783965097.918918:0:6632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eee00/0xe782b916994fdcfd lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965097.918926:0:6632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eee00/0xe782b916994fdcfd lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965097.918946:0:6632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff947402a2d300) 00010000:00010000:3.0:1783965097.918949:0:6632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783965097.918955:0:6632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eee00/0xe782b916994fdcfd lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965097.918962:0:6632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eee00/0xe782b916994fdcfd lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965097.919021:0:6632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994fdc40 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965097.919028:0:6632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994fdc40 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965097.919034:0:6632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994fdc40 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965097.919039:0:6632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743d9ee800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1783965097.919042:0:6632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994fdc40 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965097.919048:0:6632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994fdc40 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965097.919057:0:6632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94740a90c900) 00010000:00010000:3.0:1783965097.919059:0:6632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783965097.919068:0:6632:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e000/0xe782b916994fdc47 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f00cf expref: 18 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965097.919081:0:6632:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e000/0xe782b916994fdc47 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f00cf expref: 18 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965097.919092:0:6632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e000/0xe782b916994fdc47 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f00cf expref: 18 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965097.919128:0:6632:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e000/0xe782b916994fdc47 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f00cf expref: 18 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783965097.919154:0:6632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e214700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6632:1870622732913280:192.168.204.12@tcp:105: 00000100:00100000:3.0:1783965097.919423:0:6632:0:(client.c:2702:ptlrpc_set_wait()) set ffff947436de0600 going to sleep for 11 seconds 00000100:00100000:3.0:1783965097.927537:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965097.928319:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715078656 00000100:00100000:2.0:1783965097.928335:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715078656 00000100:00100000:2.0:1783965097.928416:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 31 00000100:00100000:2.0:1783965097.928428:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e217b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9923189b-eb4a-470c-ab45-969435371000+19:10524:x1870622715078656:12345-192.168.204.12@tcp:49:lfs.0 00000100:00100000:2.0:1783965097.928612:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e217b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9923189b-eb4a-470c-ab45-969435371000+19:10524:x1870622715078656:12345-192.168.204.12@tcp:49:lfs.0 Request processed in 187us (1089us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965097.928621:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 31 00000100:00100000:0.0:1783965097.930912:0:6632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e214700 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6632:1870622732913280:192.168.204.12@tcp:105: 00010000:00010000:0.0:1783965097.930958:0:6632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994fdc40 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965097.930971:0:6632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994fdc40 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965097.931031:0:6632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fd400/0xe782b916994fdd04 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965097.931050:0:6632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fd400/0xe782b916994fdd04 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965097.931064:0:6632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fd400/0xe782b916994fdd04 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965097.931076:0:6632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fd400/0xe782b916994fdd04 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965097.931084:0:6632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fd400/0xe782b916994fdd04 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965097.931114:0:6632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fd400/0xe782b916994fdd04 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965097.931121:0:6632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743e2fd400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1783965097.931126:0:6632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fd400/0xe782b916994fdd04 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965097.931136:0:6632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fd400/0xe782b916994fdd04 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965097.931151:0:6632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94740a90c900) 00010000:00010000:0.0:1783965097.931155:0:6632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783965097.931159:0:6632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fd400/0xe782b916994fdd04 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965097.931166:0:6632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fd400/0xe782b916994fdd04 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965097.931184:0:6632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efc00/0xe782b916994fdcf6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965097.931191:0:6632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efc00/0xe782b916994fdcf6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965097.931196:0:6632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efc00/0xe782b916994fdcf6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965097.931473:0:6632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743d9efc00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1783965097.931477:0:6632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efc00/0xe782b916994fdcf6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965097.931494:0:6632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efc00/0xe782b916994fdcf6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965097.931505:0:6632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94740a90c900) 00010000:00010000:0.0:1783965097.931508:0:6632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00000100:00100000:2.0:1783965097.931619:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00010000:00010000:0.0:1783965097.931694:0:6632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efc00/0xe782b916994fdcf6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965097.931702:0:6632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efc00/0xe782b916994fdcf6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783965097.931709:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715078912 00000100:00100000:3.0:1783965097.931720:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715078912 00000100:00100000:3.0:1783965097.931785:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 128 00000100:00100000:3.0:1783965097.931796:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e2c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9923189b-eb4a-470c-ab45-969435371000+19:10524:x1870622715078912:12345-192.168.204.12@tcp:58:lfs.0 00000100:00100000:0.0:1783965097.932295:0:6632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436e38a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9923189b-eb4a-470c-ab45-969435371000+19:10525:x1870622715078400:12345-192.168.204.12@tcp:57:lhsmtool_posix.0 Request processed in 27667us (28007us total) trans 4294967406 rc 0/0 00000100:00100000:0.0:1783965097.932306:0:6632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 127 00000020:00080000:0.0:1783965097.932434:0:6632:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1783965097.932458:0:5813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:3.0:1783965097.932512:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e2c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9923189b-eb4a-470c-ab45-969435371000+18:10524:x1870622715078912:12345-192.168.204.12@tcp:58:lfs.0 Request processed in 716us (895us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965097.932519:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 128 00000040:00080000:1.0:1783965097.934183:0:11561:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1783965097.934194:0:11561:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1783965097.934868:0:11561:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1783965097.934878:0:11561:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1783965097.935298:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965097.936264:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715079168 00000100:00100000:3.0:1783965097.936280:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715079168 00000100:00100000:3.0:1783965097.936357:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 32 00000100:00100000:3.0:1783965097.936370:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94740638b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9923189b-eb4a-470c-ab45-969435371000+19:10525:x1870622715079168:12345-192.168.204.12@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1783965097.936727:0:11561:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947437072680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11561:1870622732913408:192.168.204.12@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1783965097.936961:0:11561:0:(client.c:2702:ptlrpc_set_wait()) set ffff94743709e3c0 going to sleep for 11 seconds 00000004:00080000:3.0:1783965097.937260:0:5814:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1783965097.937389:0:5814:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:0.0:1783965097.942461:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fc800/0xe782b916994fdd0b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965097.942495:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fc800/0xe782b916994fdd0b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965097.942521:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fc800/0xe782b916994fdd0b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965097.942534:0:5814:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fc800/0xe782b916994fdd0b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965097.942541:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fc800/0xe782b916994fdd0b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965097.942548:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fc800/0xe782b916994fdd0b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965097.942596:0:5814:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1783965097.942775:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94740638b050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9923189b-eb4a-470c-ab45-969435371000+21:10525:x1870622715079168:12345-192.168.204.12@tcp:35:lhsmtool_posix.0 Request processed in 6397us (7473us total) trans 4294967408 rc 0/0 00000100:00100000:0.0:1783965097.942798:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 32 00000020:00080000:0.0:1783965097.942807:0:5814:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1783965097.943024:0:5800:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783965097.943034:0:5800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fc800/0xe782b916994fdd0b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965097.943044:0:5800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743e2fc800 already unused, calling callback (ffffffffc168d230) 00010000:00010000:3.0:1783965097.943048:0:5800:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fc800/0xe782b916994fdd0b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965097.943057:0:5800:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fc800/0xe782b916994fdd0b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965097.943080:0:5800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff94740a90c800) 00010000:00010000:3.0:1783965097.943084:0:5800:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1783965097.943089:0:5800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fc800/0xe782b916994fdd0b lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965097.943096:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fc800/0xe782b916994fdd0b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965097.943123:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783965097.943124:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783965097.943126:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783965097.943842:0:11561:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947437072680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11561:1870622732913408:192.168.204.12@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1783965097.944726:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783965097.944930:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715079296 00000100:00100000:0.0:1783965097.944942:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715079296 00000100:00100000:0.0:1783965097.945012:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 129 00000100:00100000:0.0:1783965097.945024:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e2c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9923189b-eb4a-470c-ab45-969435371000+20:10526:x1870622715079296:12345-192.168.204.12@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1783965097.945069:0:5812:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1783965097.945582:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e2c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9923189b-eb4a-470c-ab45-969435371000+20:10526:x1870622715079296:12345-192.168.204.12@tcp:53:lhsmtool_posix.0 Request processed in 557us (859us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965097.945593:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 129 00000100:00100000:2.0:1783965097.951682:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965097.952023:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715079552 00000100:00100000:3.0:1783965097.952036:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715079552 00000100:00100000:3.0:1783965097.952160:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 130 00000100:00100000:3.0:1783965097.952173:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e2c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9923189b-eb4a-470c-ab45-969435371000+20:10526:x1870622715079552:12345-192.168.204.12@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783965097.952246:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783965097.952275:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26800/0xe782b916994fdd12 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5f0107 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965097.952413:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27400/0xe782b916994fdd19 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965097.952433:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27400/0xe782b916994fdd19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965097.952448:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27400/0xe782b916994fdd19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783965097.952462:0:5813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1783965097.952642:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26800/0xe782b916994fdd12 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0107 expref: 23 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965097.952676:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27400/0xe782b916994fdd19 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0107 expref: 22 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965097.952687:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94740a90c900) 00010000:00010000:3.0:1783965097.952690:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1783965097.952695:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff947436f27400, rc 0) 00000100:00100000:3.0:1783965097.952777:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e2c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9923189b-eb4a-470c-ab45-969435371000+22:10526:x1870622715079552:12345-192.168.204.12@tcp:101:lhsmtool_posix.0 Request processed in 608us (1112us total) trans 4294967409 rc 0/0 00000100:00100000:3.0:1783965097.952786:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 130 00000100:00100000:2.0:1783965097.961744:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965097.961942:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715079808 00000100:00100000:1.0:1783965097.961955:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715079808 00000100:00100000:1.0:1783965097.962042:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 131 00000100:00100000:1.0:1783965097.962055:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e2c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9923189b-eb4a-470c-ab45-969435371000+22:10526:x1870622715079808:12345-192.168.204.12@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1783965097.962182:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eea00/0xe782b916994fdd27 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.962891:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eea00/0xe782b916994fdd27 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.962915:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eea00/0xe782b916994fdd27 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.963192:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eea00/0xe782b916994fdd27 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.964089:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eea00/0xe782b916994fdd27 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.964154:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eea00/0xe782b916994fdd27 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.964185:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743d9eea00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1783965097.964191:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eea00/0xe782b916994fdd27 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.964937:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eea00/0xe782b916994fdd27 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.964971:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94740a90c900) 00010000:00010000:1.0:1783965097.964974:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1783965097.964982:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eea00/0xe782b916994fdd27 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.964989:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eea00/0xe782b916994fdd27 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783965097.965605:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e2c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9923189b-eb4a-470c-ab45-969435371000+23:10526:x1870622715079808:12345-192.168.204.12@tcp:57:lhsmtool_posix.0 Request processed in 3543us (3865us total) trans 4294967410 rc 0/0 00000100:00100000:1.0:1783965097.965619:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 131 00000040:00080000:2.0:1783965097.968551:0:11561:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783965097.968565:0:11561:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783965097.969065:0:11561:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1783965097.969078:0:11561:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1783965097.971548:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965097.973088:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715080064 00000100:00100000:3.0:1783965097.973169:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715080064 00000100:00100000:2.0:1783965097.976087:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 33 00000100:00100000:2.0:1783965097.976352:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e2c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9923189b-eb4a-470c-ab45-969435371000+23:10526:x1870622715080064:12345-192.168.204.12@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1783965097.977179:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e2c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9923189b-eb4a-470c-ab45-969435371000+24:10526:x1870622715080064:12345-192.168.204.12@tcp:35:lhsmtool_posix.0 Request processed in 1072us (5639us total) trans 4294967411 rc 0/0 00000100:00100000:2.0:1783965097.977193:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 33 00000100:00100000:3.0:1783965097.985700:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783965097.986528:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715080192 00000100:00100000:0.0:1783965097.986545:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715080192 00000100:00100000:0.0:1783965097.986629:0:6632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 132 00000100:00100000:0.0:1783965097.986641:0:6632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e215c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9923189b-eb4a-470c-ab45-969435371000+24:10528:x1870622715080192:12345-192.168.204.12@tcp:101:lfs.0 00010000:00010000:0.0:1783965097.986670:0:6632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783965097.986698:0:6632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fd000/0xe782b916994fdd2e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5f010e expref: -99 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965097.986791:0:6632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fde00/0xe782b916994fdd35 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965097.986811:0:6632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fde00/0xe782b916994fdd35 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965097.986855:0:6632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fde00/0xe782b916994fdd35 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965097.986874:0:6632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fdc00/0xe782b916994fdd3c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965097.986881:0:6632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fdc00/0xe782b916994fdd3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965097.986888:0:6632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fdc00/0xe782b916994fdd3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965097.988807:0:6632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fd200/0xe782b916994fdd43 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965097.988846:0:6632:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff947430c10e00/0xe782b916994fdc32 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f00c8 expref: 25 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965097.988858:0:6632:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fd200/0xe782b916994fdd43 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965097.988914:0:6632:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff947430c10e00/0xe782b916994fdc32 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f00c8 expref: 25 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965097.988933:0:6632:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff947430c10e00/0xe782b916994fdc32 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f00c8 expref: 25 pid: 6632 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783965097.988951:0:6632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947436e3a680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6632:1870622732913536:192.168.204.12@tcp:104: 00000100:00100000:0.0:1783965097.989093:0:6632:0:(client.c:2702:ptlrpc_set_wait()) set ffff94743fb23e40 going to sleep for 11 seconds 00000100:00100000:0.0:1783965097.993417:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965097.993568:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715080448 00000100:00100000:3.0:1783965097.993593:0:6632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947436e3a680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6632:1870622732913536:192.168.204.12@tcp:104: 00010000:00010000:3.0:1783965097.993643:0:6632:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fd200/0xe782b916994fdd43 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783965097.993765:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715080448 00000100:00100000:2.0:1783965097.993958:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 34 00000100:00100000:2.0:1783965097.993971:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436e39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9923189b-eb4a-470c-ab45-969435371000+26:5571:x1870622715080448:12345-192.168.204.12@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1783965097.994334:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436e39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9923189b-eb4a-470c-ab45-969435371000+27:5571:x1870622715080448:12345-192.168.204.12@tcp:35:ldlm_bl.0 Request processed in 363us (938us total) trans 4294967412 rc 0/0 00000100:00100000:2.0:1783965097.994343:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 34 00000100:00100000:2.0:1783965097.996934:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965097.997102:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715080576 00000100:00100000:1.0:1783965097.997116:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715080576 00010000:00010000:1.0:1783965097.997171:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff947430c10e00/0xe782b916994fdc32 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f00c8 expref: 27 pid: 6632 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783965097.997392:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 60 00000100:00100000:1.0:1783965097.997404:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94741843cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9923189b-eb4a-470c-ab45-969435371000+27:2359:x1870622715080576:12345-192.168.204.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783965097.997426:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783965097.997435:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff947430c10e00/0xe782b916994fdc32 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f00c8 expref: 27 pid: 6632 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.997476:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff947430c10e00/0xe782b916994fdc32 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f00c8 expref: 27 pid: 6632 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.997510:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947430c10e00/0xe782b916994fdc32 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f00c8 expref: 27 pid: 6632 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.997533:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94740a90c900) 00010000:00010000:1.0:1783965097.997540:0:5797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fd200/0xe782b916994fdd43 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.997552:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fd200/0xe782b916994fdd43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.997563:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fd200/0xe782b916994fdd43 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965097.997599:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783965097.997673:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94741843cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9923189b-eb4a-470c-ab45-969435371000+26:2359:x1870622715080576:12345-192.168.204.12@tcp:103:ldlm_bl.0 Request processed in 271us (755us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965097.997682:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 60 00010000:00010000:3.0:1783965097.997879:0:6632:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fd200/0xe782b916994fdd43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965097.997889:0:6632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fd200/0xe782b916994fdd43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783965097.997945:0:6632:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1783965097.997950:0:6632:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1783965097.997976:0:6632:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fd200/0xe782b916994fdd43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965097.998006:0:6632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fd200/0xe782b916994fdd43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965097.998017:0:6632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fde00/0xe782b916994fdd35 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965097.998025:0:6632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fde00/0xe782b916994fdd35 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965097.998032:0:6632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fde00/0xe782b916994fdd35 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965097.998039:0:6632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743e2fde00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1783965097.998044:0:6632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fde00/0xe782b916994fdd35 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965097.998053:0:6632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fde00/0xe782b916994fdd35 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965097.998063:0:6632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9474186e7a00) 00010000:00010000:3.0:1783965097.998066:0:6632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783965097.998071:0:6632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fde00/0xe782b916994fdd35 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965097.998077:0:6632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fde00/0xe782b916994fdd35 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965097.998097:0:6632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fdc00/0xe782b916994fdd3c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965097.998104:0:6632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fdc00/0xe782b916994fdd3c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965097.998116:0:6632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fdc00/0xe782b916994fdd3c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965097.998122:0:6632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743e2fdc00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1783965097.998126:0:6632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fdc00/0xe782b916994fdd3c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965097.998132:0:6632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fdc00/0xe782b916994fdd3c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965097.998141:0:6632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff94740a90c500) 00010000:00010000:3.0:1783965097.998143:0:6632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783965097.998146:0:6632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fdc00/0xe782b916994fdd3c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965097.998152:0:6632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fdc00/0xe782b916994fdd3c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965097.998223:0:6632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fd000/0xe782b916994fdd2e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f010e expref: 26 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965097.998247:0:6632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fd200/0xe782b916994fdd43 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f010e expref: 25 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965097.998256:0:6632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94740a90c900) 00010000:00010000:3.0:1783965097.998258:0:6632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783965097.998261:0:6632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94743e2fd200, rc 0) 00000100:00100000:3.0:1783965097.998316:0:6632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e215c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9923189b-eb4a-470c-ab45-969435371000+25:10528:x1870622715080192:12345-192.168.204.12@tcp:101:lfs.0 Request processed in 11676us (12631us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965097.998333:0:6632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 132 00000100:00100000:1.0:1783965098.552460:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947437070a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3323:1870622732913664:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783965098.552559:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783965098.552656:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732913664 00000100:00100000:1.0:1783965098.552665:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732913664 00000100:00100000:1.0:1783965098.552748:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1783965098.552759:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947437070380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3323:x1870622732913664:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1783965098.552788:0:6611:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783965098.552861:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947437070380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3323:x1870622732913664:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965098.552868:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:1.0:1783965098.552895:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783965098.552942:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947437070a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3323:1870622732913664:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1783965098.668033:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1783965098.792657:0:11983:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1783965098.792672:0:11983:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1783965098.792725:0:11983:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1783965098.792731:0:11983:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1783965098.874350:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965098.874395:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965098.874416:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965098.874454:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965098.874493:0:6609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715081088 00000100:00100000:3.0:1783965098.874501:0:6609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715081088 00000100:00100000:3.0:1783965098.874584:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 63 00000100:00100000:0.0:1783965098.874587:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715080832 00000100:00100000:3.0:1783965098.874597:0:6609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e214a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9923189b-eb4a-470c-ab45-969435371000+6:2359:x1870622715081088:12345-192.168.204.12@tcp:400:kworker.0 00000100:00100000:0.0:1783965098.874601:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715080832 00000100:00100000:3.0:1783965098.874683:0:6609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e214a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9923189b-eb4a-470c-ab45-969435371000+6:2359:x1870622715081088:12345-192.168.204.12@tcp:400:kworker.0 Request processed in 89us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965098.874691:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 63 00000100:00100000:3.0:1783965098.874719:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715081216 00000100:00100000:3.0:1783965098.874724:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715081216 00000100:00100000:0.0:1783965098.874780:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 135 00000100:00100000:0.0:1783965098.874795:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e216d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9923189b-eb4a-470c-ab45-969435371000+25:2359:x1870622715080832:12345-192.168.204.12@tcp:400:kworker.0 00000100:00100000:0.0:1783965098.874884:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e216d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9923189b-eb4a-470c-ab45-969435371000+25:2359:x1870622715080832:12345-192.168.204.12@tcp:400:kworker.0 Request processed in 95us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965098.874893:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 135 00000100:00100000:0.0:1783965098.874912:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 136 00000100:00100000:0.0:1783965098.874920:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e214000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49bbacc1-b013-4591-8d15-02f4f0d1884e+5:2359:x1870622715081216:12345-192.168.204.12@tcp:400:kworker.0 00000100:00080000:3.0:1783965098.874942:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783965098.874949:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783965098.874972:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e214000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49bbacc1-b013-4591-8d15-02f4f0d1884e+5:2359:x1870622715081216:12345-192.168.204.12@tcp:400:kworker.0 Request processed in 51us (516us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965098.874981:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 136 00000100:00100000:1.0:1783965098.875583:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715080704 00000100:00100000:1.0:1783965098.875592:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715080704 00000100:00100000:1.0:1783965098.875629:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 287 00000100:00100000:1.0:1783965098.875637:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947408ec8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+13:2360:x1870622715080704:12345-192.168.204.12@tcp:400:kworker.0 00000100:00100000:1.0:1783965098.875685:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947408ec8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+13:2360:x1870622715080704:12345-192.168.204.12@tcp:400:kworker.0 Request processed in 49us (1345us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965098.875692:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 287 00000100:00100000:3.0:1783965098.875961:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965098.877881:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715080960 00000100:00100000:1.0:1783965098.877897:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715080960 00000100:00100000:1.0:1783965098.877983:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 64 00000100:00100000:1.0:1783965098.877996:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e215f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9923189b-eb4a-470c-ab45-969435371000+7:2360:x1870622715080960:12345-192.168.204.12@tcp:400:kworker.0 00000100:00100000:1.0:1783965098.878088:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e215f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9923189b-eb4a-470c-ab45-969435371000+7:2360:x1870622715080960:12345-192.168.204.12@tcp:400:kworker.0 Request processed in 95us (2131us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965098.878096:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 64 00000100:00080000:0.0:1783965098.880925:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783965098.930672:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965098.931331:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715081472 00000100:00100000:1.0:1783965098.931347:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715081472 00000100:00100000:1.0:1783965098.931425:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 133 00000100:00100000:1.0:1783965098.931438:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e214380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9923189b-eb4a-470c-ab45-969435371000+25:10551:x1870622715081472:12345-192.168.204.12@tcp:101:lfs.0 00010000:00010000:1.0:1783965098.931483:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783965098.931515:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee400/0xe782b916994fdd4a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5f0115 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965098.931676:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee000/0xe782b916994fdd51 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965098.931696:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee000/0xe782b916994fdd51 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965098.931713:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee000/0xe782b916994fdd51 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783965098.931728:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1783965098.931918:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee400/0xe782b916994fdd4a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0115 expref: 28 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965098.931951:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee000/0xe782b916994fdd51 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0115 expref: 27 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965098.931963:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94740a90c900) 00010000:00010000:1.0:1783965098.931967:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1783965098.931971:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94743d9ee000, rc 0) 00000100:00100000:1.0:1783965098.932054:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e214380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9923189b-eb4a-470c-ab45-969435371000+27:10551:x1870622715081472:12345-192.168.204.12@tcp:101:lfs.0 Request processed in 618us (1396us total) trans 4294967413 rc 0/0 00000100:00100000:1.0:1783965098.932063:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 133 00000100:00100000:3.0:1783965098.947795:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965098.947906:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715081600 00000100:00100000:1.0:1783965098.947919:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715081600 00000100:00100000:1.0:1783965098.947995:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 134 00000100:00100000:1.0:1783965098.948015:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e216680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9923189b-eb4a-470c-ab45-969435371000+27:10551:x1870622715081600:12345-192.168.204.12@tcp:54:lfs.0 00010000:00010000:1.0:1783965098.948109:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eec00/0xe782b916994fdd5f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965098.948132:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eec00/0xe782b916994fdd5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965098.948147:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eec00/0xe782b916994fdd5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965098.948182:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eec00/0xe782b916994fdd5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965098.948191:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eec00/0xe782b916994fdd5f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965098.948197:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eec00/0xe782b916994fdd5f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965098.948233:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743d9eec00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1783965098.948239:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eec00/0xe782b916994fdd5f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965098.948247:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eec00/0xe782b916994fdd5f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965098.948262:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94740a90c900) 00010000:00010000:1.0:1783965098.948266:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783965098.948273:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eec00/0xe782b916994fdd5f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965098.948280:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eec00/0xe782b916994fdd5f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783965098.948394:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e216680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9923189b-eb4a-470c-ab45-969435371000+27:10551:x1870622715081600:12345-192.168.204.12@tcp:54:lfs.0 Request processed in 380us (613us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965098.948403:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 134 00000100:00100000:0.0:1783965099.050746:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965099.050907:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715081728 00000100:00100000:2.0:1783965099.050920:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715081728 00000100:00100000:2.0:1783965099.051073:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 46 00000100:00100000:2.0:1783965099.051094:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436e3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9923189b-eb4a-470c-ab45-969435371000+6:2359:x1870622715081728:12345-192.168.204.12@tcp:101:cat.0 00010000:00010000:2.0:1783965099.051118:0:6608:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783965099.051148:0:6608:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006834d07f/0xe782b916994fdd66 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5f011c expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783965099.051185:0:6608:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a5525a9, atime: 0x6a5525a8, ctime: 0x6a5525a9, blocks: 0xb 00010000:00010000:2.0:1783965099.051246:0:6608:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=333s v=(0 0) 00010000:00010000:2.0:1783965099.051252:0:6608:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783965099.051265:0:6608:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006834d07f/0xe782b916994fdd66 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f011c expref: 7 pid: 6608 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965099.051314:0:6608:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006834d07f/0xe782b916994fdd66 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f011c expref: 7 pid: 6608 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965099.051331:0:6608:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94743fb8f400, rc 0) 00000100:00100000:2.0:1783965099.051410:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436e3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9923189b-eb4a-470c-ab45-969435371000+7:2359:x1870622715081728:12345-192.168.204.12@tcp:101:cat.0 Request processed in 320us (683us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965099.051419:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 46 00000100:00100000:3.0:1783965099.056112:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965099.060481:0:6613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715081856 00000100:00100000:2.0:1783965099.060500:0:6613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715081856 00002000:00100000:2.0:1783965099.060573:0:6613:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff94743e214e00 x1870622715081856/t0(0) o3->9923189b-eb4a-470c-ab45-969435371000@192.168.204.12@tcp:525/0 lens 488/0 e 0 to 0 dl 1783965110 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783965099.060586:0:6613:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff94743e214e00 with x1870622715081856 ext(0->4095) 00002000:00010000:2.0:1783965099.060592:0:6613:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff94743e214e00 00000100:00100000:2.0:1783965099.060926:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 3 00000100:00100000:2.0:1783965099.060938:0:6613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e214e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9923189b-eb4a-470c-ab45-969435371000+7:2360:x1870622715081856:12345-192.168.204.12@tcp:3:cat.0 00000100:00100000:2.0:1783965099.061182:0:6613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e214e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9923189b-eb4a-470c-ab45-969435371000+7:2360:x1870622715081856:12345-192.168.204.12@tcp:3:cat.0 Request processed in 246us (5079us total) trans 0 rc 4096/4096 00000100:00100000:2.0:1783965099.061190:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 3 00002000:00100000:2.0:1783965099.062897:0:6613:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff94743e214e00 x1870622715081856/t0(0) o3->9923189b-eb4a-470c-ab45-969435371000@192.168.204.12@tcp:525/0 lens 488/4536 e 0 to 0 dl 1783965110 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783965099.062918:0:6613:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff94743e214e00 with x1870622715081856 ext(0->4095) 00002000:00010000:2.0:1783965099.062926:0:6613:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff94743e214e00 00010000:00010000:3.0:1783965099.692348:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783965100.716601:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1783965101.207805:0:6637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:1.0:1783965101.207831:0:6637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000004:00080000:1.0:1783965101.611390:0:7973:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 335840184439ns, next at 336840181352ns, rc = 0 00000100:00100000:1.0:1783965101.611433:0:3325:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783965101.611462:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947437070a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3325:1870622732913792:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783965101.611561:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783965101.611653:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732913792 00000100:00100000:1.0:1783965101.611663:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732913792 00000100:00100000:1.0:1783965101.611732:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1783965101.611743:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947437070e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3325:x1870622732913792:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783965101.611805:0:6611:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783965101.611853:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947437070e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3325:x1870622732913792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 112us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965101.611859:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00080000:1.0:1783965101.611882:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783965101.611918:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947437070a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3325:1870622732913792:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783965101.614043:0:3324:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1783965101.615023:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e217800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ae0997f7-3a15-4fc6-865a-35b2f101956e:3324:1870622732913920:0@lo:400:kworker.0 00000100:00100000:3.0:1783965101.615628:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783965101.615747:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e216a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3322:1870622732914048:0@lo:400:kworker.0 00000100:00100000:3.0:1783965101.615796:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783965101.615862:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732914048 00000100:00100000:3.0:1783965101.615871:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732914048 00000100:00100000:3.0:1783965101.615934:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1783965101.615945:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e215180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3322:x1870622732914048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783965101.616001:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732913920 00000100:00100000:0.0:1783965101.616006:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732913920 00000100:00100000:3.0:1783965101.616007:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e215180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3322:x1870622732914048:12345-0@lo:400:kworker.0 Request processed in 64us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965101.616015:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1783965101.616036:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:0.0:1783965101.616043:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947408ecac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae0997f7-3a15-4fc6-865a-35b2f101956e+19:3324:x1870622732913920:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783965101.616086:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947408ecac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae0997f7-3a15-4fc6-865a-35b2f101956e+19:3324:x1870622732913920:12345-0@lo:400:kworker.0 Request processed in 44us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965101.616093:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:0.0:1783965101.616662:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e2c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3323:1870622732914176:0@lo:400:kworker.0 00000100:00100000:2.0:1783965101.616686:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e216a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3322:1870622732914048:0@lo:400:kworker.0 00000100:00100000:0.0:1783965101.616700:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783965101.616735:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e2c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3324:1870622732914304:0@lo:400:kworker.0 00000100:00100000:2.0:1783965101.616786:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783965101.616840:0:8738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732914304 00000100:00100000:0.0:1783965101.616845:0:8738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732914304 00000100:00100000:2.0:1783965101.616890:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e217800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ae0997f7-3a15-4fc6-865a-35b2f101956e:3324:1870622732913920:0@lo:400:kworker.0 00000100:00100000:0.0:1783965101.616896:0:8738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1783965101.616904:0:3324:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783965101.616904:0:8738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e2c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3324:x1870622732914304:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783965101.616909:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e2c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3324:1870622732914432:0@lo:400:kworker.0 00000100:00100000:2.0:1783965101.616933:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783965101.616938:0:8738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e2c0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3324:x1870622732914304:12345-0@lo:400:kworker.0 Request processed in 36us (153us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965101.616945:0:8738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1783965101.616955:0:3324:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:2.0:1783965101.616963:0:3324:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:2.0:1783965101.616980:0:3324:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94743e2c2a00, transno 4294967304 00000100:00100000:2.0:1783965101.617001:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e2c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3324:1870622732914304:0@lo:400:kworker.0 00000100:00100000:2.0:1783965101.617028:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732914176 00000100:00100000:1.0:1783965101.617246:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732914432 00000100:00100000:1.0:1783965101.617252:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732914432 00000100:00100000:1.0:1783965101.617706:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1783965101.617718:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e2c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3324:x1870622732914432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783965101.617793:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e2c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3324:x1870622732914432:12345-0@lo:400:kworker.0 Request processed in 79us (858us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965101.617821:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00080000:1.0:1783965101.617854:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783965101.617860:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783965101.617987:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e2c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3324:1870622732914432:0@lo:400:kworker.0 00000100:00100000:2.0:1783965101.618328:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732914176 00000100:00100000:2.0:1783965101.618372:0:6632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1783965101.618380:0:6632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436e38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3323:x1870622732914176:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783965101.618433:0:6632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436e38000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3323:x1870622732914176:12345-0@lo:400:kworker.0 Request processed in 55us (1733us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965101.618441:0:6632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1783965101.618480:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e2c3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3323:1870622732914176:0@lo:400:kworker.0 00000100:00080000:1.0:1783965101.618635:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1783965101.745594:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783965102.763564:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1783965103.210686:0:7523:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000001:00080000:2.0:1783965103.210705:0:7523:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000001:00080000:2.0:1783965103.210713:0:7523:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:1.0:1783965103.251322:0:5835:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967405 is committed 00000004:00080000:1.0:1783965103.251346:0:5835:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000001:00080000:1.0:1783965103.251359:0:5835:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:1.0:1783965103.251399:0:5835:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9473048c2180 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:1.0:1783965103.251405:0:5835:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff947436b68700 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9473048c2840 00000020:00080000:1.0:1783965103.251408:0:5835:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff947436b68800 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff947436498c00 00000020:00080000:1.0:1783965103.251423:0:5835:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:1.0:1783965103.251437:0:5846:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:1.0:1783965103.251688:0:5846:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000100:00100000:0.0:1783965103.251943:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947436e3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3322:1870622732914560:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1783965103.252039:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783965103.252126:0:11945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732914560 00000100:00100000:0.0:1783965103.252134:0:11945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732914560 00000100:00100000:0.0:1783965103.252237:0:11945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1783965103.252249:0:11945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e2a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3322:x1870622732914560:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1783965103.252486:0:11945:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1783965103.252490:0:11945:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 1783965097 -> 1783965097 00002000:00010000:0.0:1783965103.252493:0:11945:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 1783965096 -> 1783965096 00002000:00010000:0.0:1783965103.252495:0:11945:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1783965097 -> 1783965097 00002000:00010000:0.0:1783965103.252498:0:11945:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1783965103.252543:0:11945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e2a4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+6:3322:x1870622732914560:12345-0@lo:2:osp-syn-1-0.0 Request processed in 296us (504us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1783965103.252551:0:11945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:0.0:1783965103.252576:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1783965103.252610:0:3322:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:0.0:1783965103.252616:0:3322:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff947436e3bb80, transno 4294967309 00000004:00080000:0.0:1783965103.252624:0:3322:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967311 committed transno 4294967311 00000100:00100000:0.0:1783965103.252649:0:3322:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff947436e3a680 x1870622732914560/t4294967312(4294967312) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1783965119 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:0.0:1783965103.252684:0:3322:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff947436e3a680/2, rc 0, transno 4294967312 00000100:00100000:0.0:1783965103.252690:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947436e3a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3322:1870622732914560:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1783965103.660871:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e217b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3323:1870622732914688:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783965103.660977:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783965103.661083:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732914688 00000100:00100000:3.0:1783965103.661093:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732914688 00000100:00100000:3.0:1783965103.661166:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1783965103.661177:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e214700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3323:x1870622732914688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783965103.661736:0:6611:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783965103.661813:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e214700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3323:x1870622732914688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 637us (835us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965103.661822:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:3.0:1783965103.661852:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783965103.661908:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e217b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3323:1870622732914688:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1783965103.800011:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783965103.980943:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965103.981079:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715081984 00000100:00100000:2.0:1783965103.981092:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715081984 00000100:00100000:2.0:1783965103.981360:0:6632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 135 00000100:00100000:2.0:1783965103.981375:0:6632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e2a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9923189b-eb4a-470c-ab45-969435371000+14:10204:x1870622715081984:12345-192.168.204.12@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1783965103.981564:0:6632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e2a4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9923189b-eb4a-470c-ab45-969435371000+14:10204:x1870622715081984:12345-192.168.204.12@tcp:60:lhsmtool_posix.0 Request processed in 193us (639us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965103.981578:0:6632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 135 00000100:00080000:3.0:1783965103.982014:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783965103.988367:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965103.988678:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715082240 00000100:00100000:2.0:1783965103.988704:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715082240 00000100:00100000:2.0:1783965103.988795:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 35 00000100:00100000:2.0:1783965103.988808:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e2a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9923189b-eb4a-470c-ab45-969435371000+14:10204:x1870622715082240:12345-192.168.204.12@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1783965103.991590:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e2a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9923189b-eb4a-470c-ab45-969435371000+15:10204:x1870622715082240:12345-192.168.204.12@tcp:35:lhsmtool_posix.0 Request processed in 2766us (3222us total) trans 4294967414 rc 0/0 00000100:00100000:2.0:1783965103.991610:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 35 00000100:00100000:1.0:1783965104.001698:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965104.001757:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965104.001789:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965104.001834:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965104.001849:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715082624 00000100:00100000:2.0:1783965104.001865:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715082624 00000100:00100000:1.0:1783965104.001871:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715082752 00000100:00100000:1.0:1783965104.001877:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715082752 00000100:00100000:2.0:1783965104.001963:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715082496 00000100:00100000:2.0:1783965104.001967:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715082496 00000100:00100000:1.0:1783965104.001972:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 140 00000100:00100000:1.0:1783965104.001987:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947437073b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49bbacc1-b013-4591-8d15-02f4f0d1884e+5:2357:x1870622715082752:12345-192.168.204.12@tcp:400:kworker.0 00000100:00100000:2.0:1783965104.002003:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 66 00000100:00100000:2.0:1783965104.002014:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947437070a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9923189b-eb4a-470c-ab45-969435371000+6:2357:x1870622715082624:12345-192.168.204.12@tcp:400:kworker.0 00000100:00100000:0.0:1783965104.002116:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715082368 00000100:00100000:0.0:1783965104.002121:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715082368 00000100:00100000:0.0:1783965104.002156:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 289 00000100:00100000:0.0:1783965104.002163:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947408ec9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+13:2357:x1870622715082368:12345-192.168.204.12@tcp:400:kworker.0 00000100:00100000:1.0:1783965104.002499:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947437073b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49bbacc1-b013-4591-8d15-02f4f0d1884e+5:2357:x1870622715082752:12345-192.168.204.12@tcp:400:kworker.0 Request processed in 514us (662us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965104.002509:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 140 00000100:00100000:1.0:1783965104.002544:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 67 00000100:00100000:1.0:1783965104.002573:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947437073800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9923189b-eb4a-470c-ab45-969435371000+5:2357:x1870622715082496:12345-192.168.204.12@tcp:400:kworker.0 00000100:00080000:3.0:1783965104.002679:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783965104.002686:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1783965104.002693:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783965104.008908:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947437070a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9923189b-eb4a-470c-ab45-969435371000+6:2357:x1870622715082624:12345-192.168.204.12@tcp:400:kworker.0 Request processed in 6873us (7126us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965104.008936:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 66 00000100:00100000:0.0:1783965104.009103:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947408ec9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+13:2357:x1870622715082368:12345-192.168.204.12@tcp:400:kworker.0 Request processed in 6935us (7417us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965104.009121:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 289 00000100:00100000:1.0:1783965104.009441:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947437073800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9923189b-eb4a-470c-ab45-969435371000+5:2357:x1870622715082496:12345-192.168.204.12@tcp:400:kworker.0 Request processed in 6866us (7647us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965104.009451:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 67 00000100:00100000:0.0:1783965104.289996:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965104.290147:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715082880 00000100:00100000:2.0:1783965104.290160:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715082880 00000100:00100000:2.0:1783965104.290288:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 136 00000100:00100000:2.0:1783965104.290302:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436e3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49bbacc1-b013-4591-8d15-02f4f0d1884e+5:11005:x1870622715082880:12345-192.168.204.12@tcp:101:lsof.0 00010000:00010000:2.0:1783965104.290333:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783965104.290363:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f000/0xe782b916994fdd6d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5f0123 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965104.290475:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fe00/0xe782b916994fdd74 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965104.290493:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fe00/0xe782b916994fdd74 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965104.290507:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fe00/0xe782b916994fdd74 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783965104.290906:0:5813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1783965104.290912:0:5813:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1783965104.291022:0:5813:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fe00/0xe782b916994fdd74 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965104.291057:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f000/0xe782b916994fdd6d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0123 expref: 7 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965104.291079:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fe00/0xe782b916994fdd74 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0123 expref: 6 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965104.291088:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff947407b5c300) 00010000:00010000:2.0:1783965104.291092:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783965104.291096:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94743fb8fe00, rc 0) 00000100:00100000:2.0:1783965104.291183:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436e3bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:49bbacc1-b013-4591-8d15-02f4f0d1884e+6:11005:x1870622715082880:12345-192.168.204.12@tcp:101:lsof.0 Request processed in 884us (1203us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965104.291192:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 136 00010000:00010000:1.0:1783965104.821176:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1783965105.137721:0:11561:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783965105.137737:0:11561:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1783965105.143070:0:11561:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:3.0:1783965105.143091:0:11561:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1783965105.842730:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783965106.732344:0:3325:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1783965106.732379:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947437072680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3325:1870622732914816:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783965106.732474:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783965106.732687:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732914816 00000100:00100000:3.0:1783965106.732698:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732914816 00000100:00100000:3.0:1783965106.732819:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1783965106.732831:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947437071180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3325:x1870622732914816:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783965106.732882:0:6611:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783965106.732942:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947437071180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3325:x1870622732914816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 114us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965106.732952:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1783965106.733004:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947437072680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3325:1870622732914816:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1783965106.733344:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783965106.739612:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9474368d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ae0997f7-3a15-4fc6-865a-35b2f101956e:3325:1870622732914944:0@lo:400:kworker.0 00000100:00100000:2.0:1783965106.739612:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9474368d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3322:1870622732915072:0@lo:400:kworker.0 00000100:00100000:0.0:1783965106.740437:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9474057daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3323:1870622732915200:0@lo:400:kworker.0 00000100:00100000:1.0:1783965106.740491:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9474057d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3324:1870622732915328:0@lo:400:kworker.0 00000100:00100000:2.0:1783965106.742383:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783965106.742498:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732915072 00000100:00100000:2.0:1783965106.742509:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732915072 00000100:00100000:2.0:1783965106.742571:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1783965106.742583:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e2c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3322:x1870622732915072:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783965106.742649:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e2c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3322:x1870622732915072:12345-0@lo:400:kworker.0 Request processed in 68us (275us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965106.742837:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1783965106.742919:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9474368d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3322:1870622732915072:0@lo:400:kworker.0 00000100:00100000:3.0:1783965106.743672:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783965106.743798:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9474057d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3325:1870622732915456:0@lo:400:kworker.0 00000100:00100000:3.0:1783965106.743840:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783965106.743893:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732915456 00000100:00100000:3.0:1783965106.743899:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732915456 00000100:00100000:3.0:1783965106.743953:0:6632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1783965106.743960:0:6632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e217b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3325:x1870622732915456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783965106.744025:0:6632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e217b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3325:x1870622732915456:12345-0@lo:400:kworker.0 Request processed in 64us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965106.744031:0:6632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1783965106.744065:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9474057d8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3325:1870622732915456:0@lo:400:kworker.0 00000100:00080000:3.0:1783965106.744689:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783965106.744916:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732914944 00000100:00100000:2.0:1783965106.744923:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732914944 00000100:00100000:2.0:1783965106.745296:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:2.0:1783965106.745309:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947408ecbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+19:3325:x1870622732914944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783965106.745395:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947408ecbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+19:3325:x1870622732914944:12345-0@lo:400:kworker.0 Request processed in 90us (1738us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965106.745403:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:0.0:1783965106.745527:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783965106.745584:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732915200 00000100:00100000:0.0:1783965106.745588:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732915200 00000100:00100000:3.0:1783965106.745599:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9474368d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ae0997f7-3a15-4fc6-865a-35b2f101956e:3325:1870622732914944:0@lo:400:kworker.0 00000100:00100000:0.0:1783965106.745630:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1783965106.745637:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9474057d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3323:x1870622732915200:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1783965106.745647:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783965106.745689:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9474057d8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3323:x1870622732915200:12345-0@lo:400:kworker.0 Request processed in 52us (163us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965106.745696:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1783965106.745709:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9474057daa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3323:1870622732915200:0@lo:400:kworker.0 00000100:00100000:1.0:1783965106.746387:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783965106.746747:0:6609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732915328 00000100:00100000:0.0:1783965106.746753:0:6609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732915328 00000100:00100000:0.0:1783965106.746872:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1783965106.746881:0:6609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947437071f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3324:x1870622732915328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783965106.746969:0:6609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947437071f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3324:x1870622732915328:12345-0@lo:400:kworker.0 Request processed in 89us (585us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965106.746976:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:3.0:1783965106.748511:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783965106.750523:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9474057d9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3324:1870622732915328:0@lo:400:kworker.0 00010000:00010000:1.0:1783965106.859839:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783965107.894513:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1783965108.028002:0:12187:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 13:51:46 (1783965106) 00000020:00080000:1.0:1783965108.301914:0:5835:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000001:00080000:1.0:1783965108.301940:0:5835:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:1.0:1783965108.301955:0:5846:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:1.0:1783965108.301964:0:5846:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000001:00080000:3.0:1783965108.334455:0:7523:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00000100:00100000:0.0:1783965108.779459:0:3323:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783965108.779485:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e217100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3323:1870622732915584:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783965108.779555:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783965108.779689:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732915584 00000100:00100000:3.0:1783965108.779697:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732915584 00000100:00100000:3.0:1783965108.779769:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1783965108.779779:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9474057db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3323:x1870622732915584:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783965108.779814:0:6611:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783965108.779863:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9474057db800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3323:x1870622732915584:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (308us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965108.779870:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:0.0:1783965108.779968:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783965108.780003:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e217100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3323:1870622732915584:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1783965108.912292:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783965109.114093:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965109.114148:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965109.114181:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965109.114255:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965109.114326:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965109.114328:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715083520 00000100:00100000:1.0:1783965109.114345:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715083520 00000100:00100000:3.0:1783965109.114371:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715083136 00000100:00100000:3.0:1783965109.114380:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715083136 00000100:00100000:1.0:1783965109.114444:0:6632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 144 00000100:00100000:1.0:1783965109.114458:0:6632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e216a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49bbacc1-b013-4591-8d15-02f4f0d1884e+6:2357:x1870622715083520:12345-192.168.204.12@tcp:400:kworker.0 00000100:00100000:0.0:1783965109.114484:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715083008 00000100:00100000:0.0:1783965109.114490:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715083008 00000100:00100000:0.0:1783965109.114545:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 291 00000100:00100000:0.0:1783965109.114557:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947408ec9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+13:2357:x1870622715083008:12345-192.168.204.12@tcp:400:kworker.0 00000100:00100000:1.0:1783965109.114568:0:6632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e216a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49bbacc1-b013-4591-8d15-02f4f0d1884e+6:2357:x1870622715083520:12345-192.168.204.12@tcp:400:kworker.0 Request processed in 107us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965109.114579:0:6632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 144 00000100:00100000:1.0:1783965109.114607:0:6632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 145 00000100:00100000:1.0:1783965109.114630:0:6632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e217100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9923189b-eb4a-470c-ab45-969435371000+14:2357:x1870622715083136:12345-192.168.204.12@tcp:400:kworker.0 00000100:00100000:0.0:1783965109.114640:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947408ec9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+13:2357:x1870622715083008:12345-192.168.204.12@tcp:400:kworker.0 Request processed in 85us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965109.114649:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 291 00000100:00100000:1.0:1783965109.114813:0:6632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e217100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9923189b-eb4a-470c-ab45-969435371000+14:2357:x1870622715083136:12345-192.168.204.12@tcp:400:kworker.0 Request processed in 55us (425us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965109.114870:0:11945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715083264 00000100:00100000:3.0:1783965109.114876:0:11945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715083264 00000100:00100000:1.0:1783965109.114910:0:6632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 145 00000100:00100000:3.0:1783965109.114912:0:11945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715083392 00000100:00100000:3.0:1783965109.114917:0:11945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715083392 00000100:00100000:3.0:1783965109.115017:0:11945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 69 00000100:00100000:3.0:1783965109.115026:0:11945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e217800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9923189b-eb4a-470c-ab45-969435371000+5:2357:x1870622715083264:12345-192.168.204.12@tcp:400:kworker.0 00000100:00100000:3.0:1783965109.115076:0:11945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e217800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9923189b-eb4a-470c-ab45-969435371000+5:2357:x1870622715083264:12345-192.168.204.12@tcp:400:kworker.0 Request processed in 52us (927us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965109.115083:0:11945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 69 00000100:00100000:3.0:1783965109.115100:0:11945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 70 00000100:00100000:3.0:1783965109.115107:0:11945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743d9c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9923189b-eb4a-470c-ab45-969435371000+6:2357:x1870622715083392:12345-192.168.204.12@tcp:400:kworker.0 00000100:00080000:2.0:1783965109.115391:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783965109.115397:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783965109.115400:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783965109.119478:0:11945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743d9c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9923189b-eb4a-470c-ab45-969435371000+6:2357:x1870622715083392:12345-192.168.204.12@tcp:400:kworker.0 Request processed in 4350us (5133us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965109.119498:0:11945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 70 00000100:00100000:3.0:1783965109.400478:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783965109.402106:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715083776 00000100:00100000:0.0:1783965109.402126:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715083776 00000100:00100000:0.0:1783965109.402259:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 137 00000100:00100000:0.0:1783965109.402272:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743d9c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9923189b-eb4a-470c-ab45-969435371000+14:11270:x1870622715083776:12345-192.168.204.12@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783965109.402302:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783965109.402334:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fd800/0xe782b916994fdd7b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5f012a expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965109.402443:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fc400/0xe782b916994fdd82 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965109.402480:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fc400/0xe782b916994fdd82 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965109.402495:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fc400/0xe782b916994fdd82 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965109.402517:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fda00/0xe782b916994fdd89 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965109.402525:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fda00/0xe782b916994fdd89 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965109.402532:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fda00/0xe782b916994fdd89 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965109.403309:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fcc00/0xe782b916994fdd90 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965109.403328:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fcc00/0xe782b916994fdd90 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965109.403338:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fcc00/0xe782b916994fdd90 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783965109.403352:0:5813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:0.0:1783965109.403595:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fc400/0xe782b916994fdd82 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965109.403604:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fc400/0xe782b916994fdd82 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965109.403622:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fc400/0xe782b916994fdd82 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965109.403635:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743e2fc400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1783965109.403640:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fc400/0xe782b916994fdd82 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965109.403649:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fc400/0xe782b916994fdd82 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965109.403665:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9474186e7500) 00010000:00010000:0.0:1783965109.403668:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783965109.403674:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fc400/0xe782b916994fdd82 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965109.403682:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fc400/0xe782b916994fdd82 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965109.403704:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fda00/0xe782b916994fdd89 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965109.403710:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fda00/0xe782b916994fdd89 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965109.403717:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fda00/0xe782b916994fdd89 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965109.403722:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743e2fda00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1783965109.403725:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fda00/0xe782b916994fdd89 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965109.403732:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fda00/0xe782b916994fdd89 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965109.403750:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff94740a90c200) 00010000:00010000:0.0:1783965109.403753:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783965109.403756:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fda00/0xe782b916994fdd89 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965109.403762:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fda00/0xe782b916994fdd89 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965109.409514:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fd800/0xe782b916994fdd7b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f012a expref: 17 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965109.409561:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fcc00/0xe782b916994fdd90 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f012a expref: 16 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965109.409572:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9474186e7d00) 00010000:00010000:0.0:1783965109.409576:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783965109.409581:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94743e2fcc00, rc 0) 00000100:00100000:0.0:1783965109.409701:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743d9c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9923189b-eb4a-470c-ab45-969435371000+16:11270:x1870622715083776:12345-192.168.204.12@tcp:101:lhsmtool_posix.0 Request processed in 7429us (9235us total) trans 4294967415 rc 0/0 00000100:00100000:0.0:1783965109.409711:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 137 00000100:00100000:1.0:1783965109.416638:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965109.416877:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715083904 00000100:00100000:2.0:1783965109.416892:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715083904 00000100:00100000:2.0:1783965109.416999:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 9 00000100:00100000:2.0:1783965109.417044:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947437073480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9923189b-eb4a-470c-ab45-969435371000+16:2357:x1870622715083904:12345-192.168.204.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783965109.417066:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783965109.417104:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fcc00/0xe782b916994fdd90 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f012a expref: 16 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965109.417134:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9474186e7d00) 00010000:00010000:2.0:1783965109.417139:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783965109.417514:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947437073480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9923189b-eb4a-470c-ab45-969435371000+15:2357:x1870622715083904:12345-192.168.204.12@tcp:103:ldlm_bl.0 Request processed in 469us (887us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965109.417524:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 9 00000100:00100000:3.0:1783965109.420813:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783965109.421067:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715084032 00000100:00100000:0.0:1783965109.421080:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715084032 00000100:00100000:0.0:1783965109.421154:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 138 00000100:00100000:0.0:1783965109.421165:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743d9c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9923189b-eb4a-470c-ab45-969435371000+15:11270:x1870622715084032:12345-192.168.204.12@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1783965109.421341:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743d9c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9923189b-eb4a-470c-ab45-969435371000+15:11270:x1870622715084032:12345-192.168.204.12@tcp:59:lhsmtool_posix.0 Request processed in 177us (543us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965109.421350:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 138 00010000:00010000:0.0:1783965109.939087:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1783965110.251464:0:11561:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1783965110.251478:0:11561:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783965110.251523:0:11561:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 3 00000040:00080000:0.0:1783965110.251530:0:11561:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1783965110.955526:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783965111.723293:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965111.723717:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715084160 00000100:00100000:3.0:1783965111.723732:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715084160 00000100:00100000:3.0:1783965111.723885:0:6632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 139 00000100:00100000:3.0:1783965111.723906:0:6632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e2c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9923189b-eb4a-470c-ab45-969435371000+15:11312:x1870622715084160:12345-192.168.204.12@tcp:101:lfs.0 00010000:00010000:3.0:1783965111.723937:0:6632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783965111.723969:0:6632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26800/0xe782b916994fdd9e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5f0131 expref: -99 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965111.724074:0:6632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27800/0xe782b916994fdda5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965111.724103:0:6632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27800/0xe782b916994fdda5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965111.724118:0:6632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27800/0xe782b916994fdda5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965111.724138:0:6632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fddac lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965111.724146:0:6632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fddac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965111.724153:0:6632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fddac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965111.724825:0:6632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27800/0xe782b916994fdda5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965111.724837:0:6632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27800/0xe782b916994fdda5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965111.724846:0:6632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27800/0xe782b916994fdda5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965111.724854:0:6632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947436f27800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1783965111.724860:0:6632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27800/0xe782b916994fdda5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965111.724869:0:6632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27800/0xe782b916994fdda5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965111.724885:0:6632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff947407b5c300) 00010000:00010000:3.0:1783965111.724889:0:6632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783965111.724895:0:6632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27800/0xe782b916994fdda5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965111.724903:0:6632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27800/0xe782b916994fdda5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965111.724919:0:6632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fddac lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965111.724925:0:6632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fddac lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965111.724931:0:6632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fddac lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965111.724944:0:6632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947436f26e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1783965111.724946:0:6632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fddac lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965111.724952:0:6632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fddac lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965111.724961:0:6632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff94740b97a600) 00010000:00010000:3.0:1783965111.724964:0:6632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783965111.724967:0:6632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fddac lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965111.724972:0:6632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fddac lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965111.725017:0:6632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26800/0xe782b916994fdd9e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0131 expref: 16 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965111.725030:0:6632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff947407b5c300) 00010000:00010000:3.0:1783965111.725032:0:6632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783965111.725036:0:6632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26800/0xe782b916994fdd9e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0131 expref: 16 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965111.725046:0:6632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff947436f26800, rc 0) 00000100:00100000:3.0:1783965111.725143:0:6632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e2c1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9923189b-eb4a-470c-ab45-969435371000+15:11312:x1870622715084160:12345-192.168.204.12@tcp:101:lfs.0 Request processed in 1247us (1865us total) trans 0 rc 301/301 00000100:00100000:3.0:1783965111.725153:0:6632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 139 00000100:00100000:3.0:1783965111.729572:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00080000:2.0:1783965111.729853:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783965111.734237:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715084416 00000100:00100000:0.0:1783965111.734260:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715084416 00000100:00100000:0.0:1783965111.734356:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 140 00000100:00100000:0.0:1783965111.734368:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743d9ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9923189b-eb4a-470c-ab45-969435371000+15:11312:x1870622715084416:12345-192.168.204.12@tcp:36:lfs.0 00010000:00010000:0.0:1783965111.734681:0:5812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783965111.734719:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef800/0xe782b916994fd71c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5eff6a expref: 15 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965111.734755:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff947407b5c300) 00010000:00010000:0.0:1783965111.734762:0:5812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783965111.735236:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fc000/0xe782b916994fddb3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965111.735257:0:5812:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fe00/0xe782b916994fdd74 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0123 expref: 5 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965111.735268:0:5812:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fc000/0xe782b916994fddb3 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965111.735320:0:5812:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fe00/0xe782b916994fdd74 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0123 expref: 5 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965111.735339:0:5812:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fe00/0xe782b916994fdd74 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0123 expref: 5 pid: 5813 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783965111.735372:0:5812:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9474057db100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5812:1870622732915712:192.168.204.12@tcp:104: 00000100:00100000:0.0:1783965111.737714:0:5812:0:(client.c:2702:ptlrpc_set_wait()) set ffff94743e29fa80 going to sleep for 11 seconds 00000100:00100000:2.0:1783965111.741002:0:5812:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9474057db100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5812:1870622732915712:192.168.204.12@tcp:104: 00010000:00010000:2.0:1783965111.741043:0:5812:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fc000/0xe782b916994fddb3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783965111.744035:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965111.751055:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715084544 00000100:00100000:3.0:1783965111.751080:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715084544 00010000:00010000:3.0:1783965111.751192:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fe00/0xe782b916994fdd74 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0123 expref: 6 pid: 5813 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783965111.751332:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 61 00000100:00100000:3.0:1783965111.751346:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947437071500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:49bbacc1-b013-4591-8d15-02f4f0d1884e+6:2359:x1870622715084544:12345-192.168.204.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783965111.751370:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783965111.751380:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fe00/0xe782b916994fdd74 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0123 expref: 6 pid: 5813 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965111.751399:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fe00/0xe782b916994fdd74 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0123 expref: 6 pid: 5813 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1783965111.751661:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1783965111.751734:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fe00/0xe782b916994fdd74 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0123 expref: 6 pid: 5813 timeout: 445 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965111.751757:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff947407b5c300) 00010000:00010000:3.0:1783965111.751763:0:5797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fc000/0xe782b916994fddb3 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965111.751775:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fc000/0xe782b916994fddb3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965111.751784:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fc000/0xe782b916994fddb3 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965111.751825:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783965111.751934:0:5812:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fc000/0xe782b916994fddb3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965111.751943:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fc000/0xe782b916994fddb3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965111.751974:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fdc00/0xe782b916994fddba lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965111.751997:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fdc00/0xe782b916994fddba lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965111.752006:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fdc00/0xe782b916994fddba lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783965111.753652:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:0.0:1783965111.753676:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fc000/0xe782b916994fddb3 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965111.753690:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fc000/0xe782b916994fddb3 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965111.753698:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fc000/0xe782b916994fddb3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965111.753705:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743e2fc000 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1783965111.753711:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fc000/0xe782b916994fddb3 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965111.753730:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fc000/0xe782b916994fddb3 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965111.753749:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff947407b5c300) 00010000:00010000:0.0:1783965111.753753:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783965111.753759:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fc000/0xe782b916994fddb3 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965111.753766:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fc000/0xe782b916994fddb3 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783965111.753801:0:5812:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f0351e58 reply state 0000000061d6bc6a transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fdc00/0xe782b916994fddba lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783965111.753813:0:5812:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783965111.754056:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947437071500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:49bbacc1-b013-4591-8d15-02f4f0d1884e+5:2359:x1870622715084544:12345-192.168.204.12@tcp:103:ldlm_bl.0 Request processed in 2707us (10031us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965111.754076:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 61 00000100:00100000:0.0:1783965111.756420:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743d9ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9923189b-eb4a-470c-ab45-969435371000+16:11312:x1870622715084416:12345-192.168.204.12@tcp:36:lfs.0 Request processed in 22037us (26861us total) trans 4294967416 rc 0/0 00000100:00100000:0.0:1783965111.756446:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 140 00010000:00010000:3.0:1783965111.758535:0:3309:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fdc00/0xe782b916994fddba lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965111.760135:0:3309:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fdc00/0xe782b916994fddba lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965111.760163:0:3309:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fdc00/0xe782b916994fddba lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965111.760171:0:3309:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743e2fdc00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1783965111.760178:0:3309:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fdc00/0xe782b916994fddba lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965111.760189:0:3309:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fdc00/0xe782b916994fddba lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965111.760293:0:3309:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff94740a90c200) 00010000:00010000:3.0:1783965111.760297:0:3309:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783965111.760303:0:3309:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fdc00/0xe782b916994fddba lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965111.760311:0:3309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fdc00/0xe782b916994fddba lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783965111.843446:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965111.855727:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715084672 00000100:00100000:3.0:1783965111.855750:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715084672 00000100:00100000:3.0:1783965111.855839:0:6632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 141 00000100:00100000:3.0:1783965111.855853:0:6632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e2c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9923189b-eb4a-470c-ab45-969435371000+15:11320:x1870622715084672:12345-192.168.204.12@tcp:101:lctl.0 00010000:00010000:3.0:1783965111.855887:0:6632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783965111.855931:0:6632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fddc1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5f0138 expref: -99 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965111.856023:0:6632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26800/0xe782b916994fddc8 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965111.856041:0:6632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26800/0xe782b916994fddc8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965111.856057:0:6632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26800/0xe782b916994fddc8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783965111.856145:0:6632:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1783965111.856150:0:6632:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:3.0:1783965111.856378:0:6632:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26800/0xe782b916994fddc8 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965111.856415:0:6632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fddc1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0138 expref: 17 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965111.856438:0:6632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26800/0xe782b916994fddc8 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0138 expref: 16 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965111.856448:0:6632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94740b97a600) 00010000:00010000:3.0:1783965111.856452:0:6632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783965111.856457:0:6632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff947436f26800, rc 0) 00000100:00100000:3.0:1783965111.856545:0:6632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e2c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9923189b-eb4a-470c-ab45-969435371000+16:11320:x1870622715084672:12345-192.168.204.12@tcp:101:lctl.0 Request processed in 695us (13114us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965111.856553:0:6632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 141 00000100:00100000:2.0:1783965111.858846:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e2c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3323:1870622732915840:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783965111.858938:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783965111.859660:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732915840 00000100:00100000:3.0:1783965111.859687:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732915840 00000100:00100000:3.0:1783965111.859766:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1783965111.859784:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e2c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3323:x1870622732915840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783965111.859835:0:6611:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783965111.859905:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e2c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3323:x1870622732915840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 129us (967us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965111.859913:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1783965111.859944:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743d9cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3325:1870622732916096:0@lo:400:kworker.0 00000100:00100000:3.0:1783965111.859982:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783965111.860010:0:3325:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1783965111.860017:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743d9c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ae0997f7-3a15-4fc6-865a-35b2f101956e:3325:1870622732915968:0@lo:400:kworker.0 00000100:00100000:3.0:1783965111.860047:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783965111.860074:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743d9cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3325:1870622732916480:0@lo:400:kworker.0 00000100:00100000:3.0:1783965111.860098:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783965111.860124:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1783965111.860141:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732916096 00000100:00100000:3.0:1783965111.860145:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732916096 00000100:00100000:3.0:1783965111.860174:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732916480 00000100:00100000:3.0:1783965111.860178:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732916480 00000100:00100000:3.0:1783965111.860236:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1783965111.860244:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743d9c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3325:x1870622732916096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783965111.860290:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743d9c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3325:x1870622732916096:12345-0@lo:400:kworker.0 Request processed in 47us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965111.860297:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:3.0:1783965111.860310:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1783965111.860319:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743d9c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3325:x1870622732916480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783965111.860349:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743d9c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3325:x1870622732916480:12345-0@lo:400:kworker.0 Request processed in 32us (250us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965111.860364:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1783965111.860386:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732915968 00000100:00100000:3.0:1783965111.860390:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732915968 00000100:00100000:3.0:1783965111.860421:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:3.0:1783965111.860428:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947408ecb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+19:3325:x1870622732915968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783965111.860461:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947408ecb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+19:3325:x1870622732915968:12345-0@lo:400:kworker.0 Request processed in 34us (413us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965111.860468:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00080000:3.0:1783965111.860504:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783965111.860537:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743d9c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ae0997f7-3a15-4fc6-865a-35b2f101956e:3325:1870622732915968:0@lo:400:kworker.0 00000100:00100000:3.0:1783965111.860552:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743d9cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3325:1870622732916480:0@lo:400:kworker.0 00000100:00100000:3.0:1783965111.860573:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743d9cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3325:1870622732916096:0@lo:400:kworker.0 00000100:00100000:3.0:1783965111.860612:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743d9caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3322:1870622732916224:0@lo:400:kworker.0 00000100:00100000:3.0:1783965111.860640:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783965111.860660:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783965111.860666:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743d9ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3322:1870622732916352:0@lo:400:kworker.0 00000100:00100000:3.0:1783965111.860693:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783965111.860725:0:8738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732916352 00000100:00100000:3.0:1783965111.860729:0:8738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732916352 00000100:00100000:3.0:1783965111.860768:0:8738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1783965111.860776:0:8738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743d9cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3322:x1870622732916352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783965111.860813:0:8738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743d9cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3322:x1870622732916352:12345-0@lo:400:kworker.0 Request processed in 39us (119us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965111.860819:0:8738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00080000:3.0:1783965111.860849:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783965111.860867:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743d9ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3322:1870622732916352:0@lo:400:kworker.0 00000100:00100000:3.0:1783965111.860883:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732916224 00000100:00100000:3.0:1783965111.860886:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732916224 00000100:00100000:3.0:1783965111.860912:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1783965111.860918:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743d9cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3322:x1870622732916224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783965111.860952:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743d9cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3322:x1870622732916224:12345-0@lo:400:kworker.0 Request processed in 34us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965111.860958:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00080000:3.0:1783965111.860972:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783965111.860990:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743d9caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3322:1870622732916224:0@lo:400:kworker.0 00000100:00100000:3.0:1783965111.861015:0:3323:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:3.0:1783965111.861022:0:3323:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff947436e3a680, transno 4294967312 00000100:00100000:3.0:1783965111.861042:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e2c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3323:1870622732915840:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783965111.924633:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783965111.924807:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715084800 00000100:00100000:0.0:1783965111.924827:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715084800 00000100:00100000:0.0:1783965111.924918:0:6632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 142 00000100:00100000:0.0:1783965111.924931:0:6632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743d9caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9923189b-eb4a-470c-ab45-969435371000+16:11326:x1870622715084800:12345-192.168.204.12@tcp:101:bash.0 00010000:00010000:0.0:1783965111.924963:0:6632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783965111.924991:0:6632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fc000/0xe782b916994fddcf lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5f013f expref: -99 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965111.925077:0:6632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fde00/0xe782b916994fddd6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965111.925119:0:6632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fde00/0xe782b916994fddd6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965111.925134:0:6632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fde00/0xe782b916994fddd6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965111.925165:0:6632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fd400/0xe782b916994fdddd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965111.925174:0:6632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fd400/0xe782b916994fdddd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965111.925181:0:6632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fd400/0xe782b916994fdddd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965111.925388:0:6632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fc800/0xe782b916994fdde4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965111.925396:0:6632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fc800/0xe782b916994fdde4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965111.925403:0:6632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fc800/0xe782b916994fdde4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783965111.925444:0:6632:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:0.0:1783965111.925448:0:6632:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1783965111.925524:0:6632:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fc800/0xe782b916994fdde4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965111.925542:0:6632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fde00/0xe782b916994fddd6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965111.925549:0:6632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fde00/0xe782b916994fddd6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965111.925556:0:6632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fde00/0xe782b916994fddd6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965111.925574:0:6632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743e2fde00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1783965111.925580:0:6632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fde00/0xe782b916994fddd6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965111.925588:0:6632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fde00/0xe782b916994fddd6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965111.925608:0:6632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94740b97a600) 00010000:00010000:1.0:1783965111.925620:0:6632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783965111.925626:0:6632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fde00/0xe782b916994fddd6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965111.925632:0:6632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fde00/0xe782b916994fddd6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965111.925672:0:6632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fd400/0xe782b916994fdddd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965111.925678:0:6632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fd400/0xe782b916994fdddd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965111.925685:0:6632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fd400/0xe782b916994fdddd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965111.925691:0:6632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743e2fd400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1783965111.925694:0:6632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fd400/0xe782b916994fdddd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965111.925699:0:6632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fd400/0xe782b916994fdddd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965111.925707:0:6632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff94740a90c600) 00010000:00010000:1.0:1783965111.925709:0:6632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783965111.925711:0:6632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fd400/0xe782b916994fdddd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965111.925715:0:6632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fd400/0xe782b916994fdddd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965111.925755:0:6632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fc000/0xe782b916994fddcf lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f013f expref: 18 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965111.925776:0:6632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fc800/0xe782b916994fdde4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f013f expref: 17 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965111.925793:0:6632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94740a90c500) 00010000:00010000:1.0:1783965111.925795:0:6632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1783965111.925797:0:6632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94743e2fc800, rc 0) 00000100:00100000:1.0:1783965111.925872:0:6632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743d9caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9923189b-eb4a-470c-ab45-969435371000+17:11326:x1870622715084800:12345-192.168.204.12@tcp:101:bash.0 Request processed in 945us (1255us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965111.925879:0:6632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 142 00000100:00100000:3.0:1783965111.930356:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783965111.931094:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715085056 00000100:00100000:0.0:1783965111.931111:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715085056 00000100:00100000:0.0:1783965111.931247:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 143 00000100:00100000:0.0:1783965111.931261:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743d9ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9923189b-eb4a-470c-ab45-969435371000+17:11326:x1870622715085056:12345-192.168.204.12@tcp:101:bash.0 00010000:00010000:0.0:1783965111.931292:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783965111.931342:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fdc00/0xe782b916994fddeb lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5f0146 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965111.931622:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fc00/0xe782b916994fddf2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965111.931643:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fc00/0xe782b916994fddf2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965111.931660:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fc00/0xe782b916994fddf2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965111.931693:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e400/0xe782b916994fddf9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965111.931701:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e400/0xe782b916994fddf9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965111.931708:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e400/0xe782b916994fddf9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783965111.932498:0:5811:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:2.0:1783965111.932733:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f800/0xe782b916994fde00 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965111.932746:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f800/0xe782b916994fde00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965111.932756:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f800/0xe782b916994fde00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965111.932806:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fc00/0xe782b916994fddf2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965111.932815:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fc00/0xe782b916994fddf2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965111.932822:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fc00/0xe782b916994fddf2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965111.932829:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743fb8fc00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1783965111.932835:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fc00/0xe782b916994fddf2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965111.932857:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fc00/0xe782b916994fddf2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965111.932872:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94740a90c500) 00010000:00010000:2.0:1783965111.932875:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783965111.932881:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fc00/0xe782b916994fddf2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965111.932887:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fc00/0xe782b916994fddf2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783965111.932904:0:5811:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000049625b12 reply state 000000004f2056cf transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e400/0xe782b916994fddf9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783965111.932915:0:5811:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1783965111.932961:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fdc00/0xe782b916994fddeb lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0146 expref: 20 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965111.932987:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f800/0xe782b916994fde00 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0146 expref: 19 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965111.932994:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff947402a2dc00) 00010000:00010000:2.0:1783965111.932997:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783965111.932999:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94743fb8f800, rc 0) 00000100:00100000:2.0:1783965111.933119:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743d9ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9923189b-eb4a-470c-ab45-969435371000+20:11326:x1870622715085056:12345-192.168.204.12@tcp:101:bash.0 Request processed in 1861us (2780us total) trans 4294967417 rc 0/0 00000100:00100000:2.0:1783965111.933130:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 143 00010000:00010000:3.0:1783965111.936569:0:3308:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e400/0xe782b916994fddf9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965111.936596:0:3308:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e400/0xe782b916994fddf9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965111.936605:0:3308:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e400/0xe782b916994fddf9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965111.936612:0:3308:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743fb8e400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1783965111.936618:0:3308:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e400/0xe782b916994fddf9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965111.936650:0:3308:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e400/0xe782b916994fddf9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965111.936672:0:3308:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff947402a2d500) 00010000:00010000:3.0:1783965111.936676:0:3308:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783965111.936682:0:3308:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e400/0xe782b916994fddf9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965111.936690:0:3308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e400/0xe782b916994fddf9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783965111.938240:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965111.938307:0:6609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715085184 00000100:00100000:2.0:1783965111.938338:0:6609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715085184 00000100:00100000:2.0:1783965111.938452:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 48 00000100:00100000:2.0:1783965111.938464:0:6609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743d9c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9923189b-eb4a-470c-ab45-969435371000+5:2359:x1870622715085184:12345-192.168.204.12@tcp:101:bash.0 00010000:00010000:2.0:1783965111.938487:0:6609:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783965111.938514:0:6609:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bd475494/0xe782b916994fde0e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5f014d expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783965111.938549:0:6609:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783965111.938588:0:6609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=346s v=(0 0) 00010000:00010000:2.0:1783965111.938594:0:6609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783965111.938608:0:6609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bd475494/0xe782b916994fde0e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f014d expref: 6 pid: 6609 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965111.938633:0:6609:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000bd475494/0xe782b916994fde0e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f014d expref: 6 pid: 6609 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965111.938649:0:6609:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94743fb8f600, rc 0) 00000100:00100000:2.0:1783965111.938725:0:6609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743d9c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9923189b-eb4a-470c-ab45-969435371000+6:2359:x1870622715085184:12345-192.168.204.12@tcp:101:bash.0 Request processed in 263us (537us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965111.938732:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 48 00000100:00080000:3.0:1783965111.938904:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783965111.941249:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965111.942115:0:11945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715085312 00000100:00100000:3.0:1783965111.942133:0:11945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715085312 00000100:00100000:2.0:1783965111.950822:0:11945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 49 00000100:00100000:2.0:1783965111.950849:0:11945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e2c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9923189b-eb4a-470c-ab45-969435371000+6:11326:x1870622715085312:12345-192.168.204.12@tcp:101:bash.0 00010000:00010000:2.0:1783965111.950876:0:11945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783965111.950903:0:11945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003d89582a/0xe782b916994fde15 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5f0154 expref: -99 pid: 11945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965111.950977:0:11945:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bd475494/0xe782b916994fde0e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f014d expref: 7 pid: 6609 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965111.950987:0:11945:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783965111.950992:0:11945:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783965111.950998:0:11945:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003d89582a/0xe782b916994fde15 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0154 expref: 7 pid: 11945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965111.951043:0:11945:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bd475494/0xe782b916994fde0e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f014d expref: 7 pid: 6609 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965111.951059:0:11945:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bd475494/0xe782b916994fde0e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f014d expref: 7 pid: 6609 timeout: 446 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783965111.951077:0:11945:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e2c3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11945:1870622732916608:192.168.204.12@tcp:104: 00000100:00100000:2.0:1783965111.951373:0:11945:0:(client.c:2702:ptlrpc_set_wait()) set ffff9474400a4600 going to sleep for 11 seconds 00000100:00100000:2.0:1783965111.964639:0:11945:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e2c3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0000_UUID:11945:1870622732916608:192.168.204.12@tcp:104: 00010000:00010000:2.0:1783965111.964694:0:11945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003d89582a/0xe782b916994fde15 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0154 expref: 7 pid: 11945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965111.964724:0:11945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94743fb8fc00, rc 0) 00000100:00100000:2.0:1783965111.964819:0:11945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e2c0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9923189b-eb4a-470c-ab45-969435371000+7:11326:x1870622715085312:12345-192.168.204.12@tcp:101:bash.0 Request processed in 13981us (23628us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965111.964829:0:11945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 49 00000100:00100000:0.0:1783965111.972045:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965111.972185:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715085440 00000100:00100000:1.0:1783965111.972241:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715085440 00010000:00010000:1.0:1783965111.972302:0:5798:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bd475494/0xe782b916994fde0e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f014d expref: 7 pid: 6609 timeout: 446 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783965111.972357:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 62 00000100:00100000:1.0:1783965111.972370:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9474057d9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9923189b-eb4a-470c-ab45-969435371000+7:2359:x1870622715085440:12345-192.168.204.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783965111.972391:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783965111.972425:0:5798:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bd475494/0xe782b916994fde0e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f014d expref: 7 pid: 6609 timeout: 446 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965111.972442:0:5798:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bd475494/0xe782b916994fde0e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f014d expref: 7 pid: 6609 timeout: 446 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965111.972477:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bd475494/0xe782b916994fde0e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f014d expref: 7 pid: 6609 timeout: 446 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965111.972501:0:5798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783965111.972526:0:5798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783965111.972537:0:5798:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003d89582a/0xe782b916994fde15 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0154 expref: 6 pid: 11945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965111.972549:0:5798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003d89582a/0xe782b916994fde15 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0154 expref: 6 pid: 11945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965111.972610:0:5798:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000003d89582a/0xe782b916994fde15 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0154 expref: 6 pid: 11945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783965111.972629:0:5798:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947437070700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5798:1870622732916736:192.168.204.12@tcp:105: 00000100:00100000:1.0:1783965111.972728:0:5798:0:(client.c:2702:ptlrpc_set_wait()) set ffff947436de0240 going to sleep for 11 seconds 00010000:00010000:0.0:1783965111.980014:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783965111.980843:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965111.980930:0:5798:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947437070700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5798:1870622732916736:192.168.204.12@tcp:105: 00010000:00010000:2.0:1783965111.980968:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783965111.981051:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9474057d9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9923189b-eb4a-470c-ab45-969435371000+6:2359:x1870622715085440:12345-192.168.204.12@tcp:103:ldlm_bl.0 Request processed in 8683us (9023us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965111.981064:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 62 00000100:00100000:0.0:1783965111.981163:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715085696 00000100:00100000:0.0:1783965111.981172:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715085696 00000100:00100000:0.0:1783965111.981274:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 36 00000100:00100000:0.0:1783965111.981306:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743d9cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9923189b-eb4a-470c-ab45-969435371000+19:11326:x1870622715085696:12345-192.168.204.12@tcp:35:bash.0 00000100:00100000:0.0:1783965111.981741:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743d9cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9923189b-eb4a-470c-ab45-969435371000+20:11326:x1870622715085696:12345-192.168.204.12@tcp:35:bash.0 Request processed in 456us (908us total) trans 4294967418 rc 0/0 00000100:00100000:0.0:1783965111.981749:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 36 00000100:00100000:0.0:1783965112.080977:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965112.081137:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715085952 00000100:00100000:3.0:1783965112.081151:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715085952 00000100:00100000:3.0:1783965112.081272:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 144 00000100:00100000:3.0:1783965112.081286:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9474057dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9923189b-eb4a-470c-ab45-969435371000+20:11336:x1870622715085952:12345-192.168.204.12@tcp:101:lfs.0 00010000:00010000:3.0:1783965112.081328:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783965112.081358:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27800/0xe782b916994fde1c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5f015b expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783965112.081529:0:5813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:3.0:1783965112.082366:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27800/0xe782b916994fde1c lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f015b expref: 22 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965112.082390:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94740b97a600) 00010000:00010000:3.0:1783965112.082411:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783965112.082418:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27800/0xe782b916994fde1c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f015b expref: 22 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965112.082436:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff947436f27800, rc 0) 00000100:00100000:3.0:1783965112.082652:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9474057dbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9923189b-eb4a-470c-ab45-969435371000+21:11336:x1870622715085952:12345-192.168.204.12@tcp:101:lfs.0 Request processed in 1367us (1688us total) trans 4294967419 rc 301/301 00000100:00100000:3.0:1783965112.082662:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 144 00000100:00100000:3.0:1783965112.087568:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783965112.090158:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715086208 00000100:00100000:0.0:1783965112.090185:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715086208 00000100:00100000:0.0:1783965112.090319:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 37 00000100:00100000:0.0:1783965112.090337:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743d9c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9923189b-eb4a-470c-ab45-969435371000+21:11336:x1870622715086208:12345-192.168.204.12@tcp:35:lfs.0 00000100:00100000:0.0:1783965112.090843:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743d9c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9923189b-eb4a-470c-ab45-969435371000+22:11336:x1870622715086208:12345-192.168.204.12@tcp:35:lfs.0 Request processed in 509us (3303us total) trans 4294967420 rc 0/0 00000100:00100000:0.0:1783965112.090854:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 37 00000100:00100000:2.0:1783965112.154523:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965112.154750:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715086336 00000100:00100000:3.0:1783965112.154764:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715086336 00000100:00100000:3.0:1783965112.154848:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 145 00000100:00100000:3.0:1783965112.154862:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e2c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9923189b-eb4a-470c-ab45-969435371000+22:11342:x1870622715086336:12345-192.168.204.12@tcp:101:lfs.0 00010000:00010000:3.0:1783965112.154896:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783965112.154923:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27800/0xe782b916994fde2a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5f0162 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965112.155023:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fde31 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965112.155041:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fde31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965112.155056:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fde31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783965112.155148:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:3.0:1783965112.155153:0:5812:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1783965112.155181:0:5812:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fde31 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965112.155279:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27800/0xe782b916994fde2a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0162 expref: 24 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965112.155304:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fde31 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0162 expref: 23 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965112.155314:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94740a90c500) 00010000:00010000:3.0:1783965112.155318:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783965112.155323:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff947436f26e00, rc 0) 00000100:00100000:3.0:1783965112.155416:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e2c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9923189b-eb4a-470c-ab45-969435371000+23:11342:x1870622715086336:12345-192.168.204.12@tcp:101:lfs.0 Request processed in 558us (909us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965112.155427:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 145 00000100:00100000:0.0:1783965112.161665:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965112.161789:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715086592 00000100:00100000:1.0:1783965112.161803:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715086592 00000100:00100000:1.0:1783965112.161921:0:6632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 146 00000100:00100000:1.0:1783965112.161934:0:6632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9474057db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9923189b-eb4a-470c-ab45-969435371000+23:11342:x1870622715086592:12345-192.168.204.12@tcp:101:lfs.0 00010000:00010000:1.0:1783965112.161965:0:6632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783965112.162008:0:6632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efc00/0xe782b916994fde38 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5f0169 expref: -99 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965112.162165:0:6632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eea00/0xe782b916994fde3f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965112.162184:0:6632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eea00/0xe782b916994fde3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965112.162235:0:6632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eea00/0xe782b916994fde3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783965112.162280:0:6632:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1783965112.162808:0:6632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efc00/0xe782b916994fde38 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0169 expref: 26 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965112.162848:0:6632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eea00/0xe782b916994fde3f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0169 expref: 25 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965112.162859:0:6632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff947402a2dc00) 00010000:00010000:1.0:1783965112.162863:0:6632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783965112.162868:0:6632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94743d9eea00, rc 0) 00000100:00100000:1.0:1783965112.163019:0:6632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9474057db100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9923189b-eb4a-470c-ab45-969435371000+25:11342:x1870622715086592:12345-192.168.204.12@tcp:101:lfs.0 Request processed in 1086us (1368us total) trans 4294967421 rc 0/0 00000100:00100000:1.0:1783965112.163031:0:6632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 146 00000100:00100000:0.0:1783965112.168309:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783965112.168420:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965112.168599:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715086848 00000100:00100000:1.0:1783965112.168615:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715086848 00000100:00100000:1.0:1783965112.168689:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 147 00000100:00100000:1.0:1783965112.168701:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9474057daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9923189b-eb4a-470c-ab45-969435371000+25:11342:x1870622715086848:12345-192.168.204.12@tcp:101:lfs.0 00010000:00010000:1.0:1783965112.168735:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783965112.168763:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eec00/0xe782b916994fde4d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5f0170 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965112.168901:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee400/0xe782b916994fde54 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965112.168922:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee400/0xe782b916994fde54 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965112.168972:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee400/0xe782b916994fde54 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783965112.168991:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00000100:00100000:3.0:1783965112.169143:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715086976 00000100:00100000:3.0:1783965112.169150:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715086976 00010000:00010000:1.0:1783965112.169176:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eec00/0xe782b916994fde4d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0170 expref: 29 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783965112.169238:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 10 00010000:00010000:1.0:1783965112.169245:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee400/0xe782b916994fde54 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0170 expref: 28 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783965112.169251:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9474057d9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9923189b-eb4a-470c-ab45-969435371000+28:2358:x1870622715086976:12345-192.168.204.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783965112.169264:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff947402a2dc00) 00010000:00010000:3.0:1783965112.169267:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783965112.169269:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1783965112.169275:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94743d9ee400, rc 0) 00010000:00010000:3.0:1783965112.169289:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eea00/0xe782b916994fde3f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0169 expref: 28 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965112.169305:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff947402a2dc00) 00010000:00010000:3.0:1783965112.169310:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783965112.169351:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9474057daa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9923189b-eb4a-470c-ab45-969435371000+27:11342:x1870622715086848:12345-192.168.204.12@tcp:101:lfs.0 Request processed in 653us (931us total) trans 4294967422 rc 0/0 00000100:00100000:1.0:1783965112.169359:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 147 00000100:00100000:3.0:1783965112.169642:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9474057d9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9923189b-eb4a-470c-ab45-969435371000+26:2358:x1870622715086976:12345-192.168.204.12@tcp:103:ldlm_bl.0 Request processed in 395us (1346us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965112.169650:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 10 00000100:00100000:2.0:1783965112.175185:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965112.175319:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715087104 00000100:00100000:3.0:1783965112.175351:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715087104 00000100:00100000:3.0:1783965112.175451:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 50 00000100:00100000:3.0:1783965112.175465:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e2c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9923189b-eb4a-470c-ab45-969435371000+6:2359:x1870622715087104:12345-192.168.204.12@tcp:1:lfs.0 00010000:00010000:3.0:1783965112.175531:0:6608:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e214443b/0xe782b916994fde62 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965112.175692:0:6608:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003d89582a/0xe782b916994fde15 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0154 expref: 6 pid: 11945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965112.175702:0:6608:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783965112.175708:0:6608:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783965112.175713:0:6608:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e214443b/0xe782b916994fde62 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965112.175766:0:6608:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003d89582a/0xe782b916994fde15 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0154 expref: 6 pid: 11945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965112.175784:0:6608:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003d89582a/0xe782b916994fde15 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0154 expref: 6 pid: 11945 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783965112.175802:0:6608:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743d9c8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6608:1870622732916864:192.168.204.12@tcp:104: 00000100:00100000:3.0:1783965112.175918:0:6608:0:(client.c:2702:ptlrpc_set_wait()) set ffff947410edf3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783965112.179688:0:6608:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743d9c8700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6608:1870622732916864:192.168.204.12@tcp:104: 00010000:00010000:3.0:1783965112.179737:0:6608:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e214443b/0xe782b916994fde62 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783965112.182107:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783965112.183051:0:6612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715087232 00000100:00100000:0.0:1783965112.183069:0:6612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715087232 00002000:00100000:0.0:1783965112.183157:0:6612:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff94743e2c2d80 x1870622715087232/t0(0) o4->9923189b-eb4a-470c-ab45-969435371000@192.168.204.12@tcp:538/0 lens 504/0 e 0 to 0 dl 1783965123 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1783965112.183194:0:6612:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff94743e2c2d80 with x1870622715087232 ext(0->12) 00010000:00010000:0.0:1783965112.183249:0:6612:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000003d89582a/0xe782b916994fde15 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0154 expref: 7 pid: 11945 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965112.183270:0:6612:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000003d89582a/0xe782b916994fde15 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0154 expref: 7 pid: 11945 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783965112.183280:0:6612:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff94743e2c2d80 00000100:00100000:0.0:1783965112.183314:0:6612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 2 00000100:00100000:0.0:1783965112.183327:0:6612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e2c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9923189b-eb4a-470c-ab45-969435371000+7:2359:x1870622715087232:12345-192.168.204.12@tcp:4:lfs.0 00000100:00100000:0.0:1783965112.184756:0:6612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e2c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9923189b-eb4a-470c-ab45-969435371000+9:2359:x1870622715087232:12345-192.168.204.12@tcp:4:lfs.0 Request processed in 1417us (2650us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1783965112.184770:0:6612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 2 00002000:00100000:0.0:1783965112.184782:0:6612:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff94743e2c2d80 x1870622715087232/t4294967305(0) o4->9923189b-eb4a-470c-ab45-969435371000@192.168.204.12@tcp:538/0 lens 504/448 e 0 to 0 dl 1783965123 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1783965112.184793:0:6612:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff94743e2c2d80 with x1870622715087232 ext(0->12) 00010000:00010000:0.0:1783965112.184804:0:6612:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000003d89582a/0xe782b916994fde15 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0154 expref: 9 pid: 11945 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965112.184824:0:6612:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000003d89582a/0xe782b916994fde15 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0154 expref: 9 pid: 11945 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783965112.184832:0:6612:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff94743e2c2d80 00000100:00100000:0.0:1783965112.188150:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965112.188472:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715087360 00000100:00100000:2.0:1783965112.188486:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715087360 00010000:00010000:2.0:1783965112.189872:0:5799:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003d89582a/0xe782b916994fde15 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0154 expref: 9 pid: 11945 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783965112.189960:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 63 00000100:00100000:2.0:1783965112.189980:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9474057d8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9923189b-eb4a-470c-ab45-969435371000+9:2359:x1870622715087360:12345-192.168.204.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783965112.190005:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1783965112.190033:0:5799:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1783965112.190037:0:5799:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1783965111 00002000:00010000:2.0:1783965112.190039:0:5799:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1783965111 00002000:00010000:2.0:1783965112.190042:0:5799:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1783965111 00010000:00010000:2.0:1783965112.190049:0:5799:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003d89582a/0xe782b916994fde15 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0154 expref: 9 pid: 11945 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965112.190065:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003d89582a/0xe782b916994fde15 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0154 expref: 9 pid: 11945 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965112.190097:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003d89582a/0xe782b916994fde15 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0154 expref: 9 pid: 11945 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965112.190136:0:5799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783965112.190142:0:5799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783965112.190150:0:5799:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e214443b/0xe782b916994fde62 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965112.190161:0:5799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e214443b/0xe782b916994fde62 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965112.190233:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783965112.190320:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9474057d8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9923189b-eb4a-470c-ab45-969435371000+8:2359:x1870622715087360:12345-192.168.204.12@tcp:103:ldlm_bl.0 Request processed in 349us (2185us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965112.190330:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 63 00010000:00010000:0.0:1783965112.190669:0:6608:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e214443b/0xe782b916994fde62 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965112.190682:0:6608:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e214443b/0xe782b916994fde62 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965112.190716:0:6608:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e214443b/0xe782b916994fde62 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965112.190726:0:6608:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e214443b/0xe782b916994fde62 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965112.190735:0:6608:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e214443b/0xe782b916994fde62 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965112.190744:0:6608:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947436f27800 already unused, calling callback (ffffffffc168d230) 00010000:00010000:0.0:1783965112.190748:0:6608:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e214443b/0xe782b916994fde62 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965112.190758:0:6608:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e214443b/0xe782b916994fde62 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965112.190773:0:6608:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e214443b/0xe782b916994fde62 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965112.190782:0:6608:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e214443b/0xe782b916994fde62 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783965112.190863:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e2c2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9923189b-eb4a-470c-ab45-969435371000+7:2359:x1870622715087104:12345-192.168.204.12@tcp:1:lfs.0 Request processed in 15401us (15691us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965112.190874:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 50 00000100:00100000:1.0:1783965112.193779:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783965112.193896:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715087616 00000100:00100000:0.0:1783965112.193911:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715087616 00000100:00100000:0.0:1783965112.194074:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 38 00000100:00100000:0.0:1783965112.194098:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94740638b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9923189b-eb4a-470c-ab45-969435371000+26:11342:x1870622715087616:12345-192.168.204.12@tcp:35:lfs.0 00000004:00010000:0.0:1783965112.194191:0:5814:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee400/0xe782b916994fde54 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0170 expref: 26 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783965112.194677:0:5814:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:0.0:1783965112.194725:0:5814:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:0.0:1783965112.195544:0:5814:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:0.0:1783965112.195642:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fc400/0xe782b916994fde69 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965112.195665:0:5814:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f800/0xe782b916994fde00 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0146 expref: 30 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965112.195678:0:5814:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fc400/0xe782b916994fde69 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965112.195731:0:5814:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f800/0xe782b916994fde00 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0146 expref: 30 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965112.195751:0:5814:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f800/0xe782b916994fde00 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0146 expref: 30 pid: 5811 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783965112.195784:0:5814:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947436335180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5814:1870622732916992:192.168.204.12@tcp:104: 00000100:00100000:0.0:1783965112.195916:0:5814:0:(client.c:2702:ptlrpc_set_wait()) set ffff94743e29fb40 going to sleep for 11 seconds 00000100:00100000:1.0:1783965112.200573:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965112.200711:0:8330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715087744 00000100:00100000:2.0:1783965112.200723:0:8330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715087744 00010000:00010000:2.0:1783965112.200783:0:8330:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f800/0xe782b916994fde00 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0146 expref: 31 pid: 5811 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783965112.200844:0:8330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 64 00000100:00100000:0.0:1783965112.200847:0:5814:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947436335180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5814:1870622732916992:192.168.204.12@tcp:104: 00000100:00100000:2.0:1783965112.200860:0:8330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947437070700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9923189b-eb4a-470c-ab45-969435371000+31:2360:x1870622715087744:12345-192.168.204.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783965112.200881:0:8330:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783965112.200891:0:8330:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f800/0xe782b916994fde00 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0146 expref: 31 pid: 5811 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965112.200892:0:5814:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fc400/0xe782b916994fde69 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965112.200920:0:8330:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f800/0xe782b916994fde00 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0146 expref: 31 pid: 5811 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965112.201843:0:8330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f800/0xe782b916994fde00 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0146 expref: 31 pid: 5811 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965112.201868:0:8330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff947402a2dc00) 00010000:00010000:2.0:1783965112.201874:0:8330:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fc400/0xe782b916994fde69 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965112.201885:0:8330:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fc400/0xe782b916994fde69 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965112.201894:0:8330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fc400/0xe782b916994fde69 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965112.201934:0:8330:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783965112.202019:0:8330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947437070700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9923189b-eb4a-470c-ab45-969435371000+30:2360:x1870622715087744:12345-192.168.204.12@tcp:103:ldlm_bl.0 Request processed in 1163us (1469us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965112.202030:0:8330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 64 00010000:00010000:0.0:1783965112.202453:0:5814:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fc400/0xe782b916994fde69 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965112.202465:0:5814:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fc400/0xe782b916994fde69 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783965112.202785:0:5814:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:0.0:1783965112.203050:0:5814:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:0.0:1783965112.203194:0:5814:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947436335180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5814:1870622732917120:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1783965112.203409:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783965112.203503:0:5814:0:(client.c:2702:ptlrpc_set_wait()) set ffff94743e29f780 going to sleep for 11 seconds 00000100:00100000:1.0:1783965112.203794:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732917120 00000100:00100000:1.0:1783965112.203805:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732917120 00000100:00100000:1.0:1783965112.203870:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783965112.203881:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743706ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5814:x1870622732917120:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1783965112.204043:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743706ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5814:x1870622732917120:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 164us (633us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965112.204051:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1783965112.204134:0:5814:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947436335180 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5814:1870622732917120:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:0.0:1783965112.207350:0:5814:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:0.0:1783965112.207669:0:5814:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743706ea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5814:1870622732917248:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1783965112.207762:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783965112.207867:0:5814:0:(client.c:2702:ptlrpc_set_wait()) set ffff94743e29fb40 going to sleep for 11 seconds 00000100:00100000:1.0:1783965112.208520:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732917248 00000100:00100000:1.0:1783965112.208531:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732917248 00000100:00100000:1.0:1783965112.208771:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1783965112.208783:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743706e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5814:x1870622732917248:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1783965112.209080:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743706e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5814:x1870622732917248:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 298us (1316us total) trans 4294967306 rc 0/0 00000100:00100000:1.0:1783965112.209089:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783965112.209187:0:5814:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743706ea00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5814:1870622732917248:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1783965112.209295:0:5814:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:2.0:1783965112.209353:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fc400/0xe782b916994fde69 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965112.209367:0:5814:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fc400/0xe782b916994fde69 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965112.209375:0:5814:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fc400/0xe782b916994fde69 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965112.209382:0:5814:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743e2fc400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1783965112.209401:0:5814:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fc400/0xe782b916994fde69 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965112.209410:0:5814:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fc400/0xe782b916994fde69 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965112.209446:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff947402a2dc00) 00010000:00010000:2.0:1783965112.209450:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1783965112.209456:0:5814:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fc400/0xe782b916994fde69 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965112.209464:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fc400/0xe782b916994fde69 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5814 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783965112.209738:0:5814:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1783965112.209933:0:5814:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:2.0:1783965112.209947:0:5814:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 346438744861ns, next at 347438742032ns, rc = 0 00000001:00080000:2.0:1783965112.209955:0:5814:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:2.0:1783965112.209994:0:5814:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff947402a2dc00) 00010000:00010000:2.0:1783965112.209998:0:5814:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1783965112.210007:0:5814:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee400/0xe782b916994fde54 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0170 expref: 34 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783965112.210161:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94740638b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9923189b-eb4a-470c-ab45-969435371000+33:11342:x1870622715087616:12345-192.168.204.12@tcp:35:lfs.0 Request processed in 16066us (16396us total) trans 4294967431 rc 0/0 00000100:00100000:2.0:1783965112.210171:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 38 00000020:00080000:2.0:1783965112.210176:0:5814:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1783965112.214419:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965112.214546:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715087872 00000100:00100000:3.0:1783965112.214570:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715087872 00000100:00100000:2.0:1783965112.214824:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 148 00000100:00100000:2.0:1783965112.214841:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947437072680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9923189b-eb4a-470c-ab45-969435371000+33:11342:x1870622715087872:12345-192.168.204.12@tcp:101:lfs.0 00010000:00010000:2.0:1783965112.214881:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783965112.214933:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f800/0xe782b916994fde70 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5f0177 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965112.215032:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f800/0xe782b916994fde70 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0177 expref: 34 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965112.215052:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f800/0xe782b916994fde70 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0177 expref: 34 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965112.215078:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff947402a2d200) 00010000:00010000:2.0:1783965112.215082:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783965112.215086:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94743fb8f800, rc 0) 00000100:00100000:2.0:1783965112.215175:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947437072680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9923189b-eb4a-470c-ab45-969435371000+34:11342:x1870622715087872:12345-192.168.204.12@tcp:101:lfs.0 Request processed in 339us (771us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965112.215184:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 148 00000100:00100000:3.0:1783965112.219975:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965112.220100:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715088128 00000100:00100000:2.0:1783965112.220115:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715088128 00000100:00100000:2.0:1783965112.220286:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 39 00000100:00100000:2.0:1783965112.220311:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743d9c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9923189b-eb4a-470c-ab45-969435371000+34:11342:x1870622715088128:12345-192.168.204.12@tcp:35:lfs.0 00000100:00100000:2.0:1783965112.220682:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743d9c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9923189b-eb4a-470c-ab45-969435371000+35:11342:x1870622715088128:12345-192.168.204.12@tcp:35:lfs.0 Request processed in 384us (719us total) trans 4294967432 rc 0/0 00000100:00100000:2.0:1783965112.220692:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 39 00000100:00100000:0.0:1783965112.311763:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965112.312341:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715088384 00000100:00100000:1.0:1783965112.312356:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715088384 00000100:00100000:1.0:1783965112.312445:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 149 00000100:00100000:1.0:1783965112.312458:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436335180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9923189b-eb4a-470c-ab45-969435371000+35:11352:x1870622715088384:12345-192.168.204.12@tcp:101:lfs.0 00010000:00010000:1.0:1783965112.312491:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783965112.312521:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efc00/0xe782b916994fde77 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5f017e expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783965112.312702:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:1.0:1783965112.313759:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efc00/0xe782b916994fde77 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f017e expref: 37 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965112.313784:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94740b97a600) 00010000:00010000:1.0:1783965112.313788:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783965112.313795:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efc00/0xe782b916994fde77 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f017e expref: 37 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965112.313831:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94743d9efc00, rc 0) 00000100:00100000:1.0:1783965112.314850:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436335180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9923189b-eb4a-470c-ab45-969435371000+36:11352:x1870622715088384:12345-192.168.204.12@tcp:101:lfs.0 Request processed in 2383us (3093us total) trans 4294967433 rc 301/301 00000100:00100000:1.0:1783965112.314864:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 149 00000100:00100000:1.0:1783965112.320793:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965112.320899:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715088512 00000100:00100000:3.0:1783965112.320913:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715088512 00000100:00100000:3.0:1783965112.321001:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 150 00000100:00100000:3.0:1783965112.321014:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94741cc30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9923189b-eb4a-470c-ab45-969435371000+36:11352:x1870622715088512:12345-192.168.204.12@tcp:34:lfs.0 00010000:00010000:3.0:1783965112.321127:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27c00/0xe782b916994fde85 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965112.321150:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27c00/0xe782b916994fde85 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965112.321166:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27c00/0xe782b916994fde85 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965112.321186:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fde8c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965112.321193:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fde8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965112.321225:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fde8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965112.321358:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27000/0xe782b916994fde93 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965112.321367:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27000/0xe782b916994fde93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965112.321393:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27000/0xe782b916994fde93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783965112.321450:0:5813:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27000/0xe782b916994fde93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965112.321467:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27c00/0xe782b916994fde85 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965112.321474:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27c00/0xe782b916994fde85 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965112.321480:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27c00/0xe782b916994fde85 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965112.321486:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947436f27c00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1783965112.321491:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27c00/0xe782b916994fde85 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965112.321498:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27c00/0xe782b916994fde85 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965112.321512:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94740a90c500) 00010000:00010000:3.0:1783965112.321515:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783965112.321520:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27c00/0xe782b916994fde85 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965112.321526:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27c00/0xe782b916994fde85 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965112.321540:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fde8c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965112.321560:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fde8c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965112.321567:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fde8c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965112.321572:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947436f26200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1783965112.321575:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fde8c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965112.321582:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fde8c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965112.321590:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff94740b97af00) 00010000:00010000:3.0:1783965112.321593:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783965112.321595:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fde8c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965112.321601:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fde8c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965112.321618:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27000/0xe782b916994fde93 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965112.321625:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27000/0xe782b916994fde93 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965112.321631:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27000/0xe782b916994fde93 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965112.321636:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947436f27000 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1783965112.321648:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27000/0xe782b916994fde93 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965112.321655:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27000/0xe782b916994fde93 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965112.321664:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff947402a2d200) 00010000:00010000:3.0:1783965112.321667:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783965112.321670:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27000/0xe782b916994fde93 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965112.321676:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27000/0xe782b916994fde93 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783965112.321796:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94741cc30700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9923189b-eb4a-470c-ab45-969435371000+36:11352:x1870622715088512:12345-192.168.204.12@tcp:34:lfs.0 Request processed in 782us (1013us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965112.321804:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 150 00000100:00100000:3.0:1783965112.327384:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783965112.328166:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715088768 00000100:00100000:0.0:1783965112.328182:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715088768 00000100:00100000:0.0:1783965112.328310:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 40 00000100:00100000:0.0:1783965112.328348:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743d9cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9923189b-eb4a-470c-ab45-969435371000+36:11352:x1870622715088768:12345-192.168.204.12@tcp:35:lfs.0 00000100:00100000:0.0:1783965112.328740:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743d9cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9923189b-eb4a-470c-ab45-969435371000+37:11352:x1870622715088768:12345-192.168.204.12@tcp:35:lfs.0 Request processed in 397us (1371us total) trans 4294967434 rc 0/0 00000100:00100000:0.0:1783965112.328751:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 40 00000100:00100000:0.0:1783965112.360386:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965112.360496:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715089024 00000100:00100000:2.0:1783965112.360509:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715089024 00000100:00100000:2.0:1783965112.360636:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 151 00000100:00100000:2.0:1783965112.360655:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436c3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9923189b-eb4a-470c-ab45-969435371000+37:11355:x1870622715089024:12345-192.168.204.12@tcp:101:lfs.0 00010000:00010000:2.0:1783965112.360693:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783965112.360731:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fc00/0xe782b916994fde9a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5f0185 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965112.360825:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e800/0xe782b916994fdea1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965112.360842:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e800/0xe782b916994fdea1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965112.360856:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e800/0xe782b916994fdea1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965112.360882:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fe00/0xe782b916994fdea8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965112.360890:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fe00/0xe782b916994fdea8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965112.360897:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fe00/0xe782b916994fdea8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965112.361052:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8ec00/0xe782b916994fdeaf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965112.361060:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8ec00/0xe782b916994fdeaf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965112.361067:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8ec00/0xe782b916994fdeaf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783965112.361079:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1783965112.361250:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e800/0xe782b916994fdea1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965112.361269:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e800/0xe782b916994fdea1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965112.361277:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e800/0xe782b916994fdea1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965112.361283:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743fb8e800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1783965112.361289:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e800/0xe782b916994fdea1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965112.361298:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e800/0xe782b916994fdea1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965112.361311:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94740a90c500) 00010000:00010000:2.0:1783965112.361314:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783965112.361318:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e800/0xe782b916994fdea1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965112.361325:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e800/0xe782b916994fdea1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965112.361339:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fe00/0xe782b916994fdea8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965112.361346:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fe00/0xe782b916994fdea8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965112.361352:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fe00/0xe782b916994fdea8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965112.361357:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743fb8fe00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1783965112.361363:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fe00/0xe782b916994fdea8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965112.361370:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fe00/0xe782b916994fdea8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965112.361377:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff947402a2dc00) 00010000:00010000:2.0:1783965112.361379:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783965112.361381:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fe00/0xe782b916994fdea8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965112.361387:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fe00/0xe782b916994fdea8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965112.361431:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fc00/0xe782b916994fde9a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0185 expref: 40 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965112.361444:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8ec00/0xe782b916994fdeaf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0185 expref: 39 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965112.361450:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff947402a2d200) 00010000:00010000:2.0:1783965112.361452:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783965112.361455:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94743fb8ec00, rc 0) 00000100:00100000:2.0:1783965112.361534:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436c3ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9923189b-eb4a-470c-ab45-969435371000+39:11355:x1870622715089024:12345-192.168.204.12@tcp:101:lfs.0 Request processed in 889us (1163us total) trans 4294967435 rc 0/0 00000100:00100000:2.0:1783965112.361541:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 151 00000100:00100000:1.0:1783965112.367364:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965112.367621:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715089152 00000100:00100000:3.0:1783965112.367637:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715089152 00000100:00100000:3.0:1783965112.367721:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 152 00000100:00100000:3.0:1783965112.367734:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e543480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9923189b-eb4a-470c-ab45-969435371000+39:11355:x1870622715089152:12345-192.168.204.12@tcp:54:lfs.0 00010000:00010000:3.0:1783965112.367968:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27000/0xe782b916994fdebd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965112.367991:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27000/0xe782b916994fdebd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965112.368006:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27000/0xe782b916994fdebd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965112.368297:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27000/0xe782b916994fdebd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965112.368593:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27000/0xe782b916994fdebd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965112.368601:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27000/0xe782b916994fdebd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965112.368607:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947436f27000 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1783965112.368613:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27000/0xe782b916994fdebd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965112.368621:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27000/0xe782b916994fdebd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965112.368637:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff947402a2d200) 00010000:00010000:3.0:1783965112.368641:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783965112.368648:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27000/0xe782b916994fdebd lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965112.368655:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27000/0xe782b916994fdebd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783965112.368840:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e543480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9923189b-eb4a-470c-ab45-969435371000+39:11355:x1870622715089152:12345-192.168.204.12@tcp:54:lfs.0 Request processed in 1040us (1425us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965112.368850:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 152 00000100:00100000:2.0:1783965112.374243:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783965112.374355:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715089408 00000100:00100000:0.0:1783965112.374369:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715089408 00000100:00100000:0.0:1783965112.374444:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 41 00000100:00100000:0.0:1783965112.374457:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e2c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9923189b-eb4a-470c-ab45-969435371000+39:11355:x1870622715089408:12345-192.168.204.12@tcp:35:lfs.0 00000100:00100000:0.0:1783965112.374849:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e2c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9923189b-eb4a-470c-ab45-969435371000+40:11355:x1870622715089408:12345-192.168.204.12@tcp:35:lfs.0 Request processed in 393us (655us total) trans 4294967436 rc 0/0 00000100:00100000:0.0:1783965112.374859:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 41 00000100:00100000:1.0:1783965112.562473:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965112.562619:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715089664 00000100:00100000:3.0:1783965112.562635:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715089664 00000100:00100000:3.0:1783965112.562734:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 153 00000100:00100000:3.0:1783965112.562777:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e541500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9923189b-eb4a-470c-ab45-969435371000+40:11386:x1870622715089664:12345-192.168.204.12@tcp:101:cat.0 00010000:00010000:3.0:1783965112.562823:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783965112.562855:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27000/0xe782b916994fdec4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5f018c expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965112.563024:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fdecb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965112.563055:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fdecb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965112.563070:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fdecb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783965112.563084:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1783965112.564354:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27000/0xe782b916994fdec4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f018c expref: 43 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965112.564388:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fdecb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f018c expref: 42 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965112.564398:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff947402a2d200) 00010000:00010000:3.0:1783965112.564401:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783965112.564406:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff947436f26200, rc 0) 00000100:00100000:3.0:1783965112.564576:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e541500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9923189b-eb4a-470c-ab45-969435371000+42:11386:x1870622715089664:12345-192.168.204.12@tcp:101:cat.0 Request processed in 1802us (2117us total) trans 4294967437 rc 0/0 00000100:00100000:3.0:1783965112.564586:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 153 00000100:00100000:1.0:1783965112.580060:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783965112.580299:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715089920 00000100:00100000:0.0:1783965112.580317:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715089920 00000100:00100000:0.0:1783965112.580411:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 42 00000100:00100000:0.0:1783965112.580424:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e542d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9923189b-eb4a-470c-ab45-969435371000+42:11386:x1870622715089920:12345-192.168.204.12@tcp:35:cat.0 00000100:00100000:0.0:1783965112.581395:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e542d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9923189b-eb4a-470c-ab45-969435371000+43:11386:x1870622715089920:12345-192.168.204.12@tcp:35:cat.0 Request processed in 960us (1339us total) trans 4294967438 rc 0/0 00000100:00100000:0.0:1783965112.581411:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 42 00000100:00100000:3.0:1783965112.584978:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965112.585976:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715090048 00000100:00100000:1.0:1783965112.585989:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715090048 00000100:00100000:1.0:1783965112.586075:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 11 00000100:00100000:1.0:1783965112.586087:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94741843d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9923189b-eb4a-470c-ab45-969435371000+43:2358:x1870622715090048:12345-192.168.204.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783965112.586106:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783965112.586301:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fdecb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f018c expref: 43 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965112.586323:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff947402a2d200) 00010000:00010000:1.0:1783965112.586328:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783965112.586406:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94741843d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9923189b-eb4a-470c-ab45-969435371000+42:2358:x1870622715090048:12345-192.168.204.12@tcp:103:ldlm_bl.0 Request processed in 321us (1445us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965112.586414:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 11 00000100:00100000:3.0:1783965112.658761:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965112.659616:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715090304 00000100:00100000:1.0:1783965112.659627:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715090304 00000100:00100000:1.0:1783965112.659740:0:6632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 154 00000100:00100000:1.0:1783965112.659751:0:6632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743d9c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9923189b-eb4a-470c-ab45-969435371000+42:11392:x1870622715090304:12345-192.168.204.12@tcp:101:dd.0 00010000:00010000:1.0:1783965112.659782:0:6632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783965112.659785:0:6632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1783965112.659821:0:6632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fde31 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0162 expref: 42 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965112.659843:0:6632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94740a90c500) 00010000:00010000:1.0:1783965112.659858:0:6632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783965112.659874:0:6632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef800/0xe782b916994fded9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5f0193 expref: -99 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965112.659994:0:6632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994fdee0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965112.660007:0:6632:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8ec00/0xe782b916994fdeaf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0185 expref: 42 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965112.660016:0:6632:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994fdee0 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965112.660048:0:6632:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8ec00/0xe782b916994fdeaf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0185 expref: 42 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965112.660071:0:6632:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8ec00/0xe782b916994fdeaf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0185 expref: 42 pid: 5811 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783965112.660086:0:6632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e542a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6632:1870622732917376:192.168.204.12@tcp:104: 00000100:00100000:1.0:1783965112.660186:0:6632:0:(client.c:2702:ptlrpc_set_wait()) set ffff947436de0180 going to sleep for 11 seconds 00000100:00100000:3.0:1783965112.664172:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783965112.664249:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715090432 00000100:00100000:0.0:1783965112.664259:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715090432 00010000:00010000:0.0:1783965112.664301:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8ec00/0xe782b916994fdeaf lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0185 expref: 43 pid: 5811 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783965112.664335:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 65 00000100:00100000:0.0:1783965112.664346:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743d9cad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9923189b-eb4a-470c-ab45-969435371000+43:2360:x1870622715090432:12345-192.168.204.12@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783965112.664374:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783965112.664381:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8ec00/0xe782b916994fdeaf lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0185 expref: 43 pid: 5811 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965112.664394:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8ec00/0xe782b916994fdeaf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0185 expref: 43 pid: 5811 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965112.664416:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff947402a2d200) 00010000:00010000:0.0:1783965112.664422:0:5797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994fdee0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965112.664431:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994fdee0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965112.664440:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994fdee0 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965112.664459:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783965112.664515:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743d9cad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9923189b-eb4a-470c-ab45-969435371000+43:2360:x1870622715090432:12345-192.168.204.12@tcp:103:ldlm_bl.0 Request processed in 169us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965112.664523:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 65 00010000:00010000:1.0:1783965112.665326:0:6632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8ec00/0xe782b916994fdeaf lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0185 expref: 42 pid: 5811 timeout: 446 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783965112.665347:0:6632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e542a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6632:1870622732917376:192.168.204.12@tcp:104: 00010000:00010000:1.0:1783965112.665372:0:6632:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994fdee0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965112.665381:0:6632:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994fdee0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965112.665408:0:6632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994fdee0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783965112.665430:0:6632:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:1.0:1783965112.665600:0:6632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef800/0xe782b916994fded9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0193 expref: 43 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965112.665623:0:6632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994fdee0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0193 expref: 42 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965112.665631:0:6632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff947402a2d200) 00010000:00010000:1.0:1783965112.665634:0:6632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1783965112.665637:0:6632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94743d9ee800, rc 0) 00000100:00100000:1.0:1783965112.665690:0:6632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743d9c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9923189b-eb4a-470c-ab45-969435371000+42:11392:x1870622715090304:12345-192.168.204.12@tcp:101:dd.0 Request processed in 5940us (6940us total) trans 4294967439 rc 0/0 00000100:00100000:1.0:1783965112.665698:0:6632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 154 00000100:00100000:3.0:1783965112.670105:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965112.670237:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715090688 00000100:00100000:2.0:1783965112.670247:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715090688 00000100:00100000:2.0:1783965112.670304:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 155 00000100:00100000:2.0:1783965112.670328:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743d9c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9923189b-eb4a-470c-ab45-969435371000+42:11392:x1870622715090688:12345-192.168.204.12@tcp:36:dd.0 00010000:00010000:2.0:1783965112.670629:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e800/0xe782b916994fdeee lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965112.670649:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e800/0xe782b916994fdeee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965112.670663:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e800/0xe782b916994fdeee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783965112.670721:0:5811:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:2.0:1783965112.670748:0:5811:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ccc591fb reply state 00000000510b3c2a transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e800/0xe782b916994fdeee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783965112.670757:0:5811:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783965112.670917:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743d9c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9923189b-eb4a-470c-ab45-969435371000+45:11392:x1870622715090688:12345-192.168.204.12@tcp:36:dd.0 Request processed in 589us (821us total) trans 4294967441 rc 0/0 00000100:00100000:2.0:1783965112.670924:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 155 00000020:00080000:2.0:1783965112.670929:0:5811:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1783965112.672517:0:3309:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e800/0xe782b916994fdeee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965112.672532:0:3309:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e800/0xe782b916994fdeee lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965112.672539:0:3309:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e800/0xe782b916994fdeee lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965112.672554:0:3309:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743fb8e800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1783965112.672560:0:3309:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e800/0xe782b916994fdeee lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965112.672568:0:3309:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e800/0xe782b916994fdeee lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965112.672584:0:3309:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff947402a2d200) 00010000:00010000:3.0:1783965112.672587:0:3309:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783965112.672592:0:3309:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e800/0xe782b916994fdeee lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965112.672599:0:3309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e800/0xe782b916994fdeee lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965113.003579:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783965113.006789:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965113.006905:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715090816 00000100:00100000:2.0:1783965113.006916:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715090816 00000100:00100000:2.0:1783965113.006990:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 156 00000100:00100000:2.0:1783965113.007001:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743d9cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9923189b-eb4a-470c-ab45-969435371000+44:11406:x1870622715090816:12345-192.168.204.12@tcp:101:stat.0 00010000:00010000:2.0:1783965113.007030:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783965113.007053:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fa00/0xe782b916994fdef5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5f019a expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965113.007122:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e800/0xe782b916994fdefc lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965113.007154:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e800/0xe782b916994fdefc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965113.007166:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e800/0xe782b916994fdefc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965113.007183:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8ec00/0xe782b916994fdf03 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965113.007190:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8ec00/0xe782b916994fdf03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965113.007195:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8ec00/0xe782b916994fdf03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965113.007329:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fe00/0xe782b916994fdf0a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965113.007340:0:5813:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994fdee0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0193 expref: 45 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965113.007348:0:5813:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fe00/0xe782b916994fdf0a lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1783965113.007655:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1783965113.007712:0:5813:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994fdee0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0193 expref: 45 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965113.007728:0:5813:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994fdee0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0193 expref: 45 pid: 6632 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783965113.007758:0:5813:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e2a5500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5813:1870622732917504:192.168.204.12@tcp:104: 00000100:00100000:2.0:1783965113.007983:0:5813:0:(client.c:2702:ptlrpc_set_wait()) set ffff9474400a4480 going to sleep for 11 seconds 00000100:00100000:2.0:1783965113.015304:0:5813:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e2a5500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5813:1870622732917504:192.168.204.12@tcp:104: 00010000:00010000:2.0:1783965113.015335:0:5813:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fe00/0xe782b916994fdf0a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783965113.017473:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783965113.021980:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715091072 00000100:00100000:0.0:1783965113.021997:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715091072 00000100:00100000:0.0:1783965113.022348:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 43 00000100:00100000:0.0:1783965113.022363:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743d9c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9923189b-eb4a-470c-ab45-969435371000+46:5571:x1870622715091072:12345-192.168.204.12@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1783965113.023332:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743d9c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9923189b-eb4a-470c-ab45-969435371000+47:5571:x1870622715091072:12345-192.168.204.12@tcp:35:ldlm_bl.0 Request processed in 968us (5863us total) trans 4294967442 rc 0/0 00000100:00100000:0.0:1783965113.023343:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 43 00000100:00100000:0.0:1783965113.028506:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965113.028618:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715091200 00000100:00100000:1.0:1783965113.028628:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715091200 00010000:00010000:1.0:1783965113.028671:0:5799:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994fdee0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0193 expref: 47 pid: 6632 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783965113.028714:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 66 00000100:00100000:1.0:1783965113.028726:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436c3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9923189b-eb4a-470c-ab45-969435371000+47:2360:x1870622715091200:12345-192.168.204.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783965113.028748:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783965113.028757:0:5799:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994fdee0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0193 expref: 47 pid: 6632 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965113.028796:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994fdee0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0193 expref: 47 pid: 6632 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965113.028825:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994fdee0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0193 expref: 47 pid: 6632 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965113.028852:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff947402a2d200) 00010000:00010000:1.0:1783965113.028858:0:5799:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fe00/0xe782b916994fdf0a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965113.028867:0:5799:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fe00/0xe782b916994fdf0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965113.028875:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fe00/0xe782b916994fdf0a lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965113.028909:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783965113.029080:0:5813:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fe00/0xe782b916994fdf0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965113.029090:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fe00/0xe782b916994fdf0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783965113.029140:0:5813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1783965113.029144:0:5813:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1783965113.029170:0:5813:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fe00/0xe782b916994fdf0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965113.029182:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fe00/0xe782b916994fdf0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965113.029193:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e800/0xe782b916994fdefc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965113.029235:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e800/0xe782b916994fdefc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965113.029243:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e800/0xe782b916994fdefc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965113.029248:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743fb8e800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1783965113.029259:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e800/0xe782b916994fdefc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965113.029266:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e800/0xe782b916994fdefc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965113.029289:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94740a90c500) 00010000:00010000:2.0:1783965113.029293:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783965113.029297:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e800/0xe782b916994fdefc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965113.029302:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e800/0xe782b916994fdefc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965113.029315:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8ec00/0xe782b916994fdf03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965113.029319:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8ec00/0xe782b916994fdf03 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965113.029324:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8ec00/0xe782b916994fdf03 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965113.029329:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743fb8ec00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1783965113.029331:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8ec00/0xe782b916994fdf03 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965113.029336:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8ec00/0xe782b916994fdf03 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965113.029342:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff947402a2dc00) 00010000:00010000:2.0:1783965113.029344:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783965113.029354:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8ec00/0xe782b916994fdf03 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965113.029360:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8ec00/0xe782b916994fdf03 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965113.029399:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fa00/0xe782b916994fdef5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f019a expref: 47 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965113.029412:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fe00/0xe782b916994fdf0a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f019a expref: 46 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965113.029419:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff947402a2d200) 00010000:00010000:2.0:1783965113.029422:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783965113.029424:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94743fb8fe00, rc 0) 00000100:00100000:1.0:1783965113.029602:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436c3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9923189b-eb4a-470c-ab45-969435371000+46:2360:x1870622715091200:12345-192.168.204.12@tcp:103:ldlm_bl.0 Request processed in 878us (1105us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965113.029611:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 66 00000100:00100000:2.0:1783965113.029919:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743d9cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9923189b-eb4a-470c-ab45-969435371000+45:11406:x1870622715090816:12345-192.168.204.12@tcp:101:stat.0 Request processed in 22920us (23140us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965113.029927:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 156 00000100:00100000:3.0:1783965113.133851:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965113.136455:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715091456 00000100:00100000:2.0:1783965113.136471:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715091456 00000100:00100000:0.0:1783965113.136755:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 157 00000100:00100000:0.0:1783965113.136767:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436e39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9923189b-eb4a-470c-ab45-969435371000+45:11412:x1870622715091456:12345-192.168.204.12@tcp:36:truncate.0 00010000:00010000:0.0:1783965113.136829:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783965113.136858:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fe00/0xe782b916994fdf0a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f019a expref: 45 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965113.137174:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff947402a2d200) 00010000:00010000:0.0:1783965113.137180:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783965113.137941:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fd600/0xe782b916994fdf11 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965113.137958:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fd600/0xe782b916994fdf11 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965113.137967:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fd600/0xe782b916994fdf11 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783965113.138019:0:5811:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:0.0:1783965113.138047:0:5811:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000951ee530 reply state 00000000c494e719 transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fd600/0xe782b916994fdf11 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783965113.138056:0:5811:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783965113.138174:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436e39f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9923189b-eb4a-470c-ab45-969435371000+47:11412:x1870622715091456:12345-192.168.204.12@tcp:36:truncate.0 Request processed in 1403us (6289us total) trans 4294967444 rc 0/0 00000100:00100000:0.0:1783965113.138182:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 157 00000020:00080000:0.0:1783965113.138188:0:5811:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1783965113.142782:0:3308:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fd600/0xe782b916994fdf11 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965113.142817:0:3308:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fd600/0xe782b916994fdf11 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965113.142825:0:3308:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fd600/0xe782b916994fdf11 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965113.142832:0:3308:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743e2fd600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1783965113.142837:0:3308:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fd600/0xe782b916994fdf11 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965113.142846:0:3308:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fd600/0xe782b916994fdf11 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965113.142861:0:3308:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff947402a2d200) 00010000:00010000:3.0:1783965113.142865:0:3308:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783965113.142879:0:3308:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fd600/0xe782b916994fdf11 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965113.142885:0:3308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fd600/0xe782b916994fdf11 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783965113.314140:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965113.322066:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715091584 00000100:00100000:1.0:1783965113.322083:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715091584 00000100:00100000:1.0:1783965113.322166:0:6632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 158 00000100:00100000:1.0:1783965113.322177:0:6632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436e3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9923189b-eb4a-470c-ab45-969435371000+46:11427:x1870622715091584:12345-192.168.204.12@tcp:101:stat.0 00010000:00010000:1.0:1783965113.322219:0:6632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783965113.322243:0:6632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef800/0xe782b916994fdf18 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5f01a1 expref: -99 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965113.322333:0:6632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eee00/0xe782b916994fdf1f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965113.322348:0:6632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eee00/0xe782b916994fdf1f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965113.322360:0:6632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eee00/0xe782b916994fdf1f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965113.322384:0:6632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efe00/0xe782b916994fdf26 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965113.322392:0:6632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efe00/0xe782b916994fdf26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965113.322399:0:6632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efe00/0xe782b916994fdf26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965113.322498:0:6632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef000/0xe782b916994fdf2d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965113.322507:0:6632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef000/0xe782b916994fdf2d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965113.322515:0:6632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef000/0xe782b916994fdf2d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783965113.322561:0:6632:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:1.0:1783965113.322565:0:6632:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1783965113.322584:0:6632:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef000/0xe782b916994fdf2d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965113.322614:0:6632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef000/0xe782b916994fdf2d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965113.322623:0:6632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eee00/0xe782b916994fdf1f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965113.322629:0:6632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eee00/0xe782b916994fdf1f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965113.322636:0:6632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eee00/0xe782b916994fdf1f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965113.322643:0:6632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743d9eee00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1783965113.322657:0:6632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eee00/0xe782b916994fdf1f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965113.322666:0:6632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eee00/0xe782b916994fdf1f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965113.322679:0:6632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94740a90c500) 00010000:00010000:1.0:1783965113.322682:0:6632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783965113.322686:0:6632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eee00/0xe782b916994fdf1f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965113.322692:0:6632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eee00/0xe782b916994fdf1f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965113.322707:0:6632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efe00/0xe782b916994fdf26 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965113.322713:0:6632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efe00/0xe782b916994fdf26 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965113.322724:0:6632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efe00/0xe782b916994fdf26 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965113.322728:0:6632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743d9efe00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1783965113.322731:0:6632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efe00/0xe782b916994fdf26 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965113.322737:0:6632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efe00/0xe782b916994fdf26 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965113.322744:0:6632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff947407b5c200) 00010000:00010000:1.0:1783965113.322746:0:6632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783965113.322749:0:6632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efe00/0xe782b916994fdf26 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965113.322754:0:6632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efe00/0xe782b916994fdf26 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965113.322790:0:6632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef800/0xe782b916994fdf18 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f01a1 expref: 48 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965113.322803:0:6632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef000/0xe782b916994fdf2d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f01a1 expref: 47 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965113.322810:0:6632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff947402a2d200) 00010000:00010000:1.0:1783965113.322812:0:6632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783965113.322814:0:6632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94743d9ef000, rc 0) 00000100:00100000:1.0:1783965113.322891:0:6632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436e3a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9923189b-eb4a-470c-ab45-969435371000+47:11427:x1870622715091584:12345-192.168.204.12@tcp:101:stat.0 Request processed in 715us (8760us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965113.322908:0:6632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 158 00000100:00100000:2.0:1783965113.418571:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965113.419988:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715091840 00000100:00100000:3.0:1783965113.420008:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715091840 00000100:00100000:3.0:1783965113.420792:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 159 00000100:00100000:3.0:1783965113.420810:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e2a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9923189b-eb4a-470c-ab45-969435371000+47:11437:x1870622715091840:12345-192.168.204.12@tcp:101:lfs.0 00010000:00010000:3.0:1783965113.421196:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783965113.421490:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27000/0xe782b916994fdf34 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5f01a8 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783965113.422139:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:3.0:1783965113.422447:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27000/0xe782b916994fdf34 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f01a8 expref: 49 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965113.422467:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94740b97a600) 00010000:00010000:3.0:1783965113.422470:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783965113.422477:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27000/0xe782b916994fdf34 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f01a8 expref: 49 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965113.422493:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff947436f27000, rc 0) 00000100:00100000:3.0:1783965113.422608:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e2a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9923189b-eb4a-470c-ab45-969435371000+48:11437:x1870622715091840:12345-192.168.204.12@tcp:101:lfs.0 Request processed in 1800us (4050us total) trans 4294967445 rc 301/301 00000100:00100000:3.0:1783965113.422618:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 159 00000100:00100000:3.0:1783965113.429944:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965113.430163:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715092096 00000100:00100000:2.0:1783965113.430176:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715092096 00000100:00100000:2.0:1783965113.430272:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 44 00000100:00100000:2.0:1783965113.430285:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947406388c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9923189b-eb4a-470c-ab45-969435371000+48:11437:x1870622715092096:12345-192.168.204.12@tcp:35:lfs.0 00000100:00100000:2.0:1783965113.431001:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947406388c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9923189b-eb4a-470c-ab45-969435371000+49:11437:x1870622715092096:12345-192.168.204.12@tcp:35:lfs.0 Request processed in 716us (1069us total) trans 4294967446 rc 0/0 00000100:00100000:2.0:1783965113.431012:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 44 00000001:00080000:1.0:1783965113.443049:0:5835:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967444 is committed 00000020:00080000:1.0:1783965113.443089:0:5835:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff94743e29f780 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:1.0:1783965113.443097:0:5835:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff94742a5dc800 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff94743e29fcc0 00000020:00080000:1.0:1783965113.443101:0:5835:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff94742a5dc900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff947437068000 00000004:00080000:1.0:1783965113.443286:0:5835:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:2.0:1783965113.443828:0:5846:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:2.0:1783965113.444072:0:5846:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:2.0:1783965113.444087:0:3324:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783965113.444115:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743648f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3324:1870622732917632:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1783965113.444390:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783965113.444825:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732917632 00000100:00100000:3.0:1783965113.444837:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732917632 00000100:00100000:3.0:1783965113.444918:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1783965113.444930:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e2c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3324:x1870622732917632:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1783965113.444980:0:6606:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:4 count 1 00002000:00010000:3.0:1783965113.445028:0:6606:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a5525b7, atime: 0x6a5525b7, ctime: 0x6a5525b7, blocks: 0x1 00010000:00010000:3.0:1783965113.445037:0:6606:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000453bd738/0xe782b916994fdf42 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965113.445059:0:6606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=347s v=(0 0) 00010000:00010000:3.0:1783965113.445064:0:6606:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783965113.445073:0:6606:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000453bd738/0xe782b916994fdf42 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965113.445104:0:6606:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000453bd738/0xe782b916994fdf42 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965113.445116:0:6606:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000453bd738/0xe782b916994fdf42 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965113.445314:0:6606:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000453bd738/0xe782b916994fdf42 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965113.445335:0:6606:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783965113.445683:0:5800:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783965113.445693:0:5800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000453bd738/0xe782b916994fdf42 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965113.445703:0:5800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947436f27000 already unused, calling callback (ffffffffc168d230) 00010000:00010000:1.0:1783965113.445708:0:5800:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000453bd738/0xe782b916994fdf42 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965113.445718:0:5800:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000453bd738/0xe782b916994fdf42 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965113.445740:0:5800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000453bd738/0xe782b916994fdf42 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965113.445750:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000453bd738/0xe782b916994fdf42 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6606 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965113.445774:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783965113.445776:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783965113.445785:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1783965113.446622:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783965113.446750:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e2c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3324:x1870622732917632:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1816us (2355us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1783965113.446761:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000004:00080000:1.0:1783965113.448807:0:3324:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94743648f480/2, rc 0, transno 4294967307 00000100:00100000:1.0:1783965113.448830:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743648f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3324:1870622732917632:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1783965113.509065:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965113.509289:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715092352 00000100:00100000:1.0:1783965113.509303:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715092352 00000100:00100000:1.0:1783965113.509384:0:6632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 160 00000100:00100000:1.0:1783965113.509396:0:6632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743648d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9923189b-eb4a-470c-ab45-969435371000+19:11443:x1870622715092352:12345-192.168.204.12@tcp:101:bash.0 00010000:00010000:1.0:1783965113.509441:0:6632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783965113.509471:0:6632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef800/0xe782b916994fdf49 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5f01af expref: -99 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965113.509707:0:6632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efe00/0xe782b916994fdf50 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965113.509726:0:6632:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef000/0xe782b916994fdf2d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f01a1 expref: 20 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965113.509735:0:6632:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efe00/0xe782b916994fdf50 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965113.509781:0:6632:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef000/0xe782b916994fdf2d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f01a1 expref: 20 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965113.509797:0:6632:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef000/0xe782b916994fdf2d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f01a1 expref: 20 pid: 6632 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783965113.509814:0:6632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e542a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6632:1870622732917760:192.168.204.12@tcp:104: 00000100:00100000:1.0:1783965113.509940:0:6632:0:(client.c:2702:ptlrpc_set_wait()) set ffff947436de0180 going to sleep for 11 seconds 00000100:00100000:3.0:1783965113.516301:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965113.516323:0:6632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e542a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6632:1870622732917760:192.168.204.12@tcp:104: 00010000:00010000:1.0:1783965113.516366:0:6632:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efe00/0xe782b916994fdf50 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783965113.516445:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715092480 00000100:00100000:0.0:1783965113.516455:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715092480 00010000:00010000:0.0:1783965113.516509:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef000/0xe782b916994fdf2d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f01a1 expref: 21 pid: 6632 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783965113.516593:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 67 00000100:00100000:0.0:1783965113.516605:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743648d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9923189b-eb4a-470c-ab45-969435371000+21:2359:x1870622715092480:12345-192.168.204.12@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783965113.516625:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783965113.516633:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef000/0xe782b916994fdf2d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f01a1 expref: 21 pid: 6632 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965113.516649:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef000/0xe782b916994fdf2d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f01a1 expref: 21 pid: 6632 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965113.516679:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef000/0xe782b916994fdf2d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f01a1 expref: 21 pid: 6632 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965113.516710:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff947402a2d200) 00010000:00010000:0.0:1783965113.516716:0:5797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efe00/0xe782b916994fdf50 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965113.516728:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efe00/0xe782b916994fdf50 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965113.516737:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efe00/0xe782b916994fdf50 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965113.516770:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783965113.516841:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743648d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9923189b-eb4a-470c-ab45-969435371000+20:2359:x1870622715092480:12345-192.168.204.12@tcp:103:ldlm_bl.0 Request processed in 237us (555us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965113.516849:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 67 00010000:00010000:1.0:1783965113.516962:0:6632:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efe00/0xe782b916994fdf50 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965113.516971:0:6632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efe00/0xe782b916994fdf50 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783965113.516996:0:6632:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:1.0:1783965113.517257:0:6632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef800/0xe782b916994fdf49 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f01af expref: 21 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965113.517278:0:6632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efe00/0xe782b916994fdf50 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f01af expref: 20 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965113.517286:0:6632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff947402a2d200) 00010000:00010000:1.0:1783965113.517289:0:6632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1783965113.517292:0:6632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94743d9efe00, rc 0) 00000100:00100000:1.0:1783965113.517335:0:6632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743648d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9923189b-eb4a-470c-ab45-969435371000+20:11443:x1870622715092352:12345-192.168.204.12@tcp:101:bash.0 Request processed in 7942us (8293us total) trans 4294967447 rc 0/0 00000100:00100000:1.0:1783965113.517343:0:6632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 160 00000100:00100000:2.0:1783965113.522428:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965113.522577:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715092736 00000100:00100000:3.0:1783965113.522591:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715092736 00000100:00100000:3.0:1783965113.522664:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 161 00000100:00100000:3.0:1783965113.522677:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743d9c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9923189b-eb4a-470c-ab45-969435371000+20:11443:x1870622715092736:12345-192.168.204.12@tcp:36:bash.0 00010000:00010000:3.0:1783965113.523494:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27c00/0xe782b916994fdf5e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965113.523521:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27c00/0xe782b916994fdf5e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965113.523545:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27c00/0xe782b916994fdf5e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783965113.523641:0:5812:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:3.0:1783965113.523672:0:5812:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000fb406976 reply state 000000004fd318e1 transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27c00/0xe782b916994fdf5e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783965113.523683:0:5812:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783965113.523851:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743d9c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9923189b-eb4a-470c-ab45-969435371000+23:11443:x1870622715092736:12345-192.168.204.12@tcp:36:bash.0 Request processed in 1173us (1446us total) trans 4294967449 rc 0/0 00000100:00100000:3.0:1783965113.523860:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 161 00000020:00080000:3.0:1783965113.523867:0:5812:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1783965113.527131:0:3309:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27c00/0xe782b916994fdf5e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965113.527155:0:3309:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27c00/0xe782b916994fdf5e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965113.527165:0:3309:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27c00/0xe782b916994fdf5e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965113.527171:0:3309:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947436f27c00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1783965113.527177:0:3309:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27c00/0xe782b916994fdf5e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965113.527185:0:3309:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27c00/0xe782b916994fdf5e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965113.527289:0:3309:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff947402a2d200) 00010000:00010000:3.0:1783965113.527293:0:3309:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783965113.527299:0:3309:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27c00/0xe782b916994fdf5e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965113.527306:0:3309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27c00/0xe782b916994fdf5e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783965113.532629:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965113.532959:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715092864 00000100:00100000:3.0:1783965113.532974:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715092864 00000100:00100000:1.0:1783965113.533119:0:6632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 162 00000100:00100000:1.0:1783965113.533136:0:6632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743d9cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9923189b-eb4a-470c-ab45-969435371000+22:11443:x1870622715092864:12345-192.168.204.12@tcp:101:bash.0 00010000:00010000:1.0:1783965113.533174:0:6632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783965113.533245:0:6632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef800/0xe782b916994fdf65 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5f01b6 expref: -99 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965113.533658:0:6632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eee00/0xe782b916994fdf6c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965113.533681:0:6632:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efe00/0xe782b916994fdf50 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f01af expref: 23 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965113.533692:0:6632:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eee00/0xe782b916994fdf6c lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965113.534511:0:6632:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efe00/0xe782b916994fdf50 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f01af expref: 23 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965113.534553:0:6632:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efe00/0xe782b916994fdf50 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f01af expref: 23 pid: 6632 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783965113.534576:0:6632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e542a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6632:1870622732917888:192.168.204.12@tcp:104: 00000100:00100000:1.0:1783965113.534897:0:6632:0:(client.c:2702:ptlrpc_set_wait()) set ffff947436de0300 going to sleep for 11 seconds 00000100:00100000:1.0:1783965113.537625:0:6632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e542a00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6632:1870622732917888:192.168.204.12@tcp:104: 00010000:00010000:1.0:1783965113.537672:0:6632:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eee00/0xe782b916994fdf6c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783965113.540957:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965113.543629:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715092992 00000100:00100000:1.0:1783965113.543653:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715092992 00010000:00010000:1.0:1783965113.543731:0:5799:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efe00/0xe782b916994fdf50 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f01af expref: 24 pid: 6632 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783965113.543789:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 68 00000100:00100000:1.0:1783965113.543821:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743d9c9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9923189b-eb4a-470c-ab45-969435371000+24:2359:x1870622715092992:12345-192.168.204.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783965113.543843:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783965113.543852:0:5799:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efe00/0xe782b916994fdf50 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f01af expref: 24 pid: 6632 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965113.543869:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efe00/0xe782b916994fdf50 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f01af expref: 24 pid: 6632 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965113.543900:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efe00/0xe782b916994fdf50 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f01af expref: 24 pid: 6632 timeout: 447 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965113.543932:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff947402a2d200) 00010000:00010000:1.0:1783965113.543939:0:5799:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eee00/0xe782b916994fdf6c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965113.543950:0:5799:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eee00/0xe782b916994fdf6c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965113.543959:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eee00/0xe782b916994fdf6c lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965113.544013:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783965113.544106:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743d9c9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9923189b-eb4a-470c-ab45-969435371000+23:2359:x1870622715092992:12345-192.168.204.12@tcp:103:ldlm_bl.0 Request processed in 287us (3173us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965113.544115:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 68 00010000:00010000:2.0:1783965113.544264:0:6632:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eee00/0xe782b916994fdf6c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965113.544274:0:6632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eee00/0xe782b916994fdf6c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783965113.544339:0:6632:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:2.0:1783965113.544344:0:6632:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1783965113.544372:0:6632:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eee00/0xe782b916994fdf6c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965113.544426:0:6632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef800/0xe782b916994fdf65 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f01b6 expref: 23 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965113.544447:0:6632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eee00/0xe782b916994fdf6c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f01b6 expref: 22 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965113.544455:0:6632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff947402a2d200) 00010000:00010000:2.0:1783965113.544458:0:6632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783965113.544460:0:6632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94743d9eee00, rc 0) 00000100:00100000:2.0:1783965113.544504:0:6632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743d9cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9923189b-eb4a-470c-ab45-969435371000+22:11443:x1870622715092864:12345-192.168.204.12@tcp:101:bash.0 Request processed in 11373us (11893us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965113.544523:0:6632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 162 00000100:00100000:0.0:1783965113.550764:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965113.550882:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715093248 00000100:00100000:2.0:1783965113.550892:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715093248 00000100:00100000:2.0:1783965113.551018:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 45 00000100:00100000:2.0:1783965113.551030:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436c3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9923189b-eb4a-470c-ab45-969435371000+22:11443:x1870622715093248:12345-192.168.204.12@tcp:35:bash.0 00000100:00100000:2.0:1783965113.551511:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436c3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9923189b-eb4a-470c-ab45-969435371000+23:11443:x1870622715093248:12345-192.168.204.12@tcp:35:bash.0 Request processed in 481us (756us total) trans 4294967450 rc 0/0 00000100:00100000:2.0:1783965113.551521:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 45 00000100:00100000:0.0:1783965113.643455:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965113.643579:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715093504 00000100:00100000:2.0:1783965113.643590:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715093504 00000100:00100000:2.0:1783965113.643653:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 163 00000100:00100000:2.0:1783965113.643664:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436c3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9923189b-eb4a-470c-ab45-969435371000+23:11453:x1870622715093504:12345-192.168.204.12@tcp:101:lfs.0 00010000:00010000:2.0:1783965113.643690:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783965113.643715:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8ec00/0xe782b916994fdf73 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5f01bd expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783965113.644000:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:2.0:1783965113.644274:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8ec00/0xe782b916994fdf73 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f01bd expref: 25 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965113.644291:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94740b97a600) 00010000:00010000:2.0:1783965113.644294:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783965113.644300:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8ec00/0xe782b916994fdf73 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f01bd expref: 25 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965113.644312:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94743fb8ec00, rc 0) 00000100:00100000:2.0:1783965113.644368:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436c3d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9923189b-eb4a-470c-ab45-969435371000+24:11453:x1870622715093504:12345-192.168.204.12@tcp:101:lfs.0 Request processed in 706us (923us total) trans 4294967451 rc 301/301 00000100:00100000:2.0:1783965113.644375:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 163 00000100:00100000:3.0:1783965113.651491:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965113.651582:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715093632 00000100:00100000:2.0:1783965113.651601:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715093632 00000100:00100000:2.0:1783965113.651658:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 164 00000100:00100000:2.0:1783965113.651668:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743648f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9923189b-eb4a-470c-ab45-969435371000+24:11453:x1870622715093632:12345-192.168.204.12@tcp:34:lfs.0 00010000:00010000:2.0:1783965113.651741:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e800/0xe782b916994fdf81 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965113.651760:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e800/0xe782b916994fdf81 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965113.651773:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e800/0xe782b916994fdf81 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965113.651789:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fc00/0xe782b916994fdf88 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965113.651797:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fc00/0xe782b916994fdf88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965113.651803:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fc00/0xe782b916994fdf88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965113.652186:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e400/0xe782b916994fdf8f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965113.652197:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e400/0xe782b916994fdf8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965113.652228:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e400/0xe782b916994fdf8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1783965113.652282:0:5813:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e400/0xe782b916994fdf8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965113.652296:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e800/0xe782b916994fdf81 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965113.652303:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e800/0xe782b916994fdf81 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965113.652311:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e800/0xe782b916994fdf81 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965113.652318:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743fb8e800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1783965113.652322:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e800/0xe782b916994fdf81 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965113.652331:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e800/0xe782b916994fdf81 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965113.652344:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94740a90c500) 00010000:00010000:2.0:1783965113.652348:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783965113.652352:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e800/0xe782b916994fdf81 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965113.652360:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e800/0xe782b916994fdf81 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965113.653151:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fc00/0xe782b916994fdf88 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965113.653161:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fc00/0xe782b916994fdf88 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965113.653266:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fc00/0xe782b916994fdf88 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965113.653271:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743fb8fc00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1783965113.653274:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fc00/0xe782b916994fdf88 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965113.653281:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fc00/0xe782b916994fdf88 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965113.653293:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff947402a2d400) 00010000:00010000:2.0:1783965113.653296:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783965113.653299:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fc00/0xe782b916994fdf88 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965113.653304:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fc00/0xe782b916994fdf88 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965113.653322:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e400/0xe782b916994fdf8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965113.653328:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e400/0xe782b916994fdf8f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965113.653334:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e400/0xe782b916994fdf8f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965113.653338:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743fb8e400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1783965113.653341:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e400/0xe782b916994fdf8f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965113.653357:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e400/0xe782b916994fdf8f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965113.653366:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff947402a2d200) 00010000:00010000:2.0:1783965113.653369:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783965113.653453:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e400/0xe782b916994fdf8f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965113.653460:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e400/0xe782b916994fdf8f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783965113.653688:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743648f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9923189b-eb4a-470c-ab45-969435371000+24:11453:x1870622715093632:12345-192.168.204.12@tcp:34:lfs.0 Request processed in 2015us (2315us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965113.653698:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 164 00000100:00100000:0.0:1783965113.658146:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965113.658297:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715093888 00000100:00100000:3.0:1783965113.658308:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715093888 00000100:00100000:3.0:1783965113.658403:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 46 00000100:00100000:3.0:1783965113.658414:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947429f45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9923189b-eb4a-470c-ab45-969435371000+24:11453:x1870622715093888:12345-192.168.204.12@tcp:35:lfs.0 00000100:00100000:3.0:1783965113.659483:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947429f45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9923189b-eb4a-470c-ab45-969435371000+25:11453:x1870622715093888:12345-192.168.204.12@tcp:35:lfs.0 Request processed in 1065us (1340us total) trans 4294967452 rc 0/0 00000100:00100000:3.0:1783965113.659495:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 46 00000100:00100000:0.0:1783965113.700145:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965113.700336:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715094144 00000100:00100000:2.0:1783965113.700351:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715094144 00000100:00100000:2.0:1783965113.700543:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 165 00000100:00100000:2.0:1783965113.700559:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947429f46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9923189b-eb4a-470c-ab45-969435371000+25:11456:x1870622715094144:12345-192.168.204.12@tcp:101:lfs.0 00010000:00010000:2.0:1783965113.700606:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783965113.700639:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e400/0xe782b916994fdf96 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5f01c4 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965113.700755:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fc00/0xe782b916994fdf9d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965113.700774:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fc00/0xe782b916994fdf9d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965113.700789:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fc00/0xe782b916994fdf9d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965113.700831:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e800/0xe782b916994fdfa4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965113.700840:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e800/0xe782b916994fdfa4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965113.700848:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e800/0xe782b916994fdfa4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965113.701837:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8ec00/0xe782b916994fdfab lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965113.701853:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8ec00/0xe782b916994fdfab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965113.701863:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8ec00/0xe782b916994fdfab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783965113.701879:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1783965113.702275:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fc00/0xe782b916994fdf9d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965113.702286:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fc00/0xe782b916994fdf9d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965113.702293:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fc00/0xe782b916994fdf9d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965113.702300:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743fb8fc00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1783965113.702305:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fc00/0xe782b916994fdf9d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965113.702327:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fc00/0xe782b916994fdf9d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965113.702343:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94740a90c500) 00010000:00010000:2.0:1783965113.702347:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783965113.702352:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fc00/0xe782b916994fdf9d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965113.702360:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fc00/0xe782b916994fdf9d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965113.702374:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e800/0xe782b916994fdfa4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965113.702380:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e800/0xe782b916994fdfa4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965113.702386:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e800/0xe782b916994fdfa4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965113.702391:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743fb8e800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1783965113.702394:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e800/0xe782b916994fdfa4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965113.702400:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e800/0xe782b916994fdfa4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965113.702420:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff947402a2d400) 00010000:00010000:2.0:1783965113.702424:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783965113.702427:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e800/0xe782b916994fdfa4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965113.702444:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e800/0xe782b916994fdfa4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965113.702506:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e400/0xe782b916994fdf96 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f01c4 expref: 28 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965113.702523:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8ec00/0xe782b916994fdfab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f01c4 expref: 27 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965113.702544:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff947402a2d200) 00010000:00010000:2.0:1783965113.702547:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783965113.702550:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94743fb8ec00, rc 0) 00000100:00100000:2.0:1783965113.702923:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947429f46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9923189b-eb4a-470c-ab45-969435371000+27:11456:x1870622715094144:12345-192.168.204.12@tcp:101:lfs.0 Request processed in 2365us (2791us total) trans 4294967453 rc 0/0 00000100:00100000:2.0:1783965113.702934:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 165 00000100:00100000:0.0:1783965113.706888:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965113.707498:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715094272 00000100:00100000:1.0:1783965113.707523:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715094272 00000100:00100000:1.0:1783965113.707736:0:6632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 166 00000100:00100000:1.0:1783965113.707749:0:6632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e57dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9923189b-eb4a-470c-ab45-969435371000+27:11456:x1870622715094272:12345-192.168.204.12@tcp:54:lfs.0 00010000:00010000:1.0:1783965113.707877:0:6632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efe00/0xe782b916994fdfb9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965113.707900:0:6632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efe00/0xe782b916994fdfb9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965113.707916:0:6632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efe00/0xe782b916994fdfb9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965113.708091:0:6632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efe00/0xe782b916994fdfb9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965113.708100:0:6632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efe00/0xe782b916994fdfb9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965113.708109:0:6632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efe00/0xe782b916994fdfb9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965113.708116:0:6632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743d9efe00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1783965113.708121:0:6632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efe00/0xe782b916994fdfb9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965113.708134:0:6632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efe00/0xe782b916994fdfb9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965113.708149:0:6632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff947402a2d200) 00010000:00010000:1.0:1783965113.708152:0:6632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783965113.708158:0:6632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efe00/0xe782b916994fdfb9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965113.708165:0:6632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efe00/0xe782b916994fdfb9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783965113.708317:0:6632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e57dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9923189b-eb4a-470c-ab45-969435371000+27:11456:x1870622715094272:12345-192.168.204.12@tcp:54:lfs.0 Request processed in 570us (1443us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965113.708326:0:6632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 166 00000100:00100000:0.0:1783965113.712325:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783965113.712436:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965113.712726:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715094400 00000100:00100000:3.0:1783965113.712741:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715094400 00000100:00100000:3.0:1783965113.712835:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 12 00000100:00100000:3.0:1783965113.712848:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e57e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9923189b-eb4a-470c-ab45-969435371000+27:2358:x1870622715094400:12345-192.168.204.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783965113.712869:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783965113.712903:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8ec00/0xe782b916994fdfab lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f01c4 expref: 27 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965113.712930:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff947402a2d200) 00010000:00010000:3.0:1783965113.712937:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783965113.713028:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e57e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9923189b-eb4a-470c-ab45-969435371000+26:2358:x1870622715094400:12345-192.168.204.12@tcp:103:ldlm_bl.0 Request processed in 182us (591us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965113.713037:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 12 00000100:00100000:2.0:1783965113.714907:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715094656 00000100:00100000:2.0:1783965113.714925:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715094656 00000100:00100000:2.0:1783965113.715088:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 47 00000100:00100000:2.0:1783965113.715098:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e57df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9923189b-eb4a-470c-ab45-969435371000+26:11456:x1870622715094656:12345-192.168.204.12@tcp:35:lfs.0 00000100:00100000:2.0:1783965113.715442:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e57df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9923189b-eb4a-470c-ab45-969435371000+27:11456:x1870622715094656:12345-192.168.204.12@tcp:35:lfs.0 Request processed in 345us (3133us total) trans 4294967454 rc 0/0 00000100:00100000:2.0:1783965113.715451:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 47 00000100:00100000:0.0:1783965113.857776:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965113.857889:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715094912 00000100:00100000:3.0:1783965113.857904:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715094912 00000100:00100000:3.0:1783965113.858034:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 167 00000100:00100000:3.0:1783965113.858072:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e57f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9923189b-eb4a-470c-ab45-969435371000+27:11474:x1870622715094912:12345-192.168.204.12@tcp:101:cat.0 00010000:00010000:3.0:1783965113.858107:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783965113.858136:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27c00/0xe782b916994fdfc0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5f01cb expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965113.858338:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27600/0xe782b916994fdfc7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965113.858358:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27600/0xe782b916994fdfc7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965113.858375:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27600/0xe782b916994fdfc7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783965113.858388:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1783965113.858759:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27c00/0xe782b916994fdfc0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f01cb expref: 30 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965113.858782:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27600/0xe782b916994fdfc7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f01cb expref: 29 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965113.858792:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff947402a2d200) 00010000:00010000:3.0:1783965113.858796:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1783965113.858799:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff947436f27600, rc 0) 00000100:00100000:3.0:1783965113.858883:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e57f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9923189b-eb4a-470c-ab45-969435371000+29:11474:x1870622715094912:12345-192.168.204.12@tcp:101:cat.0 Request processed in 813us (1121us total) trans 4294967455 rc 0/0 00000100:00100000:3.0:1783965113.858892:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 167 00000100:00100000:0.0:1783965113.880192:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965113.880328:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715095040 00000100:00100000:3.0:1783965113.880342:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715095040 00000100:00100000:3.0:1783965113.880601:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 168 00000100:00100000:3.0:1783965113.880615:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e57d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9923189b-eb4a-470c-ab45-969435371000+29:11475:x1870622715095040:12345-192.168.204.12@tcp:101:lfs.0 00010000:00010000:3.0:1783965113.880651:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783965113.880678:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27c00/0xe782b916994fdfd5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5f01d2 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965113.880767:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26400/0xe782b916994fdfdc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965113.880784:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26400/0xe782b916994fdfdc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965113.880799:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26400/0xe782b916994fdfdc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783965113.881076:0:5813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:3.0:1783965113.881082:0:5813:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1783965113.881170:0:5813:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26400/0xe782b916994fdfdc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965113.881253:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27c00/0xe782b916994fdfd5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f01d2 expref: 31 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965113.881276:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26400/0xe782b916994fdfdc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f01d2 expref: 30 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965113.881286:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94740a90c500) 00010000:00010000:3.0:1783965113.881289:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783965113.881294:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff947436f26400, rc 0) 00000100:00100000:3.0:1783965113.881372:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e57d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9923189b-eb4a-470c-ab45-969435371000+30:11475:x1870622715095040:12345-192.168.204.12@tcp:101:lfs.0 Request processed in 761us (1194us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965113.881387:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 168 00000100:00100000:0.0:1783965113.886150:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965113.886258:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715095424 00000100:00100000:3.0:1783965113.886273:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715095424 00000100:00100000:3.0:1783965113.886349:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 48 00000100:00100000:3.0:1783965113.886361:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e57d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9923189b-eb4a-470c-ab45-969435371000+30:11475:x1870622715095424:12345-192.168.204.12@tcp:35:lfs.0 00000100:00100000:3.0:1783965113.886855:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e57d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9923189b-eb4a-470c-ab45-969435371000+31:11475:x1870622715095424:12345-192.168.204.12@tcp:35:lfs.0 Request processed in 494us (720us total) trans 4294967456 rc 0/0 00000100:00100000:3.0:1783965113.886865:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 48 00000100:00100000:0.0:1783965113.889477:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965113.889755:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715095552 00000100:00100000:2.0:1783965113.889769:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715095552 00000100:00100000:2.0:1783965113.889853:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 13 00000100:00100000:2.0:1783965113.889867:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947429f99180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9923189b-eb4a-470c-ab45-969435371000+31:11475:x1870622715095552:12345-192.168.204.12@tcp:103:lfs.0 00010000:00010000:2.0:1783965113.889906:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1783965113.889997:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eee00/0xe782b916994fdf6c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f01b6 expref: 31 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965113.890037:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27600/0xe782b916994fdfc7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f01cb expref: 30 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965113.890107:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f800/0xe782b916994fde70 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0177 expref: 29 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965113.890120:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff947402a2d200) 00010000:00010000:2.0:1783965113.890132:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783965113.890280:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947429f99180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9923189b-eb4a-470c-ab45-969435371000+28:11475:x1870622715095552:12345-192.168.204.12@tcp:103:lfs.0 Request processed in 416us (815us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965113.890289:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 13 00000100:00100000:0.0:1783965113.892801:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965113.892910:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715095680 00000100:00100000:2.0:1783965113.892922:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715095680 00000100:00100000:2.0:1783965113.893139:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 169 00000100:00100000:2.0:1783965113.893154:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947429f99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9923189b-eb4a-470c-ab45-969435371000+28:11475:x1870622715095680:12345-192.168.204.12@tcp:58:lfs.0 00010000:00010000:2.0:1783965113.893331:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e400/0xe782b916994fdfe3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965113.893352:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e400/0xe782b916994fdfe3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965113.893365:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e400/0xe782b916994fdfe3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783965113.893852:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:2.0:1783965113.893994:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947429f99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9923189b-eb4a-470c-ab45-969435371000+28:11475:x1870622715095680:12345-192.168.204.12@tcp:58:lfs.0 Request processed in 843us (1206us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965113.894002:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 169 00000100:00100000:0.0:1783965113.904113:0:3323:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783965113.904147:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e43b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3323:1870622732918016:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783965113.904261:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783965113.904335:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732918016 00000100:00100000:1.0:1783965113.904346:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732918016 00000100:00100000:0.0:1783965113.906349:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1783965113.906368:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e438a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3323:x1870622732918016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783965113.906423:0:6611:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783965113.906784:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e438a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3323:x1870622732918016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 419us (2522us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965113.906793:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1783965113.907132:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e43b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3323:1870622732918016:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1783965113.912884:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965113.912999:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715095808 00000100:00100000:1.0:1783965113.913016:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715095808 00000100:00100000:1.0:1783965113.913091:0:6632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 170 00000100:00100000:1.0:1783965113.913103:0:6632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e43b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9923189b-eb4a-470c-ab45-969435371000+28:11477:x1870622715095808:12345-192.168.204.12@tcp:101:lfs.0 00010000:00010000:1.0:1783965113.913129:0:6632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783965113.913158:0:6632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee200/0xe782b916994fdfea lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5f01d9 expref: -99 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965113.913287:0:6632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef400/0xe782b916994fdff1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965113.913306:0:6632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef400/0xe782b916994fdff1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965113.913320:0:6632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef400/0xe782b916994fdff1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965113.913337:0:6632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef600/0xe782b916994fdff8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965113.913345:0:6632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef600/0xe782b916994fdff8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965113.913352:0:6632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef600/0xe782b916994fdff8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965113.914387:0:6632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef200/0xe782b916994fdfff lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965113.914404:0:6632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef200/0xe782b916994fdfff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965113.914414:0:6632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef200/0xe782b916994fdfff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783965113.914467:0:6632:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1783965113.914473:0:6632:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1783965113.914998:0:6632:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef200/0xe782b916994fdfff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965113.915017:0:6632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef200/0xe782b916994fdfff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965113.915028:0:6632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef400/0xe782b916994fdff1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965113.915035:0:6632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef400/0xe782b916994fdff1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965113.915043:0:6632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef400/0xe782b916994fdff1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965113.915049:0:6632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743d9ef400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1783965113.915053:0:6632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef400/0xe782b916994fdff1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965113.915061:0:6632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef400/0xe782b916994fdff1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965113.915090:0:6632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94740a90c500) 00010000:00010000:1.0:1783965113.915093:0:6632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783965113.915099:0:6632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef400/0xe782b916994fdff1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965113.915106:0:6632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef400/0xe782b916994fdff1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965113.915130:0:6632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef600/0xe782b916994fdff8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965113.915136:0:6632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef600/0xe782b916994fdff8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965113.915141:0:6632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef600/0xe782b916994fdff8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965113.915145:0:6632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743d9ef600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1783965113.915148:0:6632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef600/0xe782b916994fdff8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965113.915155:0:6632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef600/0xe782b916994fdff8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965113.915161:0:6632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff947407b5c800) 00010000:00010000:1.0:1783965113.915164:0:6632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783965113.915167:0:6632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef600/0xe782b916994fdff8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965113.915172:0:6632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef600/0xe782b916994fdff8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965113.915260:0:6632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee200/0xe782b916994fdfea lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f01d9 expref: 30 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965113.915281:0:6632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef200/0xe782b916994fdfff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f01d9 expref: 29 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965113.915288:0:6632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff947402a2d400) 00010000:00010000:1.0:1783965113.915291:0:6632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783965113.915300:0:6632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94743d9ef200, rc 0) 00000100:00100000:1.0:1783965113.915462:0:6632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e43b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9923189b-eb4a-470c-ab45-969435371000+29:11477:x1870622715095808:12345-192.168.204.12@tcp:101:lfs.0 Request processed in 2358us (2590us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965113.915471:0:6632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 170 00010000:00010000:0.0:1783965114.027458:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783965114.232864:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783965114.232908:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783965114.232943:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783965114.232977:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783965114.233009:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715095936 00000100:00100000:0.0:1783965114.233032:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715095936 00000100:00100000:0.0:1783965114.233098:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 293 00000100:00100000:0.0:1783965114.233125:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947408ecb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+13:2357:x1870622715095936:12345-192.168.204.12@tcp:400:kworker.0 00000100:00100000:0.0:1783965114.233244:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947408ecb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+13:2357:x1870622715095936:12345-192.168.204.12@tcp:400:kworker.0 Request processed in 121us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965114.233254:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 293 00000100:00100000:0.0:1783965114.233298:0:6609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715096064 00000100:00100000:0.0:1783965114.233301:0:6609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715096064 00000100:00100000:0.0:1783965114.233347:0:6609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715096192 00000100:00100000:0.0:1783965114.233352:0:6609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715096192 00000100:00100000:0.0:1783965114.233375:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 72 00000100:00100000:0.0:1783965114.233382:0:6609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e611f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9923189b-eb4a-470c-ab45-969435371000+7:2357:x1870622715096064:12345-192.168.204.12@tcp:400:kworker.0 00000100:00100000:0.0:1783965114.233411:0:6609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e611f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9923189b-eb4a-470c-ab45-969435371000+7:2357:x1870622715096064:12345-192.168.204.12@tcp:400:kworker.0 Request processed in 30us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965114.233418:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 72 00000100:00100000:0.0:1783965114.233431:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 73 00000100:00100000:0.0:1783965114.233438:0:6609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e611880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9923189b-eb4a-470c-ab45-969435371000+6:2357:x1870622715096192:12345-192.168.204.12@tcp:400:kworker.0 00000100:00100000:0.0:1783965114.233464:0:6609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e611880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9923189b-eb4a-470c-ab45-969435371000+6:2357:x1870622715096192:12345-192.168.204.12@tcp:400:kworker.0 Request processed in 27us (486us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965114.233470:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 73 00000100:00080000:0.0:1783965114.233612:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1783965114.233617:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783965114.233978:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715096320 00000100:00100000:3.0:1783965114.233983:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715096320 00000100:00100000:3.0:1783965114.234036:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 149 00000100:00100000:3.0:1783965114.234045:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e613480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49bbacc1-b013-4591-8d15-02f4f0d1884e+5:2357:x1870622715096320:12345-192.168.204.12@tcp:400:kworker.0 00000100:00100000:3.0:1783965114.234381:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e613480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49bbacc1-b013-4591-8d15-02f4f0d1884e+5:2357:x1870622715096320:12345-192.168.204.12@tcp:400:kworker.0 Request processed in 58us (1192us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965114.234390:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 149 00000100:00080000:0.0:1783965114.234825:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000040:00080000:1.0:1783965114.349862:0:11561:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1783965114.349871:0:11561:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1783965114.349929:0:11561:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:1.0:1783965114.349936:0:11561:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1783965114.350087:0:11561:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e542a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11561:1870622732918144:192.168.204.12@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1783965114.350189:0:11561:0:(client.c:2702:ptlrpc_set_wait()) set ffff947436de0180 going to sleep for 11 seconds 00000100:00100000:1.0:1783965114.353048:0:11561:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e542a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11561:1870622732918144:192.168.204.12@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1783965114.373195:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965114.375279:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715096448 00000100:00100000:2.0:1783965114.375295:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715096448 00000100:00100000:2.0:1783965114.375360:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 171 00000100:00100000:2.0:1783965114.375371:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e613b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9923189b-eb4a-470c-ab45-969435371000+29:11488:x1870622715096448:12345-192.168.204.12@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1783965114.375405:0:5813:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1783965114.375542:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e613b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9923189b-eb4a-470c-ab45-969435371000+29:11488:x1870622715096448:12345-192.168.204.12@tcp:53:lhsmtool_posix.0 Request processed in 171us (2356us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965114.375550:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 171 00000100:00100000:1.0:1783965114.381757:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965114.385535:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715096576 00000100:00100000:3.0:1783965114.385549:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715096576 00000100:00100000:3.0:1783965114.385607:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 172 00000100:00100000:3.0:1783965114.385617:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e542a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9923189b-eb4a-470c-ab45-969435371000+29:11488:x1870622715096576:12345-192.168.204.12@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1783965114.385689:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27c00/0xe782b916994fe006 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965114.385705:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27c00/0xe782b916994fe006 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965114.385727:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27c00/0xe782b916994fe006 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965114.385783:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27a00/0xe782b916994fe00d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965114.385791:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27a00/0xe782b916994fe00d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965114.385798:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27a00/0xe782b916994fe00d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965114.385826:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27600/0xe782b916994fe014 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965114.385834:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27600/0xe782b916994fe014 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965114.385841:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27600/0xe782b916994fe014 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783965114.385892:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1783965114.385897:0:5811:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1783965114.385912:0:5811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27600/0xe782b916994fe014 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965114.385925:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27c00/0xe782b916994fe006 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965114.385936:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27c00/0xe782b916994fe006 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965114.385952:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27c00/0xe782b916994fe006 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965114.385958:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947436f27c00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1783965114.385962:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27c00/0xe782b916994fe006 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965114.385970:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27c00/0xe782b916994fe006 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965114.386407:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9474186e7d00) 00010000:00010000:3.0:1783965114.386411:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783965114.386417:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27c00/0xe782b916994fe006 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965114.386424:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27c00/0xe782b916994fe006 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965114.386436:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27a00/0xe782b916994fe00d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965114.386443:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27a00/0xe782b916994fe00d lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965114.386449:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27a00/0xe782b916994fe00d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965114.386455:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947436f27a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1783965114.386459:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27a00/0xe782b916994fe00d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965114.386475:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27a00/0xe782b916994fe00d lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965114.386485:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff94740b97a100) 00010000:00010000:3.0:1783965114.386487:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783965114.386490:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27a00/0xe782b916994fe00d lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965114.386497:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27a00/0xe782b916994fe00d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965114.386523:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27600/0xe782b916994fe014 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965114.386530:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27600/0xe782b916994fe014 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965114.386535:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27600/0xe782b916994fe014 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965114.386540:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947436f27600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1783965114.386542:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27600/0xe782b916994fe014 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965114.386547:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27600/0xe782b916994fe014 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965114.386554:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff947402a2d400) 00010000:00010000:3.0:1783965114.386556:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783965114.386558:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27600/0xe782b916994fe014 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965114.386573:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27600/0xe782b916994fe014 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783965114.386656:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e542a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9923189b-eb4a-470c-ab45-969435371000+29:11488:x1870622715096576:12345-192.168.204.12@tcp:34:lhsmtool_posix.0 Request processed in 1038us (4903us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965114.386664:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 172 00000100:00100000:0.0:1783965114.401018:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965114.401142:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715096832 00000100:00100000:3.0:1783965114.401152:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715096832 00000100:00100000:3.0:1783965114.401242:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 173 00000100:00100000:3.0:1783965114.401252:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e610a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9923189b-eb4a-470c-ab45-969435371000+29:11488:x1870622715096832:12345-192.168.204.12@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783965114.401272:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783965114.401295:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27000/0xe782b916994fe01b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5f01e0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965114.401399:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fe022 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965114.401414:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fe022 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965114.401425:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fe022 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783965114.401439:0:5813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1783965114.401548:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fe022 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965114.401555:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fe022 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965114.401577:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fe022 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965114.401583:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947436f26e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1783965114.401587:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fe022 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965114.401595:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fe022 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965114.401606:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff947402a2d400) 00010000:00010000:3.0:1783965114.401609:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783965114.401613:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fe022 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965114.401619:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fe022 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965114.401661:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27000/0xe782b916994fe01b lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f01e0 expref: 31 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965114.401671:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9474186e7d00) 00010000:00010000:3.0:1783965114.401673:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783965114.401676:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27000/0xe782b916994fe01b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f01e0 expref: 31 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965114.401685:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff947436f27000, rc 0) 00000100:00100000:3.0:1783965114.401745:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e610a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9923189b-eb4a-470c-ab45-969435371000+30:11488:x1870622715096832:12345-192.168.204.12@tcp:101:lhsmtool_posix.0 Request processed in 495us (737us total) trans 4294967457 rc 301/301 00000100:00100000:3.0:1783965114.401760:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 173 00000100:00100000:2.0:1783965114.408949:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783965114.409282:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715096960 00000100:00100000:0.0:1783965114.409302:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715096960 00000100:00100000:0.0:1783965114.409360:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 174 00000100:00100000:0.0:1783965114.409370:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9474368d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9923189b-eb4a-470c-ab45-969435371000+30:11488:x1870622715096960:12345-192.168.204.12@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1783965114.409405:0:5811:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1783965114.409526:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9474368d4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9923189b-eb4a-470c-ab45-969435371000+30:11488:x1870622715096960:12345-192.168.204.12@tcp:53:lhsmtool_posix.0 Request processed in 157us (585us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965114.409534:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 174 00000100:00100000:0.0:1783965114.419771:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965114.419974:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715097216 00000100:00100000:1.0:1783965114.419996:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715097216 00000100:00100000:1.0:1783965114.420064:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 175 00000100:00100000:1.0:1783965114.420074:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e613800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9923189b-eb4a-470c-ab45-969435371000+30:11488:x1870622715097216:12345-192.168.204.12@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783965114.420094:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783965114.420110:0:5813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1783965114.420139:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26400/0xe782b916994fdfdc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f01d2 expref: 30 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965114.420157:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94740a90c500) 00010000:00010000:1.0:1783965114.420162:0:5813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783965114.420175:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef600/0xe782b916994fe030 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5f01e7 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783965114.420969:0:5813:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:1.0:1783965114.421252:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef400/0xe782b916994fe037 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965114.421267:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef400/0xe782b916994fe037 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965114.421278:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef400/0xe782b916994fe037 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965114.421342:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef600/0xe782b916994fe030 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f01e7 expref: 32 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965114.421366:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef400/0xe782b916994fe037 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f01e7 expref: 31 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965114.421372:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff947407b5c800) 00010000:00010000:1.0:1783965114.421375:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783965114.421377:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94743d9ef400, rc 0) 00000100:00100000:1.0:1783965114.421763:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e613800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9923189b-eb4a-470c-ab45-969435371000+31:11488:x1870622715097216:12345-192.168.204.12@tcp:101:lhsmtool_posix.0 Request processed in 1689us (2006us total) trans 4294967458 rc 0/0 00000100:00100000:1.0:1783965114.421784:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 175 00000100:00100000:3.0:1783965114.427080:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783965114.428727:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715097472 00000100:00100000:0.0:1783965114.428742:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715097472 00000100:00100000:0.0:1783965114.428831:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 176 00000100:00100000:0.0:1783965114.428842:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743648d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9923189b-eb4a-470c-ab45-969435371000+31:11488:x1870622715097472:12345-192.168.204.12@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1783965114.428901:0:5812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783965114.428928:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef400/0xe782b916994fe037 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f01e7 expref: 31 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965114.428952:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff947407b5c800) 00010000:00010000:0.0:1783965114.428964:0:5812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783965114.428987:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fd800/0xe782b916994fe045 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965114.429003:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fd800/0xe782b916994fe045 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965114.429013:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fd800/0xe782b916994fe045 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965114.429027:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fcc00/0xe782b916994fe04c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x95c62fe4 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965114.429044:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fcc00/0xe782b916994fe04c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x95c62fe4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965114.429051:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fcc00/0xe782b916994fe04c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x95c62fe4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965114.429346:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fd800/0xe782b916994fe045 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965114.429354:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fd800/0xe782b916994fe045 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965114.429360:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fd800/0xe782b916994fe045 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965114.429366:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743e2fd800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1783965114.429370:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fd800/0xe782b916994fe045 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965114.429377:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fd800/0xe782b916994fe045 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965114.429386:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94740a90c500) 00010000:00010000:0.0:1783965114.429389:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783965114.429393:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fd800/0xe782b916994fe045 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965114.429399:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fd800/0xe782b916994fe045 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965114.429412:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fcc00/0xe782b916994fe04c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x95c62fe4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965114.429424:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fcc00/0xe782b916994fe04c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x95c62fe4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965114.429430:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fcc00/0xe782b916994fe04c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x95c62fe4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965114.429435:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743e2fcc00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1783965114.429437:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fcc00/0xe782b916994fe04c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x95c62fe4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965114.429444:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fcc00/0xe782b916994fe04c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x95c62fe4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965114.429452:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x95c62fe4 (ffff94740a90c300) 00010000:00010000:0.0:1783965114.429455:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783965114.429457:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fcc00/0xe782b916994fe04c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x95c62fe4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965114.429463:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fcc00/0xe782b916994fe04c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x95c62fe4 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783965114.429570:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743648d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9923189b-eb4a-470c-ab45-969435371000+30:11488:x1870622715097472:12345-192.168.204.12@tcp:36:lhsmtool_posix.0 Request processed in 728us (2498us total) trans 0 rc -2/-2 00000100:00100000:0.0:1783965114.429578:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 176 00000100:00100000:1.0:1783965114.435143:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965114.437178:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715097600 00000100:00100000:3.0:1783965114.437195:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715097600 00000100:00100000:3.0:1783965114.437383:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 177 00000100:00100000:3.0:1783965114.437394:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e541f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9923189b-eb4a-470c-ab45-969435371000+30:11488:x1870622715097600:12345-192.168.204.12@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783965114.437414:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783965114.437440:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fe053 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5f01ee expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965114.437474:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27000/0xe782b916994fe05a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965114.437488:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27000/0xe782b916994fe05a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965114.437499:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27000/0xe782b916994fe05a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965114.437608:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fe053 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f01ee expref: 32 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965114.437626:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27000/0xe782b916994fe05a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f01ee expref: 31 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965114.437634:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff94740b97a400) 00010000:00010000:3.0:1783965114.437638:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1783965114.437641:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff947436f27000, rc 0) 00000100:00100000:3.0:1783965114.437715:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e541f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9923189b-eb4a-470c-ab45-969435371000+31:11488:x1870622715097600:12345-192.168.204.12@tcp:101:lhsmtool_posix.0 Request processed in 322us (2581us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965114.437722:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 177 00000100:00100000:1.0:1783965114.444353:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965114.444507:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715097856 00000100:00100000:2.0:1783965114.444525:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715097856 00000100:00100000:2.0:1783965114.444614:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 178 00000100:00100000:2.0:1783965114.444623:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e540380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9923189b-eb4a-470c-ab45-969435371000+31:11488:x1870622715097856:12345-192.168.204.12@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1783965114.444727:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f000/0xe782b916994fe061 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965114.444746:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f000/0xe782b916994fe061 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965114.444759:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f000/0xe782b916994fe061 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783965114.445060:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:2.0:1783965114.445083:0:5811:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 348673881361ns, next at 349673878803ns, rc = 0 00000004:00010000:2.0:1783965114.445175:0:5811:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000be12b7d3 reply state 0000000069880b7f transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f000/0xe782b916994fe061 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783965114.445185:0:5811:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783965114.445556:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e540380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9923189b-eb4a-470c-ab45-969435371000+33:11488:x1870622715097856:12345-192.168.204.12@tcp:36:lhsmtool_posix.0 Request processed in 932us (1212us total) trans 4294967459 rc 0/0 00000100:00100000:2.0:1783965114.445564:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 178 00000100:00100000:3.0:1783965114.449483:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00010000:00010000:3.0:1783965114.449533:0:3308:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f000/0xe782b916994fe061 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965114.449547:0:3308:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f000/0xe782b916994fe061 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965114.449555:0:3308:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f000/0xe782b916994fe061 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965114.449561:0:3308:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743fb8f000 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1783965114.449566:0:3308:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f000/0xe782b916994fe061 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965114.449572:0:3308:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f000/0xe782b916994fe061 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965114.449592:0:3308:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff94740b97a400) 00010000:00010000:3.0:1783965114.449595:0:3308:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1783965114.449600:0:3308:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f000/0xe782b916994fe061 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965114.449606:0:3308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f000/0xe782b916994fe061 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783965114.450818:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715097984 00000100:00100000:2.0:1783965114.450832:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715097984 00000100:00100000:2.0:1783965114.450901:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 179 00000100:00100000:2.0:1783965114.450921:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743648c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9923189b-eb4a-470c-ab45-969435371000+32:11488:x1870622715097984:12345-192.168.204.12@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783965114.450947:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783965114.450966:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f600/0xe782b916994fe068 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5f01f5 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965114.451025:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f600/0xe782b916994fe068 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f01f5 expref: 33 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965114.451039:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f600/0xe782b916994fe068 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f01f5 expref: 33 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965114.451057:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff94740b97a400) 00010000:00010000:2.0:1783965114.451062:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783965114.451065:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94743fb8f600, rc 0) 00000100:00100000:2.0:1783965114.451127:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743648c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9923189b-eb4a-470c-ab45-969435371000+33:11488:x1870622715097984:12345-192.168.204.12@tcp:101:lhsmtool_posix.0 Request processed in 217us (1652us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965114.451134:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 179 00000100:00100000:2.0:1783965114.456620:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965114.456713:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715098112 00000100:00100000:3.0:1783965114.456723:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715098112 00000100:00100000:3.0:1783965114.456783:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 52 00000100:00100000:3.0:1783965114.456794:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9474368d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9923189b-eb4a-470c-ab45-969435371000+6:2360:x1870622715098112:12345-192.168.204.12@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1783965114.457196:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9474368d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9923189b-eb4a-470c-ab45-969435371000+7:2360:x1870622715098112:12345-192.168.204.12@tcp:2:lhsmtool_posix.0 Request processed in 401us (583us total) trans 4294967313 rc 0/0 00000100:00100000:3.0:1783965114.457228:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 52 00000100:00100000:3.0:1783965114.460463:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965114.461012:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715098368 00000100:00100000:2.0:1783965114.461024:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715098368 00000100:00100000:2.0:1783965114.461081:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 49 00000100:00100000:2.0:1783965114.461090:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743648fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9923189b-eb4a-470c-ab45-969435371000+33:11488:x1870622715098368:12345-192.168.204.12@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1783965114.461344:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743648fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9923189b-eb4a-470c-ab45-969435371000+34:11488:x1870622715098368:12345-192.168.204.12@tcp:35:lhsmtool_posix.0 Request processed in 255us (891us total) trans 4294967460 rc 0/0 00000100:00100000:2.0:1783965114.461352:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 49 00000100:00100000:3.0:1783965114.465704:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965114.465756:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715098624 00000100:00100000:3.0:1783965114.465766:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715098624 00000100:00100000:3.0:1783965114.465818:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 180 00000100:00100000:3.0:1783965114.465828:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743648dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9923189b-eb4a-470c-ab45-969435371000+34:11488:x1870622715098624:12345-192.168.204.12@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1783965114.465965:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743648dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9923189b-eb4a-470c-ab45-969435371000+34:11488:x1870622715098624:12345-192.168.204.12@tcp:57:lhsmtool_posix.0 Request processed in 138us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965114.465973:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 180 00000100:00100000:2.0:1783965114.481305:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965114.481565:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715098752 00000100:00100000:3.0:1783965114.481575:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715098752 00000100:00100000:3.0:1783965114.481637:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 181 00000100:00100000:3.0:1783965114.481647:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436e77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9923189b-eb4a-470c-ab45-969435371000+34:11488:x1870622715098752:12345-192.168.204.12@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783965114.481668:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783965114.481691:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fe06f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5f01fc expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965114.481764:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fe076 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965114.481780:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fe076 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965114.481792:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fe076 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783965114.481837:0:5813:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1783965114.481853:0:5813:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fe076 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965114.481889:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fe06f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f01fc expref: 36 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965114.481904:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fe076 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f01fc expref: 35 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965114.481912:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff94740b97a400) 00010000:00010000:3.0:1783965114.481915:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1783965114.481918:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff947436f26e00, rc 0) 00000100:00100000:3.0:1783965114.481993:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436e77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9923189b-eb4a-470c-ab45-969435371000+35:11488:x1870622715098752:12345-192.168.204.12@tcp:101:lhsmtool_posix.0 Request processed in 347us (702us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965114.481999:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 181 00000100:00100000:3.0:1783965114.487552:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783965114.487710:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715098880 00000100:00100000:0.0:1783965114.487722:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715098880 00000100:00100000:0.0:1783965114.487822:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 53 00000100:00100000:0.0:1783965114.487834:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743648ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9923189b-eb4a-470c-ab45-969435371000+7:2359:x1870622715098880:12345-192.168.204.12@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783965114.487855:0:6608:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783965114.487957:0:6608:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009d82bab5/0xe782b916994fe07d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5f0203 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1783965114.487986:0:6608:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a5525ba, blocks: 0x1 00010000:00010000:0.0:1783965114.488010:0:6608:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=348s v=(0 0) 00010000:00010000:0.0:1783965114.488016:0:6608:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783965114.488028:0:6608:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009d82bab5/0xe782b916994fe07d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0203 expref: 8 pid: 6608 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965114.488046:0:6608:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009d82bab5/0xe782b916994fe07d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0203 expref: 8 pid: 6608 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965114.488060:0:6608:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94743e2fcc00, rc 0) 00000100:00100000:0.0:1783965114.488233:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743648ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9923189b-eb4a-470c-ab45-969435371000+8:2359:x1870622715098880:12345-192.168.204.12@tcp:101:lhsmtool_posix.0 Request processed in 399us (690us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965114.488241:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 53 00000100:00100000:2.0:1783965114.491052:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965114.491109:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715099136 00000100:00100000:3.0:1783965114.491120:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715099136 00000100:00100000:3.0:1783965114.491196:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 182 00000100:00100000:3.0:1783965114.491233:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436e75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9923189b-eb4a-470c-ab45-969435371000+35:11488:x1870622715099136:12345-192.168.204.12@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1783965114.491361:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436e75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9923189b-eb4a-470c-ab45-969435371000+35:11488:x1870622715099136:12345-192.168.204.12@tcp:57:lhsmtool_posix.0 Request processed in 130us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965114.491370:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 182 00000100:00100000:2.0:1783965114.494765:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783965114.494847:0:11945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715099264 00000100:00100000:0.0:1783965114.494858:0:11945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715099264 00000100:00100000:0.0:1783965114.494923:0:11945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 54 00000100:00100000:0.0:1783965114.494941:0:11945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436e74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9923189b-eb4a-470c-ab45-969435371000+8:11488:x1870622715099264:12345-192.168.204.12@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783965114.494959:0:11945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783965114.494978:0:11945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f811ab57/0xe782b916994fe084 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5f020a expref: -99 pid: 11945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965114.495008:0:11945:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009d82bab5/0xe782b916994fe07d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0203 expref: 9 pid: 6608 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965114.495037:0:11945:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783965114.495042:0:11945:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783965114.495049:0:11945:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f811ab57/0xe782b916994fe084 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f020a expref: 9 pid: 11945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965114.495096:0:11945:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009d82bab5/0xe782b916994fe07d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0203 expref: 9 pid: 6608 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965114.495111:0:11945:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009d82bab5/0xe782b916994fe07d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0203 expref: 9 pid: 6608 timeout: 448 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783965114.495125:0:11945:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947306e7b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11945:1870622732918272:192.168.204.12@tcp:104: 00000100:00100000:0.0:1783965114.495257:0:11945:0:(client.c:2702:ptlrpc_set_wait()) set ffff94743e29f240 going to sleep for 11 seconds 00000100:00100000:2.0:1783965114.501184:0:11945:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947306e7b480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11945:1870622732918272:192.168.204.12@tcp:104: 00010000:00010000:2.0:1783965114.501256:0:11945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f811ab57/0xe782b916994fe084 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f020a expref: 9 pid: 11945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965114.501278:0:11945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94743e2fd800, rc 0) 00000100:00100000:2.0:1783965114.501341:0:11945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436e74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9923189b-eb4a-470c-ab45-969435371000+9:11488:x1870622715099264:12345-192.168.204.12@tcp:101:lhsmtool_posix.0 Request processed in 6401us (6583us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965114.501351:0:11945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 54 00000100:00100000:0.0:1783965114.501740:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783965114.501772:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715099392 00000100:00100000:0.0:1783965114.501778:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715099392 00010000:00010000:0.0:1783965114.501812:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009d82bab5/0xe782b916994fe07d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0203 expref: 9 pid: 6608 timeout: 448 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783965114.501841:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 69 00000100:00100000:0.0:1783965114.501850:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94741843e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9923189b-eb4a-470c-ab45-969435371000+9:2360:x1870622715099392:12345-192.168.204.12@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783965114.501863:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783965114.505011:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009d82bab5/0xe782b916994fe07d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0203 expref: 9 pid: 6608 timeout: 448 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965114.505664:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009d82bab5/0xe782b916994fe07d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0203 expref: 9 pid: 6608 timeout: 448 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965114.505694:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009d82bab5/0xe782b916994fe07d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0203 expref: 9 pid: 6608 timeout: 448 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965114.505713:0:5797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783965114.505718:0:5797:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783965114.505726:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f811ab57/0xe782b916994fe084 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f020a expref: 8 pid: 11945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965114.505737:0:5797:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f811ab57/0xe782b916994fe084 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f020a expref: 8 pid: 11945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965114.505783:0:5797:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000f811ab57/0xe782b916994fe084 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f020a expref: 8 pid: 11945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783965114.505800:0:5797:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947306e79500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5797:1870622732918400:192.168.204.12@tcp:105: 00000100:00100000:0.0:1783965114.505974:0:5797:0:(client.c:2702:ptlrpc_set_wait()) set ffff94743e29f240 going to sleep for 11 seconds 00000100:00100000:1.0:1783965114.509321:0:5797:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947306e79500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5797:1870622732918400:192.168.204.12@tcp:105: 00010000:00010000:1.0:1783965114.509351:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783965114.509409:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94741843e050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9923189b-eb4a-470c-ab45-969435371000+8:2360:x1870622715099392:12345-192.168.204.12@tcp:103:ldlm_bl.0 Request processed in 7559us (7670us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965114.509420:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 69 00000100:00100000:2.0:1783965114.513149:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965114.514139:0:6614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715099520 00000100:00100000:1.0:1783965114.514151:0:6614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715099520 00002000:00100000:1.0:1783965114.514221:0:6614:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff947436e76a00 x1870622715099520/t0(0) o4->9923189b-eb4a-470c-ab45-969435371000@192.168.204.12@tcp:540/0 lens 504/0 e 0 to 0 dl 1783965125 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783965114.514234:0:6614:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff947436e76a00 with x1870622715099520 ext(0->8) 00002000:00010000:1.0:1783965114.514240:0:6614:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff947436e76a00 00000100:00100000:1.0:1783965114.514305:0:6614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 4 00000100:00100000:1.0:1783965114.514315:0:6614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436e76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9923189b-eb4a-470c-ab45-969435371000+8:2360:x1870622715099520:12345-192.168.204.12@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1783965114.514786:0:6614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436e76a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9923189b-eb4a-470c-ab45-969435371000+10:2360:x1870622715099520:12345-192.168.204.12@tcp:4:lhsmtool_posix.0 Request processed in 471us (1646us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1783965114.514795:0:6614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 4 00002000:00100000:1.0:1783965114.514802:0:6614:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff947436e76a00 x1870622715099520/t4294967314(0) o4->9923189b-eb4a-470c-ab45-969435371000@192.168.204.12@tcp:540/0 lens 504/448 e 0 to 0 dl 1783965125 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783965114.514810:0:6614:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff947436e76a00 with x1870622715099520 ext(0->8) 00002000:00010000:1.0:1783965114.514813:0:6614:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff947436e76a00 00000100:00100000:2.0:1783965114.518065:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783965114.519450:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715099648 00000100:00100000:0.0:1783965114.519462:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715099648 00000100:00100000:0.0:1783965114.519535:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 183 00000100:00100000:0.0:1783965114.519546:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947307dc6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9923189b-eb4a-470c-ab45-969435371000+35:11488:x1870622715099648:12345-192.168.204.12@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1783965114.556312:0:5835:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967458 is committed 00000001:00080000:1.0:1783965114.556336:0:5835:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000004:00080000:1.0:1783965114.556343:0:5835:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000020:00080000:1.0:1783965114.556367:0:5835:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000100:00100000:1.0:1783965114.556504:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e542680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3323:1870622732918528:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1783965114.556580:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783965114.556637:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732918528 00000100:00100000:1.0:1783965114.556643:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732918528 00000100:00100000:1.0:1783965114.556690:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1783965114.556697:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e542d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3323:x1870622732918528:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1783965114.556832:0:6606:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1783965114.556836:0:6606:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1783965114 00002000:00010000:1.0:1783965114.556838:0:6606:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1783965114.556841:0:6606:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1783965114 -> 1783965114 00002000:00010000:1.0:1783965114.556843:0:6606:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1783965114.556879:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e542d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3323:x1870622732918528:12345-0@lo:2:osp-syn-1-0.0 Request processed in 181us (298us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1783965114.556886:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000004:00080000:1.0:1783965114.556924:0:3323:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94743e542680/2, rc 0, transno 4294967315 00000100:00100000:1.0:1783965114.556929:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e542680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3323:1870622732918528:0@lo:2:osp-syn-1-0.0 00000100:00080000:0.0:1783965114.557037:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000020:00080000:2.0:1783965114.557237:0:5846:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:2.0:1783965114.557248:0:5846:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:2.0:1783965114.557337:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947307dc6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9923189b-eb4a-470c-ab45-969435371000+19:11488:x1870622715099648:12345-192.168.204.12@tcp:44:lhsmtool_posix.0 Request processed in 37790us (39439us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965114.557346:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 183 00000100:00100000:0.0:1783965114.560149:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965114.560353:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715099776 00000100:00100000:2.0:1783965114.560362:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715099776 00000100:00100000:2.0:1783965114.560645:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 56 00000100:00100000:2.0:1783965114.560655:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947306e79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9923189b-eb4a-470c-ab45-969435371000+10:2357:x1870622715099776:12345-192.168.204.12@tcp:16:lhsmtool_posix.0 00000001:00080000:3.0:1783965114.599930:0:7523:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000001:00080000:3.0:1783965114.599947:0:7523:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967314 is committed 00000100:00100000:2.0:1783965114.600157:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947306e79180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9923189b-eb4a-470c-ab45-969435371000+7:2357:x1870622715099776:12345-192.168.204.12@tcp:16:lhsmtool_posix.0 Request processed in 39496us (40010us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965114.600171:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 56 00000100:00100000:0.0:1783965114.606961:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965114.607027:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715100032 00000100:00100000:3.0:1783965114.607038:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715100032 00000100:00100000:3.0:1783965114.607142:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 184 00000100:00100000:3.0:1783965114.607154:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947306e7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9923189b-eb4a-470c-ab45-969435371000+19:11488:x1870622715100032:12345-192.168.204.12@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1783965114.607237:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783965114.607264:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fe076 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f01fc expref: 19 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965114.607279:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff94740b97a400) 00010000:00010000:3.0:1783965114.607285:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783965114.607314:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27600/0xe782b916994fe08b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965114.607326:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27600/0xe782b916994fe08b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965114.607336:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27600/0xe782b916994fe08b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783965114.607842:0:5811:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d079ebb0 reply state 00000000b09dabe6 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27600/0xe782b916994fe08b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783965114.607853:0:5811:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783965114.608001:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947306e7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9923189b-eb4a-470c-ab45-969435371000+20:11488:x1870622715100032:12345-192.168.204.12@tcp:36:lhsmtool_posix.0 Request processed in 850us (1048us total) trans 4294967461 rc 0/0 00000100:00100000:3.0:1783965114.608009:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 184 00010000:00010000:1.0:1783965114.610931:0:3309:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27600/0xe782b916994fe08b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965114.610947:0:3309:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27600/0xe782b916994fe08b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965114.610954:0:3309:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27600/0xe782b916994fe08b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965114.610974:0:3309:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947436f27600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1783965114.610979:0:3309:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27600/0xe782b916994fe08b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965114.610986:0:3309:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27600/0xe782b916994fe08b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965114.611004:0:3309:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff94740b97a400) 00010000:00010000:1.0:1783965114.611007:0:3309:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783965114.611011:0:3309:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27600/0xe782b916994fe08b lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965114.611017:0:3309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27600/0xe782b916994fe08b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783965114.612288:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783965114.612417:0:11945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715100160 00000100:00100000:0.0:1783965114.612426:0:11945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715100160 00000100:00100000:0.0:1783965114.612472:0:11945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 57 00000100:00100000:0.0:1783965114.612480:0:11945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947307dc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9923189b-eb4a-470c-ab45-969435371000+7:2360:x1870622715100160:12345-192.168.204.12@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1783965114.612731:0:11945:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1783965114.612735:0:11945:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1783965114 -> 1783965113 00002000:00010000:0.0:1783965114.612738:0:11945:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1783965111 00002000:00010000:0.0:1783965114.612740:0:11945:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1783965114 -> 1783965113 00002000:00010000:0.0:1783965114.612743:0:11945:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1783965114.612799:0:11945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947307dc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9923189b-eb4a-470c-ab45-969435371000+8:2360:x1870622715100160:12345-192.168.204.12@tcp:2:lhsmtool_posix.0 Request processed in 319us (520us total) trans 4294967316 rc 0/0 00000100:00100000:0.0:1783965114.612807:0:11945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 57 00000100:00100000:2.0:1783965114.617695:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965114.618337:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715100416 00000100:00100000:1.0:1783965114.618347:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715100416 00000100:00100000:1.0:1783965114.618408:0:6632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 185 00000100:00100000:1.0:1783965114.618420:0:6632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947307dc4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9923189b-eb4a-470c-ab45-969435371000+19:11488:x1870622715100416:12345-192.168.204.12@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1783965114.618487:0:6632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eea00/0xe782b916994fe092 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965114.618502:0:6632:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27000/0xe782b916994fe05a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f01ee expref: 19 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965114.618523:0:6632:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eea00/0xe782b916994fe092 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965114.618558:0:6632:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27000/0xe782b916994fe05a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f01ee expref: 19 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965114.618588:0:6632:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27000/0xe782b916994fe05a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f01ee expref: 19 pid: 5813 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783965114.618604:0:6632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947436c3ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6632:1870622732918656:192.168.204.12@tcp:104: 00000100:00100000:1.0:1783965114.618694:0:6632:0:(client.c:2702:ptlrpc_set_wait()) set ffff947436de0600 going to sleep for 11 seconds 00000100:00100000:1.0:1783965114.622944:0:6632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947436c3ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6632:1870622732918656:192.168.204.12@tcp:104: 00010000:00010000:1.0:1783965114.622978:0:6632:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eea00/0xe782b916994fe092 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783965114.628046:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965114.628138:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715100544 00000100:00100000:1.0:1783965114.628148:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715100544 00010000:00010000:1.0:1783965114.628188:0:5799:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27000/0xe782b916994fe05a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f01ee expref: 20 pid: 5813 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783965114.628258:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 70 00000100:00100000:1.0:1783965114.628268:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743648ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9923189b-eb4a-470c-ab45-969435371000+20:2359:x1870622715100544:12345-192.168.204.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783965114.628282:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783965114.628289:0:5799:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27000/0xe782b916994fe05a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f01ee expref: 20 pid: 5813 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965114.628302:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27000/0xe782b916994fe05a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f01ee expref: 20 pid: 5813 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965114.628326:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27000/0xe782b916994fe05a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f01ee expref: 20 pid: 5813 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965114.628355:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff94740b97a400) 00010000:00010000:1.0:1783965114.628361:0:5799:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eea00/0xe782b916994fe092 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965114.628371:0:5799:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eea00/0xe782b916994fe092 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965114.628379:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eea00/0xe782b916994fe092 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965114.628405:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783965114.628469:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743648ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9923189b-eb4a-470c-ab45-969435371000+19:2359:x1870622715100544:12345-192.168.204.12@tcp:103:ldlm_bl.0 Request processed in 202us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965114.628476:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 70 00010000:00010000:1.0:1783965114.628576:0:6632:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eea00/0xe782b916994fe092 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965114.628584:0:6632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eea00/0xe782b916994fe092 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965114.628614:0:6632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eea00/0xe782b916994fe092 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965114.628621:0:6632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eea00/0xe782b916994fe092 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965114.628627:0:6632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eea00/0xe782b916994fe092 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965114.628632:0:6632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743d9eea00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1783965114.628642:0:6632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eea00/0xe782b916994fe092 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965114.628650:0:6632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eea00/0xe782b916994fe092 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965114.628660:0:6632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff94740b97a400) 00010000:00010000:1.0:1783965114.628662:0:6632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1783965114.628665:0:6632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eea00/0xe782b916994fe092 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965114.628671:0:6632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eea00/0xe782b916994fe092 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783965114.628725:0:6632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947307dc4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9923189b-eb4a-470c-ab45-969435371000+18:11488:x1870622715100416:12345-192.168.204.12@tcp:55:lhsmtool_posix.0 Request processed in 10307us (11041us total) trans 0 rc -22/-22 00000100:00100000:1.0:1783965114.628734:0:6632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 185 00000100:00100000:2.0:1783965114.638633:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965114.638675:0:8738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715100672 00000100:00100000:2.0:1783965114.638684:0:8738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715100672 00000100:00100000:2.0:1783965114.638746:0:8738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 58 00000100:00100000:2.0:1783965114.638757:0:8738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947307dc5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9923189b-eb4a-470c-ab45-969435371000+8:2360:x1870622715100672:12345-192.168.204.12@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1783965114.638804:0:8738:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000be104f74/0xe782b916994fe099 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965114.638825:0:8738:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f811ab57/0xe782b916994fe084 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f020a expref: 8 pid: 11945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965114.638836:0:8738:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783965114.638841:0:8738:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783965114.638846:0:8738:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000be104f74/0xe782b916994fe099 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965114.638892:0:8738:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f811ab57/0xe782b916994fe084 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f020a expref: 8 pid: 11945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965114.638920:0:8738:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f811ab57/0xe782b916994fe084 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f020a expref: 8 pid: 11945 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783965114.638937:0:8738:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947307dc4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8738:1870622732918784:192.168.204.12@tcp:104: 00000100:00100000:2.0:1783965114.639018:0:8738:0:(client.c:2702:ptlrpc_set_wait()) set ffff947425815a80 going to sleep for 11 seconds 00000100:00100000:1.0:1783965114.651971:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965114.652049:0:8330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715100800 00000100:00100000:2.0:1783965114.652059:0:8330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715100800 00010000:00010000:2.0:1783965114.652099:0:8330:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f811ab57/0xe782b916994fe084 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f020a expref: 9 pid: 11945 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783965114.652144:0:8330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 71 00000100:00100000:2.0:1783965114.652153:0:8330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436c3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9923189b-eb4a-470c-ab45-969435371000+9:2360:x1870622715100800:12345-192.168.204.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783965114.652168:0:8330:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783965114.652192:0:8330:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f811ab57/0xe782b916994fe084 lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f020a expref: 9 pid: 11945 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965114.652236:0:8330:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f811ab57/0xe782b916994fe084 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f020a expref: 9 pid: 11945 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965114.652262:0:8330:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783965114.652267:0:8330:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783965114.652273:0:8330:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000be104f74/0xe782b916994fe099 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965114.652295:0:8330:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000be104f74/0xe782b916994fe099 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 8738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965114.652316:0:8330:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783965114.652367:0:8330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436c3ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9923189b-eb4a-470c-ab45-969435371000+9:2360:x1870622715100800:12345-192.168.204.12@tcp:103:ldlm_bl.0 Request processed in 214us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965114.652374:0:8330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 71 00010000:00010000:0.0:1783965114.654855:0:8738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f811ab57/0xe782b916994fe084 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f020a expref: 8 pid: 11945 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783965114.654884:0:8738:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947307dc4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8738:1870622732918784:192.168.204.12@tcp:104: 00010000:00010000:0.0:1783965114.654977:0:8738:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000be104f74/0xe782b916994fe099 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965114.654989:0:8738:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000be104f74/0xe782b916994fe099 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965114.654997:0:8738:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000be104f74/0xe782b916994fe099 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965114.655104:0:8738:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000be104f74/0xe782b916994fe099 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965114.655114:0:8738:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000be104f74/0xe782b916994fe099 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965114.655124:0:8738:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000be104f74/0xe782b916994fe099 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965114.655132:0:8738:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743fb8fe00 already unused, calling callback (ffffffffc168d230) 00010000:00010000:0.0:1783965114.655136:0:8738:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000be104f74/0xe782b916994fe099 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965114.655145:0:8738:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000be104f74/0xe782b916994fe099 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965114.655164:0:8738:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000be104f74/0xe782b916994fe099 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965114.655173:0:8738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000be104f74/0xe782b916994fe099 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783965114.655271:0:8738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947307dc5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9923189b-eb4a-470c-ab45-969435371000+7:2360:x1870622715100672:12345-192.168.204.12@tcp:1:lhsmtool_posix.0 Request processed in 16516us (16646us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965114.655281:0:8738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 58 00000100:00100000:1.0:1783965114.658167:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965114.658431:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715101056 00000100:00100000:3.0:1783965114.658440:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715101056 00000100:00100000:3.0:1783965114.658488:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 186 00000100:00100000:3.0:1783965114.658503:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743d9cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9923189b-eb4a-470c-ab45-969435371000+18:11488:x1870622715101056:12345-192.168.204.12@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1783965114.658595:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fe0a0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965114.658610:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fe0a0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965114.658623:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fe0a0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965114.658840:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27a00/0xe782b916994fe0a7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965114.658852:0:5812:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f600/0xe782b916994fe068 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f01f5 expref: 19 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965114.658873:0:5812:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27a00/0xe782b916994fe0a7 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965114.658906:0:5812:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f600/0xe782b916994fe068 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f01f5 expref: 19 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965114.658921:0:5812:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f600/0xe782b916994fe068 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f01f5 expref: 19 pid: 5811 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783965114.659165:0:5812:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743648c000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5812:1870622732918912:192.168.204.12@tcp:104: 00000100:00100000:2.0:1783965114.659698:0:5812:0:(client.c:2702:ptlrpc_set_wait()) set ffff94741ccf1900 going to sleep for 11 seconds 00000100:00100000:1.0:1783965114.667441:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783965114.667567:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715101184 00000100:00100000:0.0:1783965114.667576:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715101184 00010000:00010000:0.0:1783965114.667615:0:5799:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f600/0xe782b916994fe068 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f01f5 expref: 20 pid: 5811 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783965114.667659:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 72 00000100:00100000:0.0:1783965114.667671:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743d9c9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9923189b-eb4a-470c-ab45-969435371000+20:2359:x1870622715101184:12345-192.168.204.12@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783965114.667686:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783965114.667693:0:5799:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f600/0xe782b916994fe068 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f01f5 expref: 20 pid: 5811 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965114.667718:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f600/0xe782b916994fe068 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f01f5 expref: 20 pid: 5811 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965114.667741:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff94740b97a400) 00010000:00010000:0.0:1783965114.667747:0:5799:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27a00/0xe782b916994fe0a7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965114.667757:0:5799:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27a00/0xe782b916994fe0a7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965114.667765:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27a00/0xe782b916994fe0a7 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965114.667784:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783965114.667834:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743d9c9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9923189b-eb4a-470c-ab45-969435371000+20:2359:x1870622715101184:12345-192.168.204.12@tcp:103:ldlm_bl.0 Request processed in 165us (401us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965114.667841:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 72 00010000:00010000:3.0:1783965114.668565:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f600/0xe782b916994fe068 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f01f5 expref: 19 pid: 5811 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783965114.668598:0:5812:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743648c000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5812:1870622732918912:192.168.204.12@tcp:104: 00010000:00010000:3.0:1783965114.668619:0:5812:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27a00/0xe782b916994fe0a7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965114.668628:0:5812:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27a00/0xe782b916994fe0a7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965114.668635:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27a00/0xe782b916994fe0a7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783965114.670863:0:5812:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:3.0:1783965114.671097:0:5812:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:3.0:1783965114.671143:0:5812:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:3.0:1783965114.672676:0:5812:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743648c000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5812:1870622732919040:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1783965114.672761:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783965114.672788:0:5812:0:(client.c:2702:ptlrpc_set_wait()) set ffff94741ccf1780 going to sleep for 11 seconds 00000100:00100000:0.0:1783965114.673672:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732919040 00000100:00100000:0.0:1783965114.673686:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732919040 00000100:00100000:0.0:1783965114.673746:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1783965114.673757:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743648df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5812:x1870622732919040:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1783965114.673855:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743648df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5812:x1870622732919040:12345-0@lo:1000:mdt00_001.0 Request processed in 100us (1094us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965114.673862:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1783965114.675949:0:5812:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:2.0:1783965114.675961:0:5812:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94743e542680, transno 4294967315 00000100:00100000:2.0:1783965114.675990:0:5812:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743648c000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5812:1870622732919040:0@lo:1000:mdt00_001.0 00000001:00080000:2.0:1783965114.676709:0:5812:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:2.0:1783965114.676789:0:5812:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947307dc6680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5812:1870622732919168:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1783965114.676857:0:5812:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783965114.676961:0:5812:0:(client.c:2702:ptlrpc_set_wait()) set ffff947425815b40 going to sleep for 11 seconds 00000100:00100000:0.0:1783965114.677170:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732919168 00000100:00100000:0.0:1783965114.677177:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732919168 00000100:00100000:0.0:1783965114.677258:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1783965114.677277:0:5816:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 2 min 2 max 116 00000100:00100000:0.0:1783965114.677278:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947307dc4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5812:x1870622732919168:12345-0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1783965114.677289:0:5816:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_002' 00000100:00100000:0.0:1783965114.677498:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947307dc4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5812:x1870622732919168:12345-0@lo:1000:mdt00_001.0 Request processed in 221us (640us total) trans 4294967317 rc 0/0 00000100:00100000:0.0:1783965114.677515:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1783965114.677761:0:5812:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947307dc6680 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5812:1870622732919168:0@lo:1000:mdt00_001.0 00010000:00010000:2.0:1783965114.677798:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27a00/0xe782b916994fe0a7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965114.677807:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27a00/0xe782b916994fe0a7 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965114.677814:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27a00/0xe782b916994fe0a7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965114.677820:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947436f27a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1783965114.677833:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27a00/0xe782b916994fe0a7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965114.677842:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27a00/0xe782b916994fe0a7 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965114.677977:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff94740b97a400) 00010000:00010000:2.0:1783965114.677981:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783965114.677986:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27a00/0xe782b916994fe0a7 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965114.677997:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27a00/0xe782b916994fe0a7 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965114.678027:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e400/0xe782b916994fdfe3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965114.678033:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e400/0xe782b916994fdfe3 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965114.678039:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e400/0xe782b916994fdfe3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965114.678045:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743fb8e400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1783965114.678047:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e400/0xe782b916994fdfe3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965114.678054:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e400/0xe782b916994fdfe3 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965114.678062:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff947402a2d400) 00010000:00010000:2.0:1783965114.678065:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783965114.678073:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e400/0xe782b916994fdfe3 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965114.678079:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e400/0xe782b916994fdfe3 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965114.678100:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8ec00/0xe782b916994fe0ae lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965114.678114:0:5812:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef200/0xe782b916994fdfff lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f01d9 expref: 22 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965114.678123:0:5812:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8ec00/0xe782b916994fe0ae lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965114.678149:0:5812:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef200/0xe782b916994fdfff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f01d9 expref: 22 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965114.678162:0:5812:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef200/0xe782b916994fdfff lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f01d9 expref: 22 pid: 6632 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783965114.678174:0:5812:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947307dc7800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5812:1870622732919296:192.168.204.12@tcp:104: 00000100:00100000:2.0:1783965114.678339:0:5812:0:(client.c:2702:ptlrpc_set_wait()) set ffff947425815b40 going to sleep for 11 seconds 00000100:00100000:3.0:1783965114.685838:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965114.687652:0:5812:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947307dc7800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5812:1870622732919296:192.168.204.12@tcp:104: 00010000:00010000:2.0:1783965114.687690:0:5812:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8ec00/0xe782b916994fe0ae lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783965114.689281:0:8330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715101312 00000100:00100000:0.0:1783965114.689293:0:8330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715101312 00010000:00010000:0.0:1783965114.689338:0:8330:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef200/0xe782b916994fdfff lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f01d9 expref: 23 pid: 6632 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783965114.689436:0:8330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 73 00000100:00100000:0.0:1783965114.689447:0:8330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743648c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9923189b-eb4a-470c-ab45-969435371000+23:2360:x1870622715101312:12345-192.168.204.12@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783965114.689464:0:8330:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783965114.689484:0:8330:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef200/0xe782b916994fdfff lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f01d9 expref: 23 pid: 6632 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965114.689499:0:8330:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef200/0xe782b916994fdfff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f01d9 expref: 23 pid: 6632 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965114.689545:0:8330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef200/0xe782b916994fdfff lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f01d9 expref: 23 pid: 6632 timeout: 448 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965114.689573:0:8330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff947402a2d400) 00010000:00010000:0.0:1783965114.689579:0:8330:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8ec00/0xe782b916994fe0ae lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965114.689590:0:8330:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8ec00/0xe782b916994fe0ae lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965114.689597:0:8330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8ec00/0xe782b916994fe0ae lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965114.689629:0:8330:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783965114.689691:0:8330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743648c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9923189b-eb4a-470c-ab45-969435371000+22:2360:x1870622715101312:12345-192.168.204.12@tcp:103:ldlm_bl.0 Request processed in 246us (3863us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965114.689699:0:8330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 73 00010000:00010000:3.0:1783965114.689811:0:5812:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8ec00/0xe782b916994fe0ae lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965114.689820:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8ec00/0xe782b916994fe0ae lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965114.689833:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8ec00/0xe782b916994fe0ae lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965114.689840:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8ec00/0xe782b916994fe0ae lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965114.689854:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8ec00/0xe782b916994fe0ae lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965114.689861:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743fb8ec00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1783965114.689865:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8ec00/0xe782b916994fe0ae lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965114.689874:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8ec00/0xe782b916994fe0ae lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965114.689946:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff947402a2d400) 00010000:00010000:3.0:1783965114.689949:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783965114.689953:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8ec00/0xe782b916994fe0ae lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965114.689960:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8ec00/0xe782b916994fe0ae lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965114.689972:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fe0a0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965114.689979:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fe0a0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965114.689989:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fe0a0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965114.689994:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947436f26200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1783965114.689998:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fe0a0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965114.690014:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fe0a0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965114.690023:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff947402a2d400) 00010000:00010000:3.0:1783965114.690026:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1783965114.690029:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fe0a0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965114.690037:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fe0a0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783965114.690568:0:11561:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1783965114.690574:0:11561:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:3.0:1783965114.691064:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743d9cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9923189b-eb4a-470c-ab45-969435371000+21:11488:x1870622715101056:12345-192.168.204.12@tcp:57:lhsmtool_posix.0 Request processed in 32557us (32901us total) trans 4294967466 rc 0/0 00000100:00100000:3.0:1783965114.691074:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 186 00000020:00080000:3.0:1783965114.691079:0:5812:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1783965114.693072:0:11561:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1783965114.693088:0:11561:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1783965114.701806:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783965114.701901:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715101568 00000100:00100000:0.0:1783965114.701912:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715101568 00000100:00100000:0.0:1783965114.701984:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 50 00000100:00100000:0.0:1783965114.701996:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947406389450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9923189b-eb4a-470c-ab45-969435371000+21:11488:x1870622715101568:12345-192.168.204.12@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1783965114.702685:0:5815:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1783965114.702798:0:5815:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:0.0:1783965114.702856:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fd800/0xe782b916994fe0b5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965114.702872:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fd800/0xe782b916994fe0b5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965114.702896:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fd800/0xe782b916994fe0b5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965114.702905:0:5815:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fd800/0xe782b916994fe0b5 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965114.702912:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fd800/0xe782b916994fe0b5 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965114.702918:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fd800/0xe782b916994fe0b5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965114.702943:0:5815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783965114.702996:0:5800:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783965114.703005:0:5800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fd800/0xe782b916994fe0b5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965114.703022:0:5800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743e2fd800 already unused, calling callback (ffffffffc168d230) 00010000:00010000:1.0:1783965114.703034:0:5800:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fd800/0xe782b916994fe0b5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783965114.703037:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947406389450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9923189b-eb4a-470c-ab45-969435371000+23:11488:x1870622715101568:12345-192.168.204.12@tcp:35:lhsmtool_posix.0 Request processed in 1040us (1239us total) trans 4294967468 rc 0/0 00000100:00100000:0.0:1783965114.703051:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 50 00010000:00010000:1.0:1783965114.703054:0:5800:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fd800/0xe782b916994fe0b5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000020:00080000:0.0:1783965114.703057:0:5815:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1783965114.703074:0:5800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff94740a90c300) 00010000:00010000:1.0:1783965114.703078:0:5800:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1783965114.703082:0:5800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fd800/0xe782b916994fe0b5 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965114.703088:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fd800/0xe782b916994fe0b5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965114.703114:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783965114.703116:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783965114.703118:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1783965114.795151:0:12340:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1783965114.795162:0:12340:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783965114.795256:0:12340:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 4 00000040:00080000:0.0:1783965114.795263:0:12340:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1783965114.944597:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965114.944675:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715101824 00000100:00100000:2.0:1783965114.944687:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715101824 00000100:00100000:2.0:1783965114.944761:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 187 00000100:00100000:2.0:1783965114.944772:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743648e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9923189b-eb4a-470c-ab45-969435371000+23:11498:x1870622715101824:12345-192.168.204.12@tcp:101:lfs.0 00010000:00010000:2.0:1783965114.944799:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783965114.944832:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e400/0xe782b916994fe0bc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5f0211 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965114.945103:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f800/0xe782b916994fe0c3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965114.945118:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f800/0xe782b916994fe0c3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965114.945131:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f800/0xe782b916994fe0c3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783965114.945143:0:5813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:2.0:1783965114.945350:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e400/0xe782b916994fe0bc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0211 expref: 26 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965114.945368:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f800/0xe782b916994fe0c3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0211 expref: 25 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965114.945376:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94740a90c500) 00010000:00010000:2.0:1783965114.945379:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1783965114.945383:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94743fb8f800, rc 0) 00000100:00100000:2.0:1783965114.945454:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743648e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9923189b-eb4a-470c-ab45-969435371000+25:11498:x1870622715101824:12345-192.168.204.12@tcp:101:lfs.0 Request processed in 683us (877us total) trans 4294967469 rc 0/0 00000100:00100000:2.0:1783965114.945462:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 187 00000100:00100000:3.0:1783965114.949529:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965114.951301:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715101952 00000100:00100000:1.0:1783965114.951316:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715101952 00000100:00100000:1.0:1783965114.951378:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 188 00000100:00100000:1.0:1783965114.951388:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743648ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9923189b-eb4a-470c-ab45-969435371000+25:11498:x1870622715101952:12345-192.168.204.12@tcp:34:lfs.0 00010000:00010000:1.0:1783965114.951463:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994fe0d1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965114.951479:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994fe0d1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965114.951490:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994fe0d1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965114.951516:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef000/0xe782b916994fe0d8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965114.951534:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef000/0xe782b916994fe0d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965114.951540:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef000/0xe782b916994fe0d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965114.952291:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef800/0xe782b916994fe0df lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965114.952303:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef800/0xe782b916994fe0df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965114.952311:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef800/0xe782b916994fe0df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783965114.952356:0:5811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef800/0xe782b916994fe0df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965114.952369:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994fe0d1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965114.952375:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994fe0d1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965114.952382:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994fe0d1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965114.952388:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743d9ee800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1783965114.952393:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994fe0d1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965114.952401:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994fe0d1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965114.952423:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94740a90c500) 00010000:00010000:1.0:1783965114.952426:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783965114.952431:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994fe0d1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965114.952438:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994fe0d1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965114.952458:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef000/0xe782b916994fe0d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965114.952465:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef000/0xe782b916994fe0d8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965114.952471:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef000/0xe782b916994fe0d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965114.952476:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743d9ef000 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1783965114.952479:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef000/0xe782b916994fe0d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965114.952485:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef000/0xe782b916994fe0d8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965114.952492:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff947407b5c200) 00010000:00010000:1.0:1783965114.952495:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783965114.952498:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef000/0xe782b916994fe0d8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965114.952513:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef000/0xe782b916994fe0d8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965114.952546:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef800/0xe782b916994fe0df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965114.952551:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef800/0xe782b916994fe0df lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965114.952556:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef800/0xe782b916994fe0df lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965114.952561:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743d9ef800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1783965114.952564:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef800/0xe782b916994fe0df lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965114.952569:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef800/0xe782b916994fe0df lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965114.952576:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff947407b5cd00) 00010000:00010000:1.0:1783965114.954567:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783965114.954578:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef800/0xe782b916994fe0df lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965114.954588:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef800/0xe782b916994fe0df lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783965114.954722:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743648ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9923189b-eb4a-470c-ab45-969435371000+25:11498:x1870622715101952:12345-192.168.204.12@tcp:34:lfs.0 Request processed in 3329us (5195us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965114.954733:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 188 00010000:00010000:0.0:1783965115.052027:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783965115.067431:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965115.067542:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715102208 00000100:00100000:2.0:1783965115.067568:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715102208 00000100:00100000:2.0:1783965115.067640:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 189 00000100:00100000:2.0:1783965115.067652:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947306e79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9923189b-eb4a-470c-ab45-969435371000+25:11501:x1870622715102208:12345-192.168.204.12@tcp:101:lfs.0 00010000:00010000:2.0:1783965115.067675:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783965115.067698:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e400/0xe782b916994fe0e6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5f0218 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965115.067783:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f000/0xe782b916994fe0ed lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965115.067798:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f000/0xe782b916994fe0ed lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965115.067809:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f000/0xe782b916994fe0ed lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965115.067824:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fc00/0xe782b916994fe0f4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965115.067831:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fc00/0xe782b916994fe0f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965115.067837:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fc00/0xe782b916994fe0f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965115.068412:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e800/0xe782b916994fe0fb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965115.068423:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e800/0xe782b916994fe0fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965115.068431:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e800/0xe782b916994fe0fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783965115.068448:0:5813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:2.0:1783965115.068550:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f000/0xe782b916994fe0ed lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965115.068557:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f000/0xe782b916994fe0ed lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965115.068563:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f000/0xe782b916994fe0ed lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965115.068569:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743fb8f000 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1783965115.068574:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f000/0xe782b916994fe0ed lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965115.068581:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f000/0xe782b916994fe0ed lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965115.068592:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94740a90c500) 00010000:00010000:2.0:1783965115.068596:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783965115.068600:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f000/0xe782b916994fe0ed lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965115.068606:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f000/0xe782b916994fe0ed lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965115.068618:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fc00/0xe782b916994fe0f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965115.068623:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fc00/0xe782b916994fe0f4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965115.068638:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fc00/0xe782b916994fe0f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965115.068643:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743fb8fc00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1783965115.068646:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fc00/0xe782b916994fe0f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965115.068652:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fc00/0xe782b916994fe0f4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965115.068660:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff947402a2d200) 00010000:00010000:2.0:1783965115.068663:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783965115.068666:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fc00/0xe782b916994fe0f4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965115.068671:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fc00/0xe782b916994fe0f4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965115.068713:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e400/0xe782b916994fe0e6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0218 expref: 28 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965115.068728:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e800/0xe782b916994fe0fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0218 expref: 27 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965115.068735:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff947402a2da00) 00010000:00010000:2.0:1783965115.068737:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783965115.068739:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94743fb8e800, rc 0) 00000100:00080000:0.0:1783965115.068859:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783965115.069534:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947306e79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9923189b-eb4a-470c-ab45-969435371000+27:11501:x1870622715102208:12345-192.168.204.12@tcp:101:lfs.0 Request processed in 1882us (2110us total) trans 4294967470 rc 0/0 00000100:00100000:2.0:1783965115.069554:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 189 00000100:00100000:2.0:1783965115.076282:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965115.076369:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715102336 00000100:00100000:3.0:1783965115.076380:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715102336 00000100:00100000:3.0:1783965115.076438:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 190 00000100:00100000:3.0:1783965115.076449:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947307dc7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9923189b-eb4a-470c-ab45-969435371000+27:11501:x1870622715102336:12345-192.168.204.12@tcp:54:lfs.0 00010000:00010000:3.0:1783965115.076536:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fe109 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965115.076555:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fe109 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965115.076567:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fe109 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965115.076625:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fe109 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965115.076632:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fe109 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965115.076639:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fe109 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965115.076646:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947436f26200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1783965115.076650:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fe109 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965115.076658:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fe109 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965115.076672:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff947402a2da00) 00010000:00010000:3.0:1783965115.076675:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783965115.076680:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fe109 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965115.076686:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fe109 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783965115.076831:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947307dc7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9923189b-eb4a-470c-ab45-969435371000+27:11501:x1870622715102336:12345-192.168.204.12@tcp:54:lfs.0 Request processed in 372us (548us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965115.076839:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 190 00000100:00100000:0.0:1783965115.087184:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965115.087391:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715102592 00000100:00100000:3.0:1783965115.087402:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715102592 00000100:00100000:3.0:1783965115.087474:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 51 00000100:00100000:3.0:1783965115.087510:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947306e78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9923189b-eb4a-470c-ab45-969435371000+27:11501:x1870622715102592:12345-192.168.204.12@tcp:35:lfs.0 00000100:00100000:3.0:1783965115.087756:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947306e78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9923189b-eb4a-470c-ab45-969435371000+28:11501:x1870622715102592:12345-192.168.204.12@tcp:35:lfs.0 Request processed in 260us (582us total) trans 4294967471 rc 0/0 00000100:00100000:3.0:1783965115.087765:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 51 00000100:00100000:0.0:1783965115.159374:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965115.159536:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715102848 00000100:00100000:3.0:1783965115.159548:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715102848 00000100:00100000:3.0:1783965115.159614:0:6632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 191 00000100:00100000:3.0:1783965115.159626:0:6632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947306e7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9923189b-eb4a-470c-ab45-969435371000+28:11035:x1870622715102848:12345-192.168.204.12@tcp:101:bash.0 00010000:00010000:3.0:1783965115.159656:0:6632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783965115.159684:0:6632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fe110 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5f021f expref: -99 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965115.159797:0:6632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27c00/0xe782b916994fe117 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965115.159812:0:6632:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e800/0xe782b916994fe0fb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0218 expref: 29 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965115.159821:0:6632:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27c00/0xe782b916994fe117 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965115.159855:0:6632:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e800/0xe782b916994fe0fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0218 expref: 29 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965115.159868:0:6632:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e800/0xe782b916994fe0fb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0218 expref: 29 pid: 5813 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783965115.159882:0:6632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743648f800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6632:1870622732919424:192.168.204.12@tcp:104: 00000100:00100000:3.0:1783965115.160564:0:6632:0:(client.c:2702:ptlrpc_set_wait()) set ffff9474028e9540 going to sleep for 11 seconds 00000100:00100000:3.0:1783965115.165889:0:6632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743648f800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6632:1870622732919424:192.168.204.12@tcp:104: 00010000:00010000:3.0:1783965115.165921:0:6632:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27c00/0xe782b916994fe117 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783965115.167480:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965115.167580:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715102976 00000100:00100000:1.0:1783965115.167589:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715102976 00010000:00010000:1.0:1783965115.167643:0:5799:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e800/0xe782b916994fe0fb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0218 expref: 30 pid: 5813 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783965115.167705:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 74 00000100:00100000:1.0:1783965115.167715:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947306e79c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9923189b-eb4a-470c-ab45-969435371000+30:2360:x1870622715102976:12345-192.168.204.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783965115.167732:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783965115.167740:0:5799:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e800/0xe782b916994fe0fb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0218 expref: 30 pid: 5813 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965115.167753:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e800/0xe782b916994fe0fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0218 expref: 30 pid: 5813 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965115.167776:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e800/0xe782b916994fe0fb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0218 expref: 30 pid: 5813 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965115.167793:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff947402a2da00) 00010000:00010000:1.0:1783965115.167798:0:5799:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27c00/0xe782b916994fe117 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965115.167807:0:5799:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27c00/0xe782b916994fe117 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965115.167816:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27c00/0xe782b916994fe117 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965115.167854:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783965115.167929:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947306e79c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9923189b-eb4a-470c-ab45-969435371000+29:2360:x1870622715102976:12345-192.168.204.12@tcp:103:ldlm_bl.0 Request processed in 214us (454us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965115.167937:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 74 00010000:00010000:2.0:1783965115.168251:0:6632:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27c00/0xe782b916994fe117 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965115.168260:0:6632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27c00/0xe782b916994fe117 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783965115.168281:0:6632:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:2.0:1783965115.168433:0:6632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fe110 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f021f expref: 30 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965115.168451:0:6632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27c00/0xe782b916994fe117 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f021f expref: 29 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965115.168458:0:6632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff947402a2da00) 00010000:00010000:2.0:1783965115.168461:0:6632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1783965115.168464:0:6632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff947436f27c00, rc 0) 00000100:00100000:2.0:1783965115.168514:0:6632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947306e7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9923189b-eb4a-470c-ab45-969435371000+29:11035:x1870622715102848:12345-192.168.204.12@tcp:101:bash.0 Request processed in 8892us (9151us total) trans 4294967472 rc 0/0 00000100:00100000:2.0:1783965115.168522:0:6632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 191 00000100:00100000:0.0:1783965115.173291:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965115.173510:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715103232 00000100:00100000:3.0:1783965115.173522:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715103232 00000100:00100000:3.0:1783965115.173583:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 192 00000100:00100000:3.0:1783965115.173593:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947306e7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9923189b-eb4a-470c-ab45-969435371000+29:11035:x1870622715103232:12345-192.168.204.12@tcp:36:bash.0 00010000:00010000:3.0:1783965115.173851:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fe125 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965115.173870:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fe125 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965115.173882:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fe125 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783965115.173951:0:5812:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:3.0:1783965115.173979:0:5812:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000922c3885 reply state 000000001d34f8ab transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fe125 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783965115.173987:0:5812:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1783965115.178677:0:5812:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:2.0:1783965115.178922:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947306e7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9923189b-eb4a-470c-ab45-969435371000+33:11035:x1870622715103232:12345-192.168.204.12@tcp:36:bash.0 Request processed in 5315us (5624us total) trans 4294967475 rc 0/0 00000100:00100000:2.0:1783965115.178933:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 192 00000020:00080000:2.0:1783965115.178939:0:5812:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:3.0:1783965115.188349:0:3308:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fe125 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965115.188368:0:3308:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fe125 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965115.188376:0:3308:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fe125 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965115.188400:0:3308:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947436f26e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1783965115.188405:0:3308:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fe125 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965115.188413:0:3308:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fe125 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965115.188430:0:3308:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff947402a2da00) 00010000:00010000:3.0:1783965115.188433:0:3308:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783965115.188437:0:3308:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fe125 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965115.188443:0:3308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fe125 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783965115.194960:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965115.195131:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715103360 00000100:00100000:2.0:1783965115.195142:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715103360 00000100:00100000:2.0:1783965115.195240:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 193 00000100:00100000:2.0:1783965115.195250:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947306e78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9923189b-eb4a-470c-ab45-969435371000+32:11035:x1870622715103360:12345-192.168.204.12@tcp:101:bash.0 00010000:00010000:2.0:1783965115.195278:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783965115.195301:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e400/0xe782b916994fe12c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5f0226 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965115.195362:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e400/0xe782b916994fe12c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0226 expref: 33 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965115.195378:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e400/0xe782b916994fe12c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0226 expref: 33 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965115.195397:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff947402a2da00) 00010000:00010000:2.0:1783965115.195400:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783965115.195405:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94743fb8e400, rc 0) 00000100:00100000:2.0:1783965115.195459:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947306e78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9923189b-eb4a-470c-ab45-969435371000+33:11035:x1870622715103360:12345-192.168.204.12@tcp:101:bash.0 Request processed in 210us (823us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965115.195466:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 193 00000100:00100000:0.0:1783965115.201562:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965115.201740:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715103488 00000100:00100000:2.0:1783965115.201751:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715103488 00000100:00100000:2.0:1783965115.201813:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 59 00000100:00100000:2.0:1783965115.201824:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947306e78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9923189b-eb4a-470c-ab45-969435371000+7:11035:x1870622715103488:12345-192.168.204.12@tcp:101:bash.0 00010000:00010000:2.0:1783965115.201844:0:6608:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783965115.201865:0:6608:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003d89582a/0xe782b916994fe133 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5f022d expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783965115.201892:0:6608:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a5525b9, atime: 0x6a5525b7, ctime: 0x6a5525b9, blocks: 0xb 00010000:00010000:2.0:1783965115.201987:0:6608:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=349s v=(0 0) 00010000:00010000:2.0:1783965115.202162:0:6608:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783965115.202172:0:6608:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003d89582a/0xe782b916994fe133 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f022d expref: 8 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965115.202190:0:6608:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003d89582a/0xe782b916994fe133 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f022d expref: 8 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965115.202281:0:6608:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94743fb8fc00, rc 0) 00000100:00100000:2.0:1783965115.202374:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947306e78000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9923189b-eb4a-470c-ab45-969435371000+8:11035:x1870622715103488:12345-192.168.204.12@tcp:101:bash.0 Request processed in 552us (821us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965115.202382:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 59 00000100:00100000:0.0:1783965115.204979:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965115.205099:0:6612:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715103616 00000100:00100000:2.0:1783965115.205109:0:6612:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715103616 00002000:00010000:2.0:1783965115.205147:0:6612:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:2.0:1783965115.205152:0:6612:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff947306e79f80 with x1870622715103616 ext(0->18446744073709551615) 00002000:00010000:2.0:1783965115.205163:0:6612:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff947306e79f80. 00000100:00100000:2.0:1783965115.205198:0:6612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 5 00000100:00100000:2.0:1783965115.205240:0:6612:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947306e79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9923189b-eb4a-470c-ab45-969435371000+8:2359:x1870622715103616:12345-192.168.204.12@tcp:10:bash.0 00002000:00010000:2.0:1783965115.205524:0:6612:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:2.0:1783965115.205527:0:6612:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1783965113 -> 1783965114 00002000:00010000:2.0:1783965115.205529:0:6612:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 1783965111 -> 1783965111 00002000:00010000:2.0:1783965115.205531:0:6612:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1783965113 -> 1783965114 00002000:00010000:2.0:1783965115.205534:0:6612:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:2.0:1783965115.205595:0:6612:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947306e79f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:9923189b-eb4a-470c-ab45-969435371000+9:2359:x1870622715103616:12345-192.168.204.12@tcp:10:bash.0 Request processed in 357us (625us total) trans 4294967318 rc 0/0 00000100:00100000:2.0:1783965115.205619:0:6612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 5 00002000:00010000:2.0:1783965115.205623:0:6612:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:2.0:1783965115.205626:0:6612:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff947306e79f80 with x1870622715103616 ext(0->18446744073709551615) 00002000:00010000:2.0:1783965115.205631:0:6612:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff947306e79f80. 00000100:00100000:0.0:1783965115.312343:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965115.312412:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715103744 00000100:00100000:1.0:1783965115.312434:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715103744 00000100:00100000:1.0:1783965115.312554:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 194 00000100:00100000:1.0:1783965115.312566:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947306e78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9923189b-eb4a-470c-ab45-969435371000+33:11515:x1870622715103744:12345-192.168.204.12@tcp:34:lfs.0 00010000:00010000:1.0:1783965115.312786:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef000/0xe782b916994fe13a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965115.312804:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef000/0xe782b916994fe13a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965115.312817:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef000/0xe782b916994fe13a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965115.312834:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994fe141 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965115.312842:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994fe141 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965115.312849:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994fe141 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965115.313235:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efa00/0xe782b916994fe148 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965115.313890:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efa00/0xe782b916994fe148 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965115.313902:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efa00/0xe782b916994fe148 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783965115.313948:0:5811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efa00/0xe782b916994fe148 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965115.313973:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef000/0xe782b916994fe13a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965115.313980:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef000/0xe782b916994fe13a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965115.313987:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef000/0xe782b916994fe13a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965115.313992:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743d9ef000 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1783965115.313996:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef000/0xe782b916994fe13a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965115.314004:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef000/0xe782b916994fe13a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965115.314016:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94740a90c500) 00010000:00010000:1.0:1783965115.314020:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783965115.314024:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef000/0xe782b916994fe13a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965115.314030:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef000/0xe782b916994fe13a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965115.314052:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994fe141 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965115.314059:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994fe141 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965115.314138:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994fe141 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965115.314149:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743d9ee800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1783965115.314152:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994fe141 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965115.314158:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994fe141 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965115.314167:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff947407b5cd00) 00010000:00010000:1.0:1783965115.314170:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783965115.314172:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994fe141 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965115.314178:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994fe141 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965115.314355:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efa00/0xe782b916994fe148 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965115.314365:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efa00/0xe782b916994fe148 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965115.314370:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efa00/0xe782b916994fe148 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965115.314375:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743d9efa00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1783965115.314378:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efa00/0xe782b916994fe148 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965115.314384:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efa00/0xe782b916994fe148 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965115.314401:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff947402a2da00) 00010000:00010000:1.0:1783965115.314403:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783965115.314406:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efa00/0xe782b916994fe148 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965115.314411:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efa00/0xe782b916994fe148 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783965115.314513:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947306e78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9923189b-eb4a-470c-ab45-969435371000+33:11515:x1870622715103744:12345-192.168.204.12@tcp:34:lfs.0 Request processed in 1947us (2176us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965115.314523:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 194 00000100:00100000:1.0:1783965115.378521:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965115.378682:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715104000 00000100:00100000:2.0:1783965115.378692:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715104000 00000100:00100000:2.0:1783965115.378757:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 195 00000100:00100000:2.0:1783965115.378768:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e57df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9923189b-eb4a-470c-ab45-969435371000+33:11518:x1870622715104000:12345-192.168.204.12@tcp:101:lfs.0 00010000:00010000:2.0:1783965115.378789:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783965115.378812:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f000/0xe782b916994fe14f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5f0234 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965115.378907:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8ec00/0xe782b916994fe156 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965115.378922:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8ec00/0xe782b916994fe156 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965115.378933:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8ec00/0xe782b916994fe156 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965115.378948:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f600/0xe782b916994fe15d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965115.378955:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f600/0xe782b916994fe15d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965115.378960:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f600/0xe782b916994fe15d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965115.379333:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fe00/0xe782b916994fe164 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965115.379343:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fe00/0xe782b916994fe164 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965115.379351:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fe00/0xe782b916994fe164 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783965115.379360:0:5813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1783965115.379462:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8ec00/0xe782b916994fe156 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965115.379470:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8ec00/0xe782b916994fe156 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965115.379476:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8ec00/0xe782b916994fe156 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965115.379482:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743fb8ec00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1783965115.379486:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8ec00/0xe782b916994fe156 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965115.379505:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8ec00/0xe782b916994fe156 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965115.379518:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94740a90c500) 00010000:00010000:2.0:1783965115.379521:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783965115.379525:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8ec00/0xe782b916994fe156 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965115.379541:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8ec00/0xe782b916994fe156 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965115.379553:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f600/0xe782b916994fe15d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965115.379559:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f600/0xe782b916994fe15d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965115.379565:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f600/0xe782b916994fe15d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965115.379570:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743fb8f600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1783965115.379573:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f600/0xe782b916994fe15d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965115.379579:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f600/0xe782b916994fe15d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965115.379586:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff947402a2dc00) 00010000:00010000:2.0:1783965115.379588:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783965115.379591:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f600/0xe782b916994fe15d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965115.379596:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f600/0xe782b916994fe15d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965115.379641:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f000/0xe782b916994fe14f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0234 expref: 36 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965115.379654:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fe00/0xe782b916994fe164 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0234 expref: 35 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965115.379667:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff947402a2da00) 00010000:00010000:2.0:1783965115.379670:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1783965115.379672:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94743fb8fe00, rc 0) 00000100:00100000:2.0:1783965115.379739:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e57df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9923189b-eb4a-470c-ab45-969435371000+35:11518:x1870622715104000:12345-192.168.204.12@tcp:101:lfs.0 Request processed in 972us (1227us total) trans 4294967476 rc 0/0 00000100:00100000:2.0:1783965115.379747:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 195 00000100:00100000:0.0:1783965115.383557:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965115.383650:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715104128 00000100:00100000:2.0:1783965115.383660:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715104128 00000100:00100000:2.0:1783965115.383719:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 196 00000100:00100000:2.0:1783965115.383729:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947306e7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9923189b-eb4a-470c-ab45-969435371000+35:11518:x1870622715104128:12345-192.168.204.12@tcp:54:lfs.0 00010000:00010000:2.0:1783965115.383799:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fa00/0xe782b916994fe172 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965115.383814:0:5812:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27c00/0xe782b916994fe117 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f021f expref: 35 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965115.383823:0:5812:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fa00/0xe782b916994fe172 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965115.383871:0:5812:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27c00/0xe782b916994fe117 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f021f expref: 35 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965115.383884:0:5812:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27c00/0xe782b916994fe117 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f021f expref: 35 pid: 6632 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783965115.383900:0:5812:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947307dc6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5812:1870622732919552:192.168.204.12@tcp:104: 00000100:00100000:2.0:1783965115.384278:0:5812:0:(client.c:2702:ptlrpc_set_wait()) set ffff9474258150c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783965115.388542:0:5812:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947307dc6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5812:1870622732919552:192.168.204.12@tcp:104: 00010000:00010000:2.0:1783965115.388575:0:5812:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fa00/0xe782b916994fe172 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783965115.389788:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965115.389899:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715104384 00000100:00100000:3.0:1783965115.389908:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715104384 00000100:00100000:3.0:1783965115.393967:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 52 00000100:00100000:3.0:1783965115.394005:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947306e78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9923189b-eb4a-470c-ab45-969435371000+36:5571:x1870622715104384:12345-192.168.204.12@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1783965115.394363:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947306e78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9923189b-eb4a-470c-ab45-969435371000+37:5571:x1870622715104384:12345-192.168.204.12@tcp:35:ldlm_bl.0 Request processed in 378us (4577us total) trans 4294967477 rc 0/0 00000100:00100000:3.0:1783965115.397960:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 52 00000100:00100000:0.0:1783965115.400132:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965115.400331:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715104512 00000100:00100000:2.0:1783965115.400341:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715104512 00010000:00010000:2.0:1783965115.400384:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27c00/0xe782b916994fe117 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f021f expref: 37 pid: 6632 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783965115.400467:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 75 00000100:00100000:2.0:1783965115.400478:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947306e7b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9923189b-eb4a-470c-ab45-969435371000+37:2360:x1870622715104512:12345-192.168.204.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783965115.400507:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783965115.400513:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27c00/0xe782b916994fe117 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f021f expref: 37 pid: 6632 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965115.400527:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27c00/0xe782b916994fe117 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f021f expref: 37 pid: 6632 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965115.400550:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27c00/0xe782b916994fe117 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f021f expref: 37 pid: 6632 timeout: 449 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965115.400567:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff947402a2da00) 00010000:00010000:2.0:1783965115.400573:0:5797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fa00/0xe782b916994fe172 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965115.400582:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fa00/0xe782b916994fe172 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965115.400609:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fa00/0xe782b916994fe172 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965115.400656:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783965115.400729:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947306e7b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9923189b-eb4a-470c-ab45-969435371000+36:2360:x1870622715104512:12345-192.168.204.12@tcp:103:ldlm_bl.0 Request processed in 252us (606us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965115.400736:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 75 00010000:00010000:3.0:1783965115.400794:0:5812:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fa00/0xe782b916994fe172 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965115.400802:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fa00/0xe782b916994fe172 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965115.400834:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fa00/0xe782b916994fe172 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965115.400860:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fa00/0xe782b916994fe172 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965115.400867:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fa00/0xe782b916994fe172 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965115.400872:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743fb8fa00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1783965115.400877:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fa00/0xe782b916994fe172 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965115.400884:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fa00/0xe782b916994fe172 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965115.400893:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff947402a2da00) 00010000:00010000:3.0:1783965115.400895:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783965115.400898:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fa00/0xe782b916994fe172 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965115.400904:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fa00/0xe782b916994fe172 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783965115.400953:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947306e7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9923189b-eb4a-470c-ab45-969435371000+35:11518:x1870622715104128:12345-192.168.204.12@tcp:54:lfs.0 Request processed in 17224us (17405us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965115.400961:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 196 00000100:00100000:1.0:1783965115.407063:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965115.407176:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715104768 00000100:00100000:2.0:1783965115.407186:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715104768 00000100:00100000:2.0:1783965115.407344:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 53 00000100:00100000:2.0:1783965115.407356:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e57d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9923189b-eb4a-470c-ab45-969435371000+35:11518:x1870622715104768:12345-192.168.204.12@tcp:35:lfs.0 00000100:00100000:2.0:1783965115.407606:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e57d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9923189b-eb4a-470c-ab45-969435371000+36:11518:x1870622715104768:12345-192.168.204.12@tcp:35:lfs.0 Request processed in 251us (551us total) trans 4294967478 rc 0/0 00000100:00100000:2.0:1783965115.407614:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 53 00000100:00100000:1.0:1783965115.498996:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965115.499117:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715105024 00000100:00100000:2.0:1783965115.499126:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715105024 00000100:00100000:2.0:1783965115.499340:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 197 00000100:00100000:2.0:1783965115.499351:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e57e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9923189b-eb4a-470c-ab45-969435371000+36:11529:x1870622715105024:12345-192.168.204.12@tcp:101:cat.0 00010000:00010000:2.0:1783965115.499374:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783965115.499395:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f000/0xe782b916994fe179 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5f023b expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965115.499466:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f600/0xe782b916994fe180 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965115.499480:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f600/0xe782b916994fe180 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965115.499519:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f600/0xe782b916994fe180 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965115.499533:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8ec00/0xe782b916994fe187 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965115.499540:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8ec00/0xe782b916994fe187 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965115.499547:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8ec00/0xe782b916994fe187 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965115.499934:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fa00/0xe782b916994fe18e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965115.499944:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fa00/0xe782b916994fe18e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965115.499951:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fa00/0xe782b916994fe18e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783965115.499961:0:5813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:2.0:1783965115.500037:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f600/0xe782b916994fe180 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965115.500044:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f600/0xe782b916994fe180 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965115.500052:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f600/0xe782b916994fe180 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965115.500057:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743fb8f600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1783965115.500066:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f600/0xe782b916994fe180 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965115.500074:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f600/0xe782b916994fe180 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965115.500085:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94740a90c500) 00010000:00010000:2.0:1783965115.500089:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783965115.500093:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f600/0xe782b916994fe180 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965115.500099:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f600/0xe782b916994fe180 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965115.500110:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8ec00/0xe782b916994fe187 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965115.500115:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8ec00/0xe782b916994fe187 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965115.500121:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8ec00/0xe782b916994fe187 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965115.500126:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743fb8ec00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1783965115.500129:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8ec00/0xe782b916994fe187 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965115.500134:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8ec00/0xe782b916994fe187 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965115.500140:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff947402a2dc00) 00010000:00010000:2.0:1783965115.500142:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783965115.500149:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8ec00/0xe782b916994fe187 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965115.500155:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8ec00/0xe782b916994fe187 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965115.500189:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f000/0xe782b916994fe179 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f023b expref: 39 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965115.500462:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fa00/0xe782b916994fe18e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f023b expref: 38 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965115.500471:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff947402a2da00) 00010000:00010000:2.0:1783965115.500474:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783965115.500476:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94743fb8fa00, rc 0) 00000100:00100000:2.0:1783965115.500545:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e57e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9923189b-eb4a-470c-ab45-969435371000+38:11529:x1870622715105024:12345-192.168.204.12@tcp:101:cat.0 Request processed in 1195us (1556us total) trans 4294967479 rc 0/0 00000100:00100000:2.0:1783965115.500553:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 197 00000100:00100000:0.0:1783965115.510903:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965115.511048:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715105280 00000100:00100000:3.0:1783965115.511059:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715105280 00000100:00100000:3.0:1783965115.511119:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 54 00000100:00100000:3.0:1783965115.511129:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947306e7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9923189b-eb4a-470c-ab45-969435371000+38:11529:x1870622715105280:12345-192.168.204.12@tcp:35:cat.0 00000100:00100000:3.0:1783965115.511409:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947306e7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9923189b-eb4a-470c-ab45-969435371000+39:11529:x1870622715105280:12345-192.168.204.12@tcp:35:cat.0 Request processed in 280us (528us total) trans 4294967480 rc 0/0 00000100:00100000:3.0:1783965115.511428:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 54 00000100:00100000:0.0:1783965115.555632:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965115.555819:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715105536 00000100:00100000:1.0:1783965115.555829:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715105536 00000100:00100000:1.0:1783965115.555906:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 198 00000100:00100000:1.0:1783965115.555917:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947306e7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9923189b-eb4a-470c-ab45-969435371000+39:11530:x1870622715105536:12345-192.168.204.12@tcp:36:rm.0 00010000:00010000:1.0:1783965115.555976:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1783965115.556006:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fa00/0xe782b916994fe18e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f023b expref: 39 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965115.556041:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fe00/0xe782b916994fe164 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0234 expref: 38 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965115.556053:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e400/0xe782b916994fe12c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0226 expref: 37 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965115.556082:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff947402a2da00) 00010000:00010000:1.0:1783965115.556093:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783965115.556115:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef600/0xe782b916994fe19c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965115.556127:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef600/0xe782b916994fe19c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965115.556136:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef600/0xe782b916994fe19c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965115.556149:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef400/0xe782b916994fe1a3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965115.556157:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef400/0xe782b916994fe1a3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965115.556163:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef400/0xe782b916994fe1a3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965115.557398:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eee00/0xe782b916994fe1aa lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965115.557411:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eee00/0xe782b916994fe1aa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965115.557421:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eee00/0xe782b916994fe1aa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783965115.561149:0:5811:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:1.0:1783965115.561165:0:5811:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 349789962631ns, next at 350789959009ns, rc = 0 00010000:00010000:1.0:1783965115.561480:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee200/0xe782b916994fe1b1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965115.561508:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee200/0xe782b916994fe1b1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965115.561519:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee200/0xe782b916994fe1b1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965115.561528:0:5811:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee200/0xe782b916994fe1b1 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965115.561535:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee200/0xe782b916994fe1b1 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965115.561541:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee200/0xe782b916994fe1b1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965115.561558:0:5811:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783965115.561580:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eee00/0xe782b916994fe1aa lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965115.561587:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eee00/0xe782b916994fe1aa lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965115.561593:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eee00/0xe782b916994fe1aa lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965115.561599:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743d9eee00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1783965115.561603:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eee00/0xe782b916994fe1aa lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965115.561611:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eee00/0xe782b916994fe1aa lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965115.561637:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff947407b5c200) 00010000:00010000:1.0:1783965115.564563:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1783965115.564575:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eee00/0xe782b916994fe1aa lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965115.564584:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eee00/0xe782b916994fe1aa lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965115.564623:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef600/0xe782b916994fe19c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965115.564631:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef600/0xe782b916994fe19c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965115.564636:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef600/0xe782b916994fe19c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965115.564744:0:5800:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783965115.564751:0:5800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee200/0xe782b916994fe1b1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965115.564758:0:5800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743d9ee200 already unused, calling callback (ffffffffc168d230) 00010000:00010000:0.0:1783965115.564762:0:5800:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee200/0xe782b916994fe1b1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965115.564770:0:5800:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee200/0xe782b916994fe1b1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965115.564786:0:5800:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff947407b5c200) 00010000:00010000:0.0:1783965115.564788:0:5800:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1783965115.564791:0:5800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee200/0xe782b916994fe1b1 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965115.564797:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee200/0xe782b916994fe1b1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965115.564821:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783965115.564823:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783965115.564824:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783965115.564855:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743d9ef600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1783965115.564860:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef600/0xe782b916994fe19c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965115.564865:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef600/0xe782b916994fe19c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965115.564875:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94740a90c500) 00010000:00010000:1.0:1783965115.564877:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783965115.564880:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef600/0xe782b916994fe19c lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965115.564886:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef600/0xe782b916994fe19c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783965115.564923:0:5811:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000161a4589 reply state 000000002d561c6d transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef400/0xe782b916994fe1a3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783965115.564933:0:5811:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783965115.565083:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947306e7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9923189b-eb4a-470c-ab45-969435371000+38:11530:x1870622715105536:12345-192.168.204.12@tcp:36:rm.0 Request processed in 9161us (9452us total) trans 4294967481 rc 0/0 00000100:00100000:1.0:1783965115.565092:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 198 00010000:00010000:2.0:1783965115.578293:0:3309:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef400/0xe782b916994fe1a3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965115.578312:0:3309:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef400/0xe782b916994fe1a3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965115.578321:0:3309:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef400/0xe782b916994fe1a3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965115.578328:0:3309:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743d9ef400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1783965115.578333:0:3309:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef400/0xe782b916994fe1a3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965115.578367:0:3309:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef400/0xe782b916994fe1a3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965115.578384:0:3309:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff947407b5cd00) 00010000:00010000:2.0:1783965115.578387:0:3309:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783965115.578392:0:3309:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef400/0xe782b916994fe1a3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965115.578399:0:3309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef400/0xe782b916994fe1a3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783965115.666521:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965115.666616:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715105792 00000100:00100000:3.0:1783965115.666626:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715105792 00000100:00100000:3.0:1783965115.666689:0:6632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 199 00000100:00100000:3.0:1783965115.666700:0:6632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947306e79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9923189b-eb4a-470c-ab45-969435371000+37:11536:x1870622715105792:12345-192.168.204.12@tcp:101:bash.0 00010000:00010000:3.0:1783965115.666726:0:6632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783965115.666749:0:6632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fe1b8 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5f0242 expref: -99 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965115.666902:0:6632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27800/0xe782b916994fe1bf lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965115.666918:0:6632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27800/0xe782b916994fe1bf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965115.666930:0:6632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27800/0xe782b916994fe1bf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965115.666946:0:6632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27c00/0xe782b916994fe1c6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965115.666953:0:6632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27c00/0xe782b916994fe1c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965115.666959:0:6632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27c00/0xe782b916994fe1c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1783965115.667960:0:6632:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:3.0:1783965115.668123:0:6632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fe1cd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965115.668141:0:6632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fe1cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965115.668150:0:6632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fe1cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965115.668189:0:6632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27800/0xe782b916994fe1bf lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965115.668196:0:6632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27800/0xe782b916994fe1bf lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965115.668233:0:6632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27800/0xe782b916994fe1bf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965115.668239:0:6632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947436f27800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1783965115.668360:0:6632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27800/0xe782b916994fe1bf lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965115.668370:0:6632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27800/0xe782b916994fe1bf lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965115.668382:0:6632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94740a90c500) 00010000:00010000:3.0:1783965115.668385:0:6632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783965115.668389:0:6632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27800/0xe782b916994fe1bf lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965115.668396:0:6632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27800/0xe782b916994fe1bf lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783965115.668410:0:6632:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a3e7c684 reply state 00000000b9708aed transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27c00/0xe782b916994fe1c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783965115.668425:0:6632:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1783965115.668458:0:6632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fe1b8 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0242 expref: 40 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965115.668473:0:6632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fe1cd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0242 expref: 39 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965115.668480:0:6632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff94740b97a200) 00010000:00010000:3.0:1783965115.668482:0:6632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783965115.668484:0:6632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff947436f26200, rc 0) 00000100:00100000:3.0:1783965115.668569:0:6632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947306e79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9923189b-eb4a-470c-ab45-969435371000+40:11536:x1870622715105792:12345-192.168.204.12@tcp:101:bash.0 Request processed in 1870us (2058us total) trans 4294967482 rc 0/0 00000100:00100000:3.0:1783965115.668578:0:6632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 199 00010000:00010000:3.0:1783965115.672229:0:3308:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27c00/0xe782b916994fe1c6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965115.672320:0:3308:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27c00/0xe782b916994fe1c6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965115.672327:0:3308:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27c00/0xe782b916994fe1c6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965115.672333:0:3308:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947436f27c00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1783965115.672338:0:3308:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27c00/0xe782b916994fe1c6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965115.672347:0:3308:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27c00/0xe782b916994fe1c6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965115.672382:0:3308:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff94740b97ad00) 00010000:00010000:3.0:1783965115.672385:0:3308:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783965115.672390:0:3308:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27c00/0xe782b916994fe1c6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965115.672397:0:3308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27c00/0xe782b916994fe1c6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783965115.672592:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965115.672697:0:11945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715105920 00000100:00100000:2.0:1783965115.672709:0:11945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715105920 00000100:00100000:2.0:1783965115.672768:0:11945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 60 00000100:00100000:2.0:1783965115.672778:0:11945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947306e7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9923189b-eb4a-470c-ab45-969435371000+7:2360:x1870622715105920:12345-192.168.204.12@tcp:101:bash.0 00010000:00010000:2.0:1783965115.672797:0:11945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783965115.672815:0:11945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f42876e3/0xe782b916994fe1db lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5f0249 expref: -99 pid: 11945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783965115.672842:0:11945:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783965115.672864:0:11945:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=349s v=(0 0) 00010000:00010000:2.0:1783965115.672869:0:11945:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783965115.672879:0:11945:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f42876e3/0xe782b916994fe1db lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0249 expref: 8 pid: 11945 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965115.672897:0:11945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f42876e3/0xe782b916994fe1db lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0249 expref: 8 pid: 11945 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965115.672929:0:11945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94743fb8f000, rc 0) 00000100:00100000:2.0:1783965115.672985:0:11945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947306e7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9923189b-eb4a-470c-ab45-969435371000+8:2360:x1870622715105920:12345-192.168.204.12@tcp:101:bash.0 Request processed in 208us (396us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965115.672996:0:11945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 60 00000100:00100000:1.0:1783965115.679085:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783965115.679400:0:8738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715106048 00000100:00100000:0.0:1783965115.679411:0:8738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715106048 00000100:00100000:0.0:1783965115.679469:0:8738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 61 00000100:00100000:0.0:1783965115.679480:0:8738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947429f99180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9923189b-eb4a-470c-ab45-969435371000+8:11536:x1870622715106048:12345-192.168.204.12@tcp:101:bash.0 00010000:00010000:0.0:1783965115.679507:0:8738:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783965115.679526:0:8738:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000acaa0ca6/0xe782b916994fe1e2 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5f0250 expref: -99 pid: 8738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965115.679559:0:8738:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f42876e3/0xe782b916994fe1db lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0249 expref: 9 pid: 11945 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965115.679569:0:8738:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783965115.679573:0:8738:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783965115.679580:0:8738:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000acaa0ca6/0xe782b916994fe1e2 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0250 expref: 9 pid: 8738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965115.679614:0:8738:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f42876e3/0xe782b916994fe1db lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0249 expref: 9 pid: 11945 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965115.679627:0:8738:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f42876e3/0xe782b916994fe1db lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0249 expref: 9 pid: 11945 timeout: 449 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783965115.679640:0:8738:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947436c3c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8738:1870622732919680:192.168.204.12@tcp:104: 00000100:00100000:0.0:1783965115.679744:0:8738:0:(client.c:2702:ptlrpc_set_wait()) set ffff9473048c2180 going to sleep for 11 seconds 00000100:00100000:0.0:1783965115.688513:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965115.689405:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715106176 00000100:00100000:3.0:1783965115.689416:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715106176 00010000:00010000:3.0:1783965115.689457:0:5799:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f42876e3/0xe782b916994fe1db lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0249 expref: 10 pid: 11945 timeout: 449 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783965115.689507:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 76 00000100:00100000:3.0:1783965115.689517:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94741843e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9923189b-eb4a-470c-ab45-969435371000+10:2359:x1870622715106176:12345-192.168.204.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783965115.689530:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783965115.689551:0:5799:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f42876e3/0xe782b916994fe1db lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0249 expref: 10 pid: 11945 timeout: 449 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965115.689565:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f42876e3/0xe782b916994fe1db lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0249 expref: 10 pid: 11945 timeout: 449 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965115.689590:0:5799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783965115.689595:0:5799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783965115.689602:0:5799:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000acaa0ca6/0xe782b916994fe1e2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0250 expref: 10 pid: 8738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965115.689626:0:5799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000acaa0ca6/0xe782b916994fe1e2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0250 expref: 10 pid: 8738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965115.689664:0:5799:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000acaa0ca6/0xe782b916994fe1e2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0250 expref: 10 pid: 8738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783965115.689677:0:5799:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743648f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5799:1870622732919808:192.168.204.12@tcp:105: 00000100:00100000:3.0:1783965115.689757:0:5799:0:(client.c:2702:ptlrpc_set_wait()) set ffff9474258aa300 going to sleep for 11 seconds 00010000:00010000:2.0:1783965115.690699:0:8738:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f42876e3/0xe782b916994fe1db lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0249 expref: 10 pid: 11945 timeout: 449 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783965115.690718:0:8738:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947436c3c380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8738:1870622732919680:192.168.204.12@tcp:104: 00010000:00010000:2.0:1783965115.690744:0:8738:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000acaa0ca6/0xe782b916994fe1e2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0250 expref: 9 pid: 8738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965115.690755:0:8738:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94743e2fc200, rc 0) 00000100:00100000:2.0:1783965115.690837:0:8738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947429f99180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9923189b-eb4a-470c-ab45-969435371000+9:11536:x1870622715106048:12345-192.168.204.12@tcp:101:bash.0 Request processed in 11359us (11764us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965115.690845:0:8738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 61 00000100:00100000:3.0:1783965115.692418:0:5799:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743648f800 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5799:1870622732919808:192.168.204.12@tcp:105: 00010000:00010000:3.0:1783965115.692437:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783965115.692520:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94741843e850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9923189b-eb4a-470c-ab45-969435371000+8:2359:x1870622715106176:12345-192.168.204.12@tcp:103:ldlm_bl.0 Request processed in 3003us (4015us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965115.692530:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 76 00000100:00100000:0.0:1783965115.701581:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965115.701663:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715106432 00000100:00100000:3.0:1783965115.701674:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715106432 00000100:00100000:3.0:1783965115.701737:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 55 00000100:00100000:3.0:1783965115.701749:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436c3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9923189b-eb4a-470c-ab45-969435371000+39:11536:x1870622715106432:12345-192.168.204.12@tcp:35:bash.0 00000100:00100000:3.0:1783965115.702130:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436c3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9923189b-eb4a-470c-ab45-969435371000+40:11536:x1870622715106432:12345-192.168.204.12@tcp:35:bash.0 Request processed in 383us (559us total) trans 4294967483 rc 0/0 00000100:00100000:3.0:1783965115.702139:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 55 00000040:00080000:1.0:1783965115.755471:0:11561:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1783965115.755481:0:11561:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1783965115.755694:0:11561:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1783965115.755701:0:11561:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1783965115.847594:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965115.847879:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715106560 00000100:00100000:3.0:1783965115.847888:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715106560 00000100:00100000:3.0:1783965115.847968:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 200 00000100:00100000:3.0:1783965115.847990:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436c3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9923189b-eb4a-470c-ab45-969435371000+40:11552:x1870622715106560:12345-192.168.204.12@tcp:101:lfs.0 00010000:00010000:3.0:1783965115.848029:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783965115.848051:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27c00/0xe782b916994fe1e9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5f0257 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965115.848116:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fe1f0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965115.848131:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fe1f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965115.848143:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fe1f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783965115.848252:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:3.0:1783965115.848257:0:5812:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1783965115.848283:0:5812:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fe1f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965115.848309:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27c00/0xe782b916994fe1e9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0257 expref: 42 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965115.848329:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fe1f0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0257 expref: 41 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965115.848338:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94740a90c500) 00010000:00010000:3.0:1783965115.848340:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783965115.848344:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff947436f26e00, rc 0) 00000100:00100000:3.0:1783965115.848401:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436c3c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9923189b-eb4a-470c-ab45-969435371000+41:11552:x1870622715106560:12345-192.168.204.12@tcp:101:lfs.0 Request processed in 424us (816us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965115.848410:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 200 00000100:00100000:0.0:1783965115.857586:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965115.858411:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715106816 00000100:00100000:2.0:1783965115.858422:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715106816 00000100:00100000:2.0:1783965115.858494:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 201 00000100:00100000:2.0:1783965115.858504:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947429f45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9923189b-eb4a-470c-ab45-969435371000+41:11552:x1870622715106816:12345-192.168.204.12@tcp:101:lfs.0 00010000:00010000:2.0:1783965115.858526:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783965115.858550:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f000/0xe782b916994fe1f7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5f025e expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965115.858656:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f600/0xe782b916994fe1fe lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965115.858685:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f600/0xe782b916994fe1fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965115.858697:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f600/0xe782b916994fe1fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783965115.858710:0:5813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1783965115.858841:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f000/0xe782b916994fe1f7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f025e expref: 44 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965115.858861:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f600/0xe782b916994fe1fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f025e expref: 43 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965115.858871:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff94740b97a200) 00010000:00010000:2.0:1783965115.858874:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783965115.858878:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94743fb8f600, rc 0) 00000100:00100000:2.0:1783965115.858955:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947429f45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9923189b-eb4a-470c-ab45-969435371000+43:11552:x1870622715106816:12345-192.168.204.12@tcp:101:lfs.0 Request processed in 452us (1379us total) trans 4294967484 rc 0/0 00000100:00100000:2.0:1783965115.858962:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 201 00000100:00100000:0.0:1783965115.870273:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965115.870380:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715107072 00000100:00100000:1.0:1783965115.870390:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715107072 00000100:00100000:1.0:1783965115.870465:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 202 00000100:00100000:1.0:1783965115.870476:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743d9cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9923189b-eb4a-470c-ab45-969435371000+43:11552:x1870622715107072:12345-192.168.204.12@tcp:101:lfs.0 00010000:00010000:1.0:1783965115.870510:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783965115.870533:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef600/0xe782b916994fe20c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5f0265 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965115.870635:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eee00/0xe782b916994fe213 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965115.870650:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eee00/0xe782b916994fe213 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965115.870661:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eee00/0xe782b916994fe213 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1783965115.870686:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1783965115.870821:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef600/0xe782b916994fe20c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0265 expref: 46 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965115.870847:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eee00/0xe782b916994fe213 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0265 expref: 45 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965115.870855:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff94740b97a200) 00010000:00010000:1.0:1783965115.870858:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1783965115.870861:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94743d9eee00, rc 0) 00000100:00100000:1.0:1783965115.870920:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743d9cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9923189b-eb4a-470c-ab45-969435371000+45:11552:x1870622715107072:12345-192.168.204.12@tcp:101:lfs.0 Request processed in 446us (658us total) trans 4294967485 rc 0/0 00000100:00100000:1.0:1783965115.870927:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 202 00000100:00100000:0.0:1783965115.871392:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965115.871761:0:8330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715107200 00000100:00100000:1.0:1783965115.871767:0:8330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715107200 00000100:00100000:1.0:1783965115.871814:0:8330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 14 00000100:00100000:1.0:1783965115.871822:0:8330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743d9ce680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9923189b-eb4a-470c-ab45-969435371000+45:2359:x1870622715107200:12345-192.168.204.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783965115.871835:0:8330:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783965115.871853:0:8330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f600/0xe782b916994fe1fe lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f025e expref: 45 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965115.871867:0:8330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff94740b97a200) 00010000:00010000:1.0:1783965115.871871:0:8330:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783965115.872104:0:8330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743d9ce680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9923189b-eb4a-470c-ab45-969435371000+44:2359:x1870622715107200:12345-192.168.204.12@tcp:103:ldlm_bl.0 Request processed in 282us (712us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965115.872113:0:8330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 14 00000100:00100000:0.0:1783965115.888997:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965115.889096:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715107328 00000100:00100000:2.0:1783965115.889106:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715107328 00000100:00100000:2.0:1783965115.889164:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 62 00000100:00100000:2.0:1783965115.889173:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743d9cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9923189b-eb4a-470c-ab45-969435371000+8:2358:x1870622715107328:12345-192.168.204.12@tcp:1:lfs.0 00010000:00010000:2.0:1783965115.889256:0:6608:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f42876e3/0xe782b916994fe221 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965115.889278:0:6608:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000acaa0ca6/0xe782b916994fe1e2 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0250 expref: 8 pid: 8738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965115.889299:0:6608:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1783965115.889304:0:6608:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783965115.889309:0:6608:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f42876e3/0xe782b916994fe221 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965115.889345:0:6608:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000acaa0ca6/0xe782b916994fe1e2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0250 expref: 8 pid: 8738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965115.889359:0:6608:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000acaa0ca6/0xe782b916994fe1e2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0250 expref: 8 pid: 8738 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783965115.889375:0:6608:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947307dc6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6608:1870622732919936:192.168.204.12@tcp:104: 00000100:00100000:2.0:1783965115.889458:0:6608:0:(client.c:2702:ptlrpc_set_wait()) set ffff947425815a80 going to sleep for 11 seconds 00000100:00100000:2.0:1783965115.894907:0:6608:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947307dc6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6608:1870622732919936:192.168.204.12@tcp:104: 00010000:00010000:2.0:1783965115.894939:0:6608:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f42876e3/0xe782b916994fe221 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783965115.900618:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965115.900726:0:6614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715107456 00000100:00100000:1.0:1783965115.900736:0:6614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715107456 00002000:00100000:1.0:1783965115.900786:0:6614:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff94743d9cf800 x1870622715107456/t0(0) o4->9923189b-eb4a-470c-ab45-969435371000@192.168.204.12@tcp:541/0 lens 504/0 e 0 to 0 dl 1783965126 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783965115.900798:0:6614:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff94743d9cf800 with x1870622715107456 ext(0->8) 00010000:00010000:1.0:1783965115.900808:0:6614:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000acaa0ca6/0xe782b916994fe1e2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0250 expref: 9 pid: 8738 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965115.900824:0:6614:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000acaa0ca6/0xe782b916994fe1e2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0250 expref: 9 pid: 8738 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783965115.900833:0:6614:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff94743d9cf800 00000100:00100000:1.0:1783965115.900866:0:6614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 3 00000100:00100000:1.0:1783965115.900874:0:6614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743d9cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9923189b-eb4a-470c-ab45-969435371000+9:2360:x1870622715107456:12345-192.168.204.12@tcp:4:lfs.0 00000100:00100000:1.0:1783965115.901538:0:6614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743d9cf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9923189b-eb4a-470c-ab45-969435371000+11:2360:x1870622715107456:12345-192.168.204.12@tcp:4:lfs.0 Request processed in 662us (929us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1783965115.901547:0:6614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 3 00002000:00100000:1.0:1783965115.901554:0:6614:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff94743d9cf800 x1870622715107456/t4294967308(0) o4->9923189b-eb4a-470c-ab45-969435371000@192.168.204.12@tcp:541/0 lens 504/448 e 0 to 0 dl 1783965126 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783965115.901563:0:6614:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff94743d9cf800 with x1870622715107456 ext(0->8) 00010000:00010000:1.0:1783965115.901570:0:6614:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000acaa0ca6/0xe782b916994fe1e2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0250 expref: 11 pid: 8738 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965115.901583:0:6614:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000acaa0ca6/0xe782b916994fe1e2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0250 expref: 11 pid: 8738 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783965115.901602:0:6614:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff94743d9cf800 00000100:00100000:0.0:1783965115.910909:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965115.911018:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715107584 00000100:00100000:1.0:1783965115.911030:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715107584 00010000:00010000:1.0:1783965115.911074:0:5798:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000acaa0ca6/0xe782b916994fe1e2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0250 expref: 11 pid: 8738 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783965115.911122:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 77 00000100:00100000:1.0:1783965115.911131:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743d9cea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9923189b-eb4a-470c-ab45-969435371000+11:2360:x1870622715107584:12345-192.168.204.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783965115.911146:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1783965115.913493:0:5798:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1783965115.913502:0:5798:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1783965115 00002000:00010000:2.0:1783965115.913506:0:5798:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1783965115 00002000:00010000:2.0:1783965115.913508:0:5798:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1783965115 00010000:00010000:2.0:1783965115.913527:0:5798:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000acaa0ca6/0xe782b916994fe1e2 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0250 expref: 11 pid: 8738 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965115.913571:0:5798:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000acaa0ca6/0xe782b916994fe1e2 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0250 expref: 11 pid: 8738 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965115.913600:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000acaa0ca6/0xe782b916994fe1e2 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0250 expref: 11 pid: 8738 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965115.913623:0:5798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783965115.913627:0:5798:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783965115.913633:0:5798:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f42876e3/0xe782b916994fe221 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965115.913643:0:5798:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f42876e3/0xe782b916994fe221 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965115.913694:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783965115.913773:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743d9cea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9923189b-eb4a-470c-ab45-969435371000+10:2360:x1870622715107584:12345-192.168.204.12@tcp:103:ldlm_bl.0 Request processed in 2641us (2872us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965115.913783:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 77 00010000:00010000:0.0:1783965115.913889:0:6608:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f42876e3/0xe782b916994fe221 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965115.913900:0:6608:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f42876e3/0xe782b916994fe221 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965115.913929:0:6608:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f42876e3/0xe782b916994fe221 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965115.913938:0:6608:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f42876e3/0xe782b916994fe221 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965115.913947:0:6608:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f42876e3/0xe782b916994fe221 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965115.913956:0:6608:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743fb8f000 already unused, calling callback (ffffffffc168d230) 00010000:00010000:0.0:1783965115.913961:0:6608:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f42876e3/0xe782b916994fe221 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965115.913984:0:6608:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f42876e3/0xe782b916994fe221 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965115.913997:0:6608:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f42876e3/0xe782b916994fe221 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965115.914005:0:6608:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f42876e3/0xe782b916994fe221 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783965115.914049:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743d9cce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9923189b-eb4a-470c-ab45-969435371000+9:2358:x1870622715107328:12345-192.168.204.12@tcp:1:lfs.0 Request processed in 24878us (25064us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965115.914058:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 62 00000100:00100000:0.0:1783965115.918564:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965115.918641:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715107840 00000100:00100000:3.0:1783965115.918655:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715107840 00000100:00100000:3.0:1783965115.918763:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 56 00000100:00100000:3.0:1783965115.918774:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94740638a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9923189b-eb4a-470c-ab45-969435371000+44:11552:x1870622715107840:12345-192.168.204.12@tcp:35:lfs.0 00000004:00010000:3.0:1783965115.918845:0:5815:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eee00/0xe782b916994fe213 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0265 expref: 44 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783965115.919115:0:5815:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:3.0:1783965115.919156:0:5815:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:3.0:1783965115.919502:0:5815:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:3.0:1783965115.919557:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27c00/0xe782b916994fe228 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965115.919572:0:5815:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fe1cd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0242 expref: 48 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965115.919581:0:5815:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27c00/0xe782b916994fe228 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965115.919615:0:5815:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fe1cd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0242 expref: 48 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965115.919629:0:5815:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fe1cd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0242 expref: 48 pid: 6632 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783965115.919644:0:5815:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743648ca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5815:1870622732920064:192.168.204.12@tcp:104: 00000100:00100000:3.0:1783965115.919730:0:5815:0:(client.c:2702:ptlrpc_set_wait()) set ffff9474258aab40 going to sleep for 11 seconds 00000100:00100000:1.0:1783965115.925841:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783965115.926239:0:8330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715107968 00000100:00100000:0.0:1783965115.926248:0:8330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715107968 00010000:00010000:0.0:1783965115.926290:0:8330:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fe1cd lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0242 expref: 49 pid: 6632 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783965115.926337:0:8330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 78 00000100:00100000:0.0:1783965115.926346:0:8330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9474057d9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9923189b-eb4a-470c-ab45-969435371000+49:2359:x1870622715107968:12345-192.168.204.12@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783965115.926360:0:8330:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783965115.926366:0:8330:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fe1cd lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0242 expref: 49 pid: 6632 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965115.926378:0:8330:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fe1cd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0242 expref: 49 pid: 6632 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965115.926420:0:8330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff94740b97a200) 00010000:00010000:0.0:1783965115.926426:0:8330:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27c00/0xe782b916994fe228 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965115.926436:0:8330:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27c00/0xe782b916994fe228 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965115.926443:0:8330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27c00/0xe782b916994fe228 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965115.926462:0:8330:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783965115.926529:0:8330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9474057d9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9923189b-eb4a-470c-ab45-969435371000+49:2359:x1870622715107968:12345-192.168.204.12@tcp:103:ldlm_bl.0 Request processed in 184us (698us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965115.926536:0:8330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 78 00010000:00010000:3.0:1783965115.926856:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fe1cd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0242 expref: 48 pid: 6632 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783965115.927263:0:5815:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743648ca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5815:1870622732920064:192.168.204.12@tcp:104: 00010000:00010000:3.0:1783965115.927291:0:5815:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27c00/0xe782b916994fe228 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965115.927300:0:5815:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27c00/0xe782b916994fe228 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965115.927305:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27c00/0xe782b916994fe228 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783965115.927447:0:5815:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:3.0:1783965115.933376:0:5815:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:3.0:1783965115.933540:0:5815:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743648ca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5815:1870622732920192:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1783965115.933611:0:5815:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783965115.933651:0:5815:0:(client.c:2702:ptlrpc_set_wait()) set ffff9474258aa000 going to sleep for 11 seconds 00000100:00100000:0.0:1783965115.933661:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732920192 00000100:00100000:0.0:1783965115.933670:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732920192 00000100:00100000:0.0:1783965115.933743:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1783965115.933752:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743648c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5815:x1870622732920192:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1783965115.933837:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743648c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5815:x1870622732920192:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 86us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965115.933844:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:2.0:1783965115.933966:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783965115.934343:0:5815:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743648ca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5815:1870622732920192:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1783965115.935473:0:5815:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:3.0:1783965115.935571:0:5815:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743648ca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5815:1870622732920320:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1783965115.935626:0:5815:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783965115.935654:0:5815:0:(client.c:2702:ptlrpc_set_wait()) set ffff9474258aab40 going to sleep for 11 seconds 00000100:00100000:0.0:1783965115.936027:0:12328:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732920320 00000100:00100000:0.0:1783965115.936034:0:12328:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732920320 00000100:00100000:0.0:1783965115.936084:0:12328:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1783965115.936094:0:12328:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743648f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+7:5815:x1870622732920320:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1783965115.936319:0:12328:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743648f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_002:lustre-MDT0000-mdtlov_UUID+8:5815:x1870622732920320:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 226us (692us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1783965115.936343:0:12328:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1783965115.936657:0:5815:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743648ca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5815:1870622732920320:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1783965115.936719:0:5815:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:1.0:1783965115.936778:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27c00/0xe782b916994fe228 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965115.936788:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27c00/0xe782b916994fe228 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965115.936796:0:5815:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27c00/0xe782b916994fe228 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965115.936803:0:5815:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947436f27c00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1783965115.936807:0:5815:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27c00/0xe782b916994fe228 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965115.936815:0:5815:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27c00/0xe782b916994fe228 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965115.936841:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff94740b97a200) 00010000:00010000:1.0:1783965115.936843:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1783965115.936849:0:5815:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27c00/0xe782b916994fe228 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965115.936855:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27c00/0xe782b916994fe228 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783965115.937075:0:5815:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1783965115.937265:0:5815:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:1.0:1783965115.937278:0:5815:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 350166075200ns, next at 351166073186ns, rc = 0 00000001:00080000:1.0:1783965115.937286:0:5815:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:1.0:1783965115.937323:0:5815:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff94740b97a200) 00010000:00010000:1.0:1783965115.937327:0:5815:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1783965115.937334:0:5815:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eee00/0xe782b916994fe213 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0265 expref: 52 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783965115.937440:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94740638a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9923189b-eb4a-470c-ab45-969435371000+51:11552:x1870622715107840:12345-192.168.204.12@tcp:35:lfs.0 Request processed in 18667us (18884us total) trans 4294967494 rc 0/0 00000100:00100000:1.0:1783965115.937449:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 56 00000020:00080000:1.0:1783965115.937454:0:5815:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1783965115.940493:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965115.940981:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715108096 00000100:00100000:2.0:1783965115.940991:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715108096 00000100:00100000:2.0:1783965115.941074:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 203 00000100:00100000:2.0:1783965115.941085:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9474057d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9923189b-eb4a-470c-ab45-969435371000+51:11552:x1870622715108096:12345-192.168.204.12@tcp:101:lfs.0 00010000:00010000:2.0:1783965115.941113:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783965115.941136:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e800/0xe782b916994fe22f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5f026c expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965115.941245:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e800/0xe782b916994fe22f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f026c expref: 52 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965115.941261:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e800/0xe782b916994fe22f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f026c expref: 52 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965115.941280:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff947402a2d300) 00010000:00010000:2.0:1783965115.941283:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783965115.941286:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94743fb8e800, rc 0) 00000100:00100000:2.0:1783965115.941347:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9474057d9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9923189b-eb4a-470c-ab45-969435371000+52:11552:x1870622715108096:12345-192.168.204.12@tcp:101:lfs.0 Request processed in 264us (872us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965115.941354:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 203 00000100:00100000:0.0:1783965115.953848:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965115.953978:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715108352 00000100:00100000:2.0:1783965115.953993:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715108352 00000100:00100000:2.0:1783965115.954076:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 57 00000100:00100000:2.0:1783965115.954089:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743d9ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9923189b-eb4a-470c-ab45-969435371000+52:11552:x1870622715108352:12345-192.168.204.12@tcp:35:lfs.0 00000100:00100000:2.0:1783965115.954508:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743d9ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9923189b-eb4a-470c-ab45-969435371000+53:11552:x1870622715108352:12345-192.168.204.12@tcp:35:lfs.0 Request processed in 419us (673us total) trans 4294967495 rc 0/0 00000100:00100000:2.0:1783965115.954517:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 57 00010000:00010000:0.0:1783965116.079271:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783965116.087460:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965116.087558:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715108480 00000100:00100000:3.0:1783965116.087572:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715108480 00000100:00100000:3.0:1783965116.087654:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 204 00000100:00100000:3.0:1783965116.087667:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9474057d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9923189b-eb4a-470c-ab45-969435371000+53:11562:x1870622715108480:12345-192.168.204.12@tcp:34:lfs.0 00010000:00010000:3.0:1783965116.087777:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fe236 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965116.087889:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fe236 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965116.087904:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fe236 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965116.087925:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27800/0xe782b916994fe23d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965116.087932:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27800/0xe782b916994fe23d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965116.087938:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27800/0xe782b916994fe23d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965116.088078:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27a00/0xe782b916994fe244 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965116.088087:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27a00/0xe782b916994fe244 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965116.088095:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27a00/0xe782b916994fe244 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783965116.088152:0:5811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27a00/0xe782b916994fe244 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965116.088167:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fe236 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965116.088175:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fe236 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965116.088196:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fe236 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965116.088229:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947436f26200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1783965116.088235:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fe236 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965116.088244:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fe236 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965116.088260:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94740a90c500) 00010000:00010000:3.0:1783965116.088264:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783965116.088270:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fe236 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965116.088276:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fe236 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965116.088293:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27800/0xe782b916994fe23d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965116.088299:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27800/0xe782b916994fe23d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965116.088306:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27800/0xe782b916994fe23d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965116.088312:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947436f27800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1783965116.088315:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27800/0xe782b916994fe23d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965116.088331:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27800/0xe782b916994fe23d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965116.088340:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff94740b97ad00) 00010000:00010000:3.0:1783965116.088342:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783965116.088345:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27800/0xe782b916994fe23d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965116.088351:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27800/0xe782b916994fe23d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965116.088368:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27a00/0xe782b916994fe244 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965116.088374:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27a00/0xe782b916994fe244 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965116.088380:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27a00/0xe782b916994fe244 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965116.088386:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947436f27a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1783965116.088389:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27a00/0xe782b916994fe244 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965116.088395:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27a00/0xe782b916994fe244 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965116.088402:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff947402a2d300) 00010000:00010000:3.0:1783965116.088405:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783965116.088408:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27a00/0xe782b916994fe244 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965116.088424:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27a00/0xe782b916994fe244 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783965116.088523:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9474057d8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9923189b-eb4a-470c-ab45-969435371000+53:11562:x1870622715108480:12345-192.168.204.12@tcp:34:lfs.0 Request processed in 856us (1076us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965116.088532:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 204 00000100:00100000:0.0:1783965116.143349:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965116.143450:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715108736 00000100:00100000:2.0:1783965116.143475:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715108736 00000100:00100000:2.0:1783965116.143572:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 205 00000100:00100000:2.0:1783965116.143585:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743d9cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9923189b-eb4a-470c-ab45-969435371000+53:11565:x1870622715108736:12345-192.168.204.12@tcp:101:lfs.0 00010000:00010000:2.0:1783965116.143617:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783965116.143660:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f600/0xe782b916994fe24b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5f0273 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965116.143785:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8ec00/0xe782b916994fe252 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965116.143805:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8ec00/0xe782b916994fe252 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965116.143965:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8ec00/0xe782b916994fe252 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965116.143986:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e400/0xe782b916994fe259 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965116.143994:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e400/0xe782b916994fe259 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965116.144002:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e400/0xe782b916994fe259 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965116.144179:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fe00/0xe782b916994fe260 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965116.144188:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fe00/0xe782b916994fe260 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965116.144195:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fe00/0xe782b916994fe260 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783965116.144258:0:5813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1783965116.144394:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8ec00/0xe782b916994fe252 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965116.144403:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8ec00/0xe782b916994fe252 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965116.144418:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8ec00/0xe782b916994fe252 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965116.144425:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743fb8ec00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1783965116.144430:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8ec00/0xe782b916994fe252 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965116.144438:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8ec00/0xe782b916994fe252 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965116.144452:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94740a90c500) 00010000:00010000:2.0:1783965116.144456:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783965116.144460:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8ec00/0xe782b916994fe252 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965116.144467:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8ec00/0xe782b916994fe252 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965116.144494:0:5813:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e400/0xe782b916994fe259 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965116.144500:0:5813:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e400/0xe782b916994fe259 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965116.144506:0:5813:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e400/0xe782b916994fe259 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965116.144511:0:5813:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743fb8e400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1783965116.144515:0:5813:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e400/0xe782b916994fe259 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965116.144534:0:5813:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e400/0xe782b916994fe259 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965116.144543:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff947402a2d900) 00010000:00010000:2.0:1783965116.144546:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783965116.144549:0:5813:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e400/0xe782b916994fe259 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965116.144555:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e400/0xe782b916994fe259 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965116.144605:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f600/0xe782b916994fe24b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0273 expref: 56 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965116.144622:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fe00/0xe782b916994fe260 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0273 expref: 55 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965116.144631:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff947402a2d300) 00010000:00010000:2.0:1783965116.144633:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783965116.144635:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94743fb8fe00, rc 0) 00000100:00100000:2.0:1783965116.144731:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743d9cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9923189b-eb4a-470c-ab45-969435371000+55:11565:x1870622715108736:12345-192.168.204.12@tcp:101:lfs.0 Request processed in 1148us (1397us total) trans 4294967496 rc 0/0 00000100:00100000:2.0:1783965116.144741:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 205 00000100:00100000:0.0:1783965116.149177:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965116.149563:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715108864 00000100:00100000:2.0:1783965116.149577:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715108864 00000100:00100000:2.0:1783965116.149664:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 206 00000100:00100000:2.0:1783965116.149676:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743d9cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9923189b-eb4a-470c-ab45-969435371000+55:11565:x1870622715108864:12345-192.168.204.12@tcp:54:lfs.0 00010000:00010000:2.0:1783965116.149796:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fa00/0xe782b916994fe26e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965116.149830:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fa00/0xe782b916994fe26e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965116.149846:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fa00/0xe782b916994fe26e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965116.149883:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fa00/0xe782b916994fe26e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965116.149890:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fa00/0xe782b916994fe26e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965116.149907:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fa00/0xe782b916994fe26e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965116.149914:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743fb8fa00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1783965116.149919:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fa00/0xe782b916994fe26e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965116.149927:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fa00/0xe782b916994fe26e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965116.149941:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff947402a2d300) 00010000:00010000:2.0:1783965116.149944:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783965116.149949:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fa00/0xe782b916994fe26e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965116.149956:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fa00/0xe782b916994fe26e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783965116.150076:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743d9cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9923189b-eb4a-470c-ab45-969435371000+55:11565:x1870622715108864:12345-192.168.204.12@tcp:54:lfs.0 Request processed in 402us (917us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965116.150085:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 206 00000100:00100000:0.0:1783965116.155067:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965116.156583:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715109120 00000100:00100000:2.0:1783965116.156603:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715109120 00000100:00100000:2.0:1783965116.156763:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 58 00000100:00100000:2.0:1783965116.156776:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743d9cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9923189b-eb4a-470c-ab45-969435371000+55:11565:x1870622715109120:12345-192.168.204.12@tcp:35:lfs.0 00000100:00100000:2.0:1783965116.157115:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743d9cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9923189b-eb4a-470c-ab45-969435371000+56:11565:x1870622715109120:12345-192.168.204.12@tcp:35:lfs.0 Request processed in 340us (2072us total) trans 4294967497 rc 0/0 00000100:00100000:2.0:1783965116.157125:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 58 00000100:00100000:0.0:1783965116.270485:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965116.270635:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715109376 00000100:00100000:3.0:1783965116.270649:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715109376 00000100:00100000:3.0:1783965116.270733:0:6632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 207 00000100:00100000:3.0:1783965116.270744:0:6632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743d9cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9923189b-eb4a-470c-ab45-969435371000+56:11575:x1870622715109376:12345-192.168.204.12@tcp:101:bash.0 00010000:00010000:3.0:1783965116.270777:0:6632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783965116.270780:0:6632:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1783965116.270817:0:6632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fe1f0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0257 expref: 56 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965116.270853:0:6632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94740a90c500) 00010000:00010000:3.0:1783965116.270860:0:6632:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783965116.270900:0:6632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27a00/0xe782b916994fe275 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5f027a expref: -99 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965116.271029:0:6632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27800/0xe782b916994fe27c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965116.271045:0:6632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27800/0xe782b916994fe27c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965116.271057:0:6632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27800/0xe782b916994fe27c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783965116.271095:0:6632:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1783965116.271779:0:6632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27a00/0xe782b916994fe275 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f027a expref: 58 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965116.271800:0:6632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27800/0xe782b916994fe27c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f027a expref: 57 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965116.271809:0:6632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff947402a2d300) 00010000:00010000:3.0:1783965116.271811:0:6632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783965116.271815:0:6632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff947436f27800, rc 0) 00000100:00100000:3.0:1783965116.272462:0:6632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743d9cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9923189b-eb4a-470c-ab45-969435371000+57:11575:x1870622715109376:12345-192.168.204.12@tcp:101:bash.0 Request processed in 1707us (1997us total) trans 4294967498 rc 0/0 00000100:00100000:3.0:1783965116.272484:0:6632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 207 00000100:00100000:0.0:1783965116.284593:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965116.289388:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715109632 00000100:00100000:2.0:1783965116.289409:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715109632 00000100:00100000:2.0:1783965116.289773:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 208 00000100:00100000:2.0:1783965116.289787:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743d9cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9923189b-eb4a-470c-ab45-969435371000+57:11575:x1870622715109632:12345-192.168.204.12@tcp:36:bash.0 00010000:00010000:2.0:1783965116.289886:0:5812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:2.0:1783965116.289936:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27800/0xe782b916994fe27c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f027a expref: 57 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965116.289965:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fe00/0xe782b916994fe260 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0273 expref: 56 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965116.289978:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff947402a2d300) 00010000:00010000:2.0:1783965116.289984:0:5812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783965116.290364:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fa00/0xe782b916994fe28a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965116.290404:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fa00/0xe782b916994fe28a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965116.290417:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fa00/0xe782b916994fe28a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783965116.290502:0:5812:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:2.0:1783965116.290541:0:5812:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000438015d reply state 00000000bb8f0107 transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fa00/0xe782b916994fe28a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783965116.290557:0:5812:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783965116.290680:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743d9cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9923189b-eb4a-470c-ab45-969435371000+58:11575:x1870622715109632:12345-192.168.204.12@tcp:36:bash.0 Request processed in 894us (6101us total) trans 4294967500 rc 0/0 00000100:00100000:2.0:1783965116.290689:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 208 00000020:00080000:2.0:1783965116.290695:0:5812:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1783965116.295139:0:3309:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fa00/0xe782b916994fe28a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965116.295171:0:3309:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fa00/0xe782b916994fe28a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965116.295181:0:3309:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fa00/0xe782b916994fe28a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965116.295188:0:3309:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743fb8fa00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1783965116.295194:0:3309:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fa00/0xe782b916994fe28a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965116.295253:0:3309:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fa00/0xe782b916994fe28a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965116.295307:0:3309:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff947402a2d300) 00010000:00010000:2.0:1783965116.295311:0:3309:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783965116.295319:0:3309:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fa00/0xe782b916994fe28a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965116.295327:0:3309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fa00/0xe782b916994fe28a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783965116.295811:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965116.295968:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715109760 00000100:00100000:2.0:1783965116.295984:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715109760 00000100:00100000:2.0:1783965116.296120:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 209 00000100:00100000:2.0:1783965116.296135:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743d9cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9923189b-eb4a-470c-ab45-969435371000+57:11575:x1870622715109760:12345-192.168.204.12@tcp:101:bash.0 00010000:00010000:2.0:1783965116.296251:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783965116.296276:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f600/0xe782b916994fe291 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5f0281 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965116.296390:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e400/0xe782b916994fe298 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965116.296408:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e400/0xe782b916994fe298 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965116.296420:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e400/0xe782b916994fe298 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783965116.296462:0:5813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1783965116.296466:0:5813:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1783965116.296508:0:5813:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e400/0xe782b916994fe298 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965116.297120:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f600/0xe782b916994fe291 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0281 expref: 59 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965116.297143:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e400/0xe782b916994fe298 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0281 expref: 58 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965116.297152:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff947402a2d300) 00010000:00010000:2.0:1783965116.297155:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783965116.297159:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94743fb8e400, rc 0) 00000100:00100000:2.0:1783965116.298048:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743d9cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9923189b-eb4a-470c-ab45-969435371000+58:11575:x1870622715109760:12345-192.168.204.12@tcp:101:bash.0 Request processed in 1910us (2240us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965116.298061:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 209 00000100:00100000:3.0:1783965116.304318:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965116.304431:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715110016 00000100:00100000:1.0:1783965116.304449:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715110016 00000100:00100000:1.0:1783965116.304608:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 59 00000100:00100000:1.0:1783965116.304621:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743648ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9923189b-eb4a-470c-ab45-969435371000+58:11575:x1870622715110016:12345-192.168.204.12@tcp:35:bash.0 00000100:00100000:1.0:1783965116.304960:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743648ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9923189b-eb4a-470c-ab45-969435371000+59:11575:x1870622715110016:12345-192.168.204.12@tcp:35:bash.0 Request processed in 341us (651us total) trans 4294967501 rc 0/0 00000100:00100000:1.0:1783965116.304988:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 59 00000100:00100000:0.0:1783965116.388512:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965116.388679:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715110144 00000100:00100000:3.0:1783965116.388694:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715110144 00000100:00100000:3.0:1783965116.388781:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 210 00000100:00100000:3.0:1783965116.388794:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743d9cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9923189b-eb4a-470c-ab45-969435371000+59:11581:x1870622715110144:12345-192.168.204.12@tcp:101:lfs.0 00010000:00010000:3.0:1783965116.388839:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783965116.388870:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27a00/0xe782b916994fe29f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5f0288 expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965116.388978:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fe2a6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965116.389008:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fe2a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965116.389042:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fe2a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783965116.389376:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:3.0:1783965116.389383:0:5811:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1783965116.389418:0:5811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fe2a6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965116.389465:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27a00/0xe782b916994fe29f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0288 expref: 61 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965116.389498:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fe2a6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0288 expref: 60 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965116.389508:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94740a90c500) 00010000:00010000:3.0:1783965116.389512:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783965116.389516:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff947436f26e00, rc 0) 00000100:00100000:3.0:1783965116.389611:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743d9cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9923189b-eb4a-470c-ab45-969435371000+60:11581:x1870622715110144:12345-192.168.204.12@tcp:101:lfs.0 Request processed in 819us (1114us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965116.389620:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 210 00000100:00100000:0.0:1783965116.395547:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965116.396004:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715110272 00000100:00100000:3.0:1783965116.396021:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715110272 00000100:00100000:3.0:1783965116.396114:0:6632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 211 00000100:00100000:3.0:1783965116.396127:0:6632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743d9cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9923189b-eb4a-470c-ab45-969435371000+60:11581:x1870622715110272:12345-192.168.204.12@tcp:101:lfs.0 00010000:00010000:3.0:1783965116.396156:0:6632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783965116.396186:0:6632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27a00/0xe782b916994fe2ad lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5f028f expref: -99 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965116.396328:0:6632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fe2b4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965116.396346:0:6632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fe2b4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965116.396361:0:6632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fe2b4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965116.396378:0:6632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27000/0xe782b916994fe2bb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965116.396386:0:6632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27000/0xe782b916994fe2bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965116.396394:0:6632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27000/0xe782b916994fe2bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965116.396570:0:6632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27600/0xe782b916994fe2c2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965116.396580:0:6632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27600/0xe782b916994fe2c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965116.396589:0:6632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27600/0xe782b916994fe2c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783965116.396639:0:6632:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1783965116.396644:0:6632:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1783965116.396667:0:6632:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27600/0xe782b916994fe2c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965116.396694:0:6632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27600/0xe782b916994fe2c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965116.396705:0:6632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fe2b4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965116.396713:0:6632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fe2b4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965116.396722:0:6632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fe2b4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965116.396730:0:6632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947436f26200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1783965116.396735:0:6632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fe2b4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965116.396744:0:6632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fe2b4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965116.396759:0:6632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94740a90c500) 00010000:00010000:3.0:1783965116.396762:0:6632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783965116.396767:0:6632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fe2b4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965116.396773:0:6632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fe2b4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965116.396788:0:6632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27000/0xe782b916994fe2bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965116.396794:0:6632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27000/0xe782b916994fe2bb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965116.396810:0:6632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27000/0xe782b916994fe2bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965116.396816:0:6632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947436f27000 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1783965116.396819:0:6632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27000/0xe782b916994fe2bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965116.396826:0:6632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27000/0xe782b916994fe2bb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965116.396846:0:6632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff94740b97ad00) 00010000:00010000:3.0:1783965116.396848:0:6632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783965116.396851:0:6632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27000/0xe782b916994fe2bb lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965116.396857:0:6632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27000/0xe782b916994fe2bb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965116.396905:0:6632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27a00/0xe782b916994fe2ad lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f028f expref: 62 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965116.396921:0:6632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27600/0xe782b916994fe2c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f028f expref: 61 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965116.396929:0:6632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff947402a2d300) 00010000:00010000:3.0:1783965116.396931:0:6632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1783965116.396934:0:6632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff947436f27600, rc 0) 00000100:00100000:3.0:1783965116.397017:0:6632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743d9cdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9923189b-eb4a-470c-ab45-969435371000+61:11581:x1870622715110272:12345-192.168.204.12@tcp:101:lfs.0 Request processed in 892us (1486us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965116.397034:0:6632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 211 00000100:00100000:1.0:1783965116.406840:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965116.406907:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965116.407013:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715110656 00000100:00100000:2.0:1783965116.407030:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715110656 00000100:00100000:3.0:1783965116.407131:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715110400 00000100:00100000:2.0:1783965116.407132:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 212 00000100:00100000:3.0:1783965116.407144:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715110400 00000100:00100000:2.0:1783965116.407152:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436c3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9923189b-eb4a-470c-ab45-969435371000+61:11581:x1870622715110656:12345-192.168.204.12@tcp:101:lfs.0 00010000:00010000:2.0:1783965116.407181:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00100000:3.0:1783965116.407267:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 15 00010000:00010000:2.0:1783965116.407276:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f600/0xe782b916994fe2c9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5f0296 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783965116.407283:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e57d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9923189b-eb4a-470c-ab45-969435371000+62:2358:x1870622715110400:12345-192.168.204.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783965116.407314:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783965116.407342:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27600/0xe782b916994fe2c2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f028f expref: 63 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965116.407363:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff947402a2d300) 00010000:00010000:3.0:1783965116.407368:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783965116.407421:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e57d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9923189b-eb4a-470c-ab45-969435371000+62:2358:x1870622715110400:12345-192.168.204.12@tcp:103:ldlm_bl.0 Request processed in 145us (593us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965116.407429:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 15 00010000:00010000:2.0:1783965116.407438:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fa00/0xe782b916994fe2d0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965116.407459:0:5812:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e400/0xe782b916994fe298 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0281 expref: 61 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965116.407469:0:5812:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fa00/0xe782b916994fe2d0 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965116.407540:0:5812:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e400/0xe782b916994fe298 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0281 expref: 61 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965116.407556:0:5812:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e400/0xe782b916994fe298 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0281 expref: 61 pid: 5813 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783965116.407574:0:5812:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947307dc6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5812:1870622732920448:192.168.204.12@tcp:104: 00000100:00100000:2.0:1783965116.407694:0:5812:0:(client.c:2702:ptlrpc_set_wait()) set ffff947425815a80 going to sleep for 11 seconds 00000100:00100000:2.0:1783965116.412547:0:5812:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947307dc6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5812:1870622732920448:192.168.204.12@tcp:104: 00010000:00010000:2.0:1783965116.412588:0:5812:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fa00/0xe782b916994fe2d0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783965116.413364:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783965116.413896:0:8330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715110784 00000100:00100000:0.0:1783965116.413906:0:8330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715110784 00010000:00010000:0.0:1783965116.413946:0:8330:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e400/0xe782b916994fe298 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0281 expref: 62 pid: 5813 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783965116.413999:0:8330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 79 00000100:00100000:0.0:1783965116.414010:0:8330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947437073480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9923189b-eb4a-470c-ab45-969435371000+62:2359:x1870622715110784:12345-192.168.204.12@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783965116.414037:0:8330:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783965116.414045:0:8330:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e400/0xe782b916994fe298 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0281 expref: 62 pid: 5813 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965116.414059:0:8330:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e400/0xe782b916994fe298 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0281 expref: 62 pid: 5813 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965116.414082:0:8330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e400/0xe782b916994fe298 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0281 expref: 62 pid: 5813 timeout: 450 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965116.414117:0:8330:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff947402a2d300) 00010000:00010000:0.0:1783965116.414122:0:8330:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fa00/0xe782b916994fe2d0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965116.414132:0:8330:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fa00/0xe782b916994fe2d0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965116.414139:0:8330:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fa00/0xe782b916994fe2d0 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965116.414179:0:8330:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783965116.414281:0:8330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947437073480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9923189b-eb4a-470c-ab45-969435371000+61:2359:x1870622715110784:12345-192.168.204.12@tcp:103:ldlm_bl.0 Request processed in 273us (920us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965116.414290:0:8330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 79 00010000:00010000:3.0:1783965116.414441:0:5812:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fa00/0xe782b916994fe2d0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965116.414450:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fa00/0xe782b916994fe2d0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783965116.414469:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1783965116.414685:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f600/0xe782b916994fe2c9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0296 expref: 62 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965116.414702:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fa00/0xe782b916994fe2d0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0296 expref: 61 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965116.414721:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff947402a2d300) 00010000:00010000:3.0:1783965116.414724:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1783965116.414727:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94743fb8fa00, rc 0) 00000100:00100000:3.0:1783965116.414765:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436c3ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9923189b-eb4a-470c-ab45-969435371000+61:11581:x1870622715110656:12345-192.168.204.12@tcp:101:lfs.0 Request processed in 7619us (7857us total) trans 4294967502 rc 0/0 00000100:00100000:3.0:1783965116.414772:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 212 00000100:00100000:1.0:1783965116.426559:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965116.426647:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715111040 00000100:00100000:3.0:1783965116.426658:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715111040 00000100:00100000:3.0:1783965116.426727:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 16 00000100:00100000:3.0:1783965116.426739:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947437071500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9923189b-eb4a-470c-ab45-969435371000+61:11581:x1870622715111040:12345-192.168.204.12@tcp:103:lfs.0 00010000:00010000:3.0:1783965116.426754:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783965116.426781:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e800/0xe782b916994fe22f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f026c expref: 61 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965116.426802:0:5799:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff947402a2d300) 00010000:00010000:3.0:1783965116.426807:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783965116.426880:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947437071500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9923189b-eb4a-470c-ab45-969435371000+60:11581:x1870622715111040:12345-192.168.204.12@tcp:103:lfs.0 Request processed in 143us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965116.426888:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 16 00000100:00100000:0.0:1783965116.431096:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965116.431189:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715111168 00000100:00100000:3.0:1783965116.431240:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715111168 00000100:00100000:3.0:1783965116.431302:0:6632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 213 00000100:00100000:3.0:1783965116.431312:0:6632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743d9ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9923189b-eb4a-470c-ab45-969435371000+60:11581:x1870622715111168:12345-192.168.204.12@tcp:58:lfs.0 00010000:00010000:3.0:1783965116.431438:0:6632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27600/0xe782b916994fe2de lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965116.431467:0:6632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27600/0xe782b916994fe2de lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965116.431490:0:6632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27600/0xe782b916994fe2de lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783965116.431665:0:6632:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:3.0:1783965116.431750:0:6632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743d9ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9923189b-eb4a-470c-ab45-969435371000+60:11581:x1870622715111168:12345-192.168.204.12@tcp:58:lfs.0 Request processed in 439us (665us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965116.431759:0:6632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 213 00000100:00100000:1.0:1783965116.434167:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965116.437086:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715111296 00000100:00100000:3.0:1783965116.437104:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715111296 00000100:00100000:3.0:1783965116.437192:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 214 00000100:00100000:3.0:1783965116.437222:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947437070700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9923189b-eb4a-470c-ab45-969435371000+60:11581:x1870622715111296:12345-192.168.204.12@tcp:101:lfs.0 00010000:00010000:3.0:1783965116.437245:0:5811:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783965116.437270:0:5811:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27a00/0xe782b916994fe2e5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5f029d expref: -99 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965116.437335:0:5811:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27600/0xe782b916994fe2de lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965116.437348:0:5811:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27a00/0xe782b916994fe2e5 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f029d expref: 61 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965116.437368:0:5811:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27600/0xe782b916994fe2de lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965116.437382:0:5811:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27a00/0xe782b916994fe2e5 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f029d expref: 61 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965116.437412:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff947402a2d300) 00010000:00010000:3.0:1783965116.437415:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783965116.437419:0:5811:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27a00/0xe782b916994fe2e5 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f029d expref: 61 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965116.437427:0:5811:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff947436f27a00, rc 0) 00000100:00100000:3.0:1783965116.437501:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947437070700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9923189b-eb4a-470c-ab45-969435371000+61:11581:x1870622715111296:12345-192.168.204.12@tcp:101:lfs.0 Request processed in 298us (3339us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965116.437508:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 214 00000001:00080000:2.0:1783965116.496560:0:6637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000001:00080000:2.0:1783965116.496577:0:6637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000001:00080000:2.0:1783965116.496698:0:6637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000040:00080000:1.0:1783965116.780019:0:11561:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1783965116.780028:0:11561:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1783965116.780068:0:11561:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:1.0:1783965116.780074:0:11561:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1783965116.780221:0:11561:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947407294a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11561:1870622732920576:192.168.204.12@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1783965116.782215:0:11561:0:(client.c:2702:ptlrpc_set_wait()) set ffff94743e29f480 going to sleep for 11 seconds 00000100:00100000:3.0:1783965116.786509:0:11561:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947407294a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11561:1870622732920576:192.168.204.12@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1783965116.787598:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965116.787679:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715111424 00000100:00100000:3.0:1783965116.787688:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715111424 00000100:00100000:3.0:1783965116.787748:0:6632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 215 00000100:00100000:3.0:1783965116.787758:0:6632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743d9cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9923189b-eb4a-470c-ab45-969435371000+61:11582:x1870622715111424:12345-192.168.204.12@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1783965116.787794:0:6632:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1783965116.787899:0:6632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743d9cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9923189b-eb4a-470c-ab45-969435371000+61:11582:x1870622715111424:12345-192.168.204.12@tcp:53:lhsmtool_posix.0 Request processed in 141us (304us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965116.787908:0:6632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 215 00000100:00100000:1.0:1783965116.797283:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965116.797408:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715111552 00000100:00100000:3.0:1783965116.797420:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715111552 00000100:00100000:3.0:1783965116.797483:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 216 00000100:00100000:3.0:1783965116.797493:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947407297100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9923189b-eb4a-470c-ab45-969435371000+61:11582:x1870622715111552:12345-192.168.204.12@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1783965116.797568:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27000/0xe782b916994fe2ec lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965116.797603:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27000/0xe782b916994fe2ec lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965116.797617:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27000/0xe782b916994fe2ec lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965116.797634:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fe2f3 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965116.797641:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fe2f3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965116.797648:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fe2f3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965116.797671:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26400/0xe782b916994fe2fa lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965116.797680:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26400/0xe782b916994fe2fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965116.797686:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26400/0xe782b916994fe2fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783965116.797726:0:5811:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1783965116.797730:0:5811:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1783965116.797746:0:5811:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26400/0xe782b916994fe2fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965116.797758:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27000/0xe782b916994fe2ec lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965116.797778:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27000/0xe782b916994fe2ec lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965116.797784:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27000/0xe782b916994fe2ec lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965116.797789:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947436f27000 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1783965116.797793:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27000/0xe782b916994fe2ec lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965116.797800:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27000/0xe782b916994fe2ec lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965116.797812:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9474186e7d00) 00010000:00010000:3.0:1783965116.797815:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783965116.797819:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27000/0xe782b916994fe2ec lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965116.797825:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27000/0xe782b916994fe2ec lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965116.797839:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fe2f3 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965116.797844:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fe2f3 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965116.797850:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fe2f3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965116.797855:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947436f26200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1783965116.797863:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fe2f3 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965116.797870:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fe2f3 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965116.797877:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff94740b97a200) 00010000:00010000:3.0:1783965116.797879:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783965116.798094:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fe2f3 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965116.798102:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fe2f3 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965116.798118:0:5811:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26400/0xe782b916994fe2fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965116.798123:0:5811:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26400/0xe782b916994fe2fa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965116.798129:0:5811:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26400/0xe782b916994fe2fa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965116.798134:0:5811:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947436f26400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1783965116.798138:0:5811:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26400/0xe782b916994fe2fa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965116.798144:0:5811:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26400/0xe782b916994fe2fa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965116.798153:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff947402a2d300) 00010000:00010000:3.0:1783965116.798155:0:5811:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783965116.798164:0:5811:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26400/0xe782b916994fe2fa lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965116.798169:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26400/0xe782b916994fe2fa lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783965116.798569:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947407297100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9923189b-eb4a-470c-ab45-969435371000+61:11582:x1870622715111552:12345-192.168.204.12@tcp:34:lhsmtool_posix.0 Request processed in 1075us (1291us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965116.798578:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 216 00000100:00100000:1.0:1783965116.808648:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965116.808735:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715111808 00000100:00100000:3.0:1783965116.808746:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715111808 00000100:00100000:3.0:1783965116.808808:0:6632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 217 00000100:00100000:3.0:1783965116.808818:0:6632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947407294a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9923189b-eb4a-470c-ab45-969435371000+61:11582:x1870622715111808:12345-192.168.204.12@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783965116.808840:0:6632:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783965116.808862:0:6632:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26400/0xe782b916994fe301 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5f02a4 expref: -99 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965116.808973:0:6632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fe308 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965116.808988:0:6632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fe308 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965116.808999:0:6632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fe308 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783965116.809008:0:6632:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1783965116.809098:0:6632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fe308 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965116.809106:0:6632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fe308 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965116.809125:0:6632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fe308 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965116.809130:0:6632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947436f26200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1783965116.809134:0:6632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fe308 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965116.809141:0:6632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fe308 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965116.809152:0:6632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff947402a2d300) 00010000:00010000:3.0:1783965116.809155:0:6632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1783965116.809159:0:6632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fe308 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965116.809165:0:6632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fe308 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965116.809635:0:6632:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26400/0xe782b916994fe301 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f02a4 expref: 63 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965116.809649:0:6632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9474186e7d00) 00010000:00010000:3.0:1783965116.809651:0:6632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783965116.809656:0:6632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26400/0xe782b916994fe301 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f02a4 expref: 63 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965116.809666:0:6632:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff947436f26400, rc 0) 00000100:00100000:3.0:1783965116.809736:0:6632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947407294a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9923189b-eb4a-470c-ab45-969435371000+62:11582:x1870622715111808:12345-192.168.204.12@tcp:101:lhsmtool_posix.0 Request processed in 919us (1097us total) trans 4294967503 rc 301/301 00000100:00100000:3.0:1783965116.809755:0:6632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 217 00000100:00100000:2.0:1783965116.815173:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965116.815343:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715111936 00000100:00100000:3.0:1783965116.815355:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715111936 00000100:00100000:3.0:1783965116.815411:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 218 00000100:00100000:3.0:1783965116.815421:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947307dc6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9923189b-eb4a-470c-ab45-969435371000+62:11582:x1870622715111936:12345-192.168.204.12@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1783965116.815486:0:5812:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1783965116.815595:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947307dc6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9923189b-eb4a-470c-ab45-969435371000+62:11582:x1870622715111936:12345-192.168.204.12@tcp:53:lhsmtool_posix.0 Request processed in 175us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965116.815602:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 218 00000100:00100000:0.0:1783965116.819280:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965116.819381:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715112192 00000100:00100000:2.0:1783965116.819390:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715112192 00000100:00100000:2.0:1783965116.819449:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 219 00000100:00100000:2.0:1783965116.819460:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743d9cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9923189b-eb4a-470c-ab45-969435371000+62:11582:x1870622715112192:12345-192.168.204.12@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783965116.819491:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783965116.819494:0:5813:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1783965116.819524:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fe2a6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0288 expref: 62 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965116.819543:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94740a90c500) 00010000:00010000:2.0:1783965116.819560:0:5813:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1783965116.819573:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8ec00/0xe782b916994fe316 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5f02ab expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1783965116.819958:0:5813:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6:0x0], index 1: 0 00010000:00010000:2.0:1783965116.820140:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fe00/0xe782b916994fe31d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965116.820154:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fe00/0xe782b916994fe31d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965116.820165:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fe00/0xe782b916994fe31d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965116.820274:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8ec00/0xe782b916994fe316 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f02ab expref: 64 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965116.820290:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fe00/0xe782b916994fe31d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f02ab expref: 63 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965116.820298:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff947402a2dc00) 00010000:00010000:2.0:1783965116.820300:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783965116.820303:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94743fb8fe00, rc 0) 00000100:00100000:2.0:1783965116.820357:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743d9cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9923189b-eb4a-470c-ab45-969435371000+63:11582:x1870622715112192:12345-192.168.204.12@tcp:101:lhsmtool_posix.0 Request processed in 900us (1087us total) trans 4294967504 rc 0/0 00000100:00100000:2.0:1783965116.820364:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 219 00000100:00100000:2.0:1783965116.830565:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965116.830655:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715112448 00000100:00100000:3.0:1783965116.830669:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715112448 00000100:00100000:3.0:1783965116.830730:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 220 00000100:00100000:3.0:1783965116.830740:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947307dc6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9923189b-eb4a-470c-ab45-969435371000+63:11582:x1870622715112448:12345-192.168.204.12@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1783965116.830796:0:5812:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783965116.830830:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fe00/0xe782b916994fe31d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f02ab expref: 63 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965116.830848:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff947402a2dc00) 00010000:00010000:3.0:1783965116.830858:0:5812:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783965116.830879:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26400/0xe782b916994fe32b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965116.830892:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26400/0xe782b916994fe32b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965116.830907:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26400/0xe782b916994fe32b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965116.830983:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fe332 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x95ec421d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965116.830992:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fe332 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x95ec421d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965116.830999:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fe332 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x95ec421d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965116.831070:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26400/0xe782b916994fe32b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965116.831077:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26400/0xe782b916994fe32b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965116.831083:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26400/0xe782b916994fe32b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965116.831089:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947436f26400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1783965116.831094:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26400/0xe782b916994fe32b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965116.831101:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26400/0xe782b916994fe32b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965116.831110:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94740a90c500) 00010000:00010000:3.0:1783965116.831114:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783965116.831117:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26400/0xe782b916994fe32b lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965116.831122:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26400/0xe782b916994fe32b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965116.831138:0:5812:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fe332 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x95ec421d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965116.831144:0:5812:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fe332 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x95ec421d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965116.831151:0:5812:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fe332 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x95ec421d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965116.831157:0:5812:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947436f26200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1783965116.831160:0:5812:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fe332 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x95ec421d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965116.831166:0:5812:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fe332 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x95ec421d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965116.831175:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x95ec421d (ffff94740b97a200) 00010000:00010000:3.0:1783965116.831177:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783965116.831180:0:5812:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fe332 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x95ec421d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965116.831185:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fe332 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x95ec421d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783965116.831311:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947307dc6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9923189b-eb4a-470c-ab45-969435371000+62:11582:x1870622715112448:12345-192.168.204.12@tcp:36:lhsmtool_posix.0 Request processed in 571us (755us total) trans 0 rc -2/-2 00000100:00100000:3.0:1783965116.831319:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 220 00000100:00100000:0.0:1783965116.834896:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965116.834984:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715112576 00000100:00100000:2.0:1783965116.834994:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715112576 00000100:00100000:2.0:1783965116.835069:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 221 00000100:00100000:2.0:1783965116.835080:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743d9cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9923189b-eb4a-470c-ab45-969435371000+62:11582:x1870622715112576:12345-192.168.204.12@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783965116.835099:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783965116.835123:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8ec00/0xe782b916994fe339 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5f02b2 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965116.835163:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e800/0xe782b916994fe340 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965116.835177:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e800/0xe782b916994fe340 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965116.835189:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e800/0xe782b916994fe340 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965116.835325:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8ec00/0xe782b916994fe339 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f02b2 expref: 64 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965116.835342:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e800/0xe782b916994fe340 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f02b2 expref: 63 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965116.835350:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff947402a2d900) 00010000:00010000:2.0:1783965116.835353:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1783965116.835356:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94743fb8e800, rc 0) 00000100:00100000:2.0:1783965116.835646:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743d9cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9923189b-eb4a-470c-ab45-969435371000+63:11582:x1870622715112576:12345-192.168.204.12@tcp:101:lhsmtool_posix.0 Request processed in 565us (765us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965116.835654:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 221 00000100:00100000:0.0:1783965116.848748:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965116.848843:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715112832 00000100:00100000:3.0:1783965116.848854:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715112832 00000100:00100000:3.0:1783965116.849033:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 222 00000100:00100000:3.0:1783965116.849061:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743fb9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9923189b-eb4a-470c-ab45-969435371000+63:11582:x1870622715112832:12345-192.168.204.12@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1783965116.849158:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fe347 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965116.849177:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fe347 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965116.849189:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fe347 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1783965116.849485:0:5812:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00080000:3.0:1783965116.849495:0:5812:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 351078292978ns, next at 352078290483ns, rc = 0 00000004:00010000:3.0:1783965116.849590:0:5812:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000b123bc31 reply state 00000000223af54b transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fe347 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783965116.849600:0:5812:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1783965116.849690:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743fb9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9923189b-eb4a-470c-ab45-969435371000+65:11582:x1870622715112832:12345-192.168.204.12@tcp:36:lhsmtool_posix.0 Request processed in 639us (953us total) trans 4294967505 rc 0/0 00000100:00100000:3.0:1783965116.849697:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 222 00000100:00100000:0.0:1783965116.856345:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965116.856500:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715112960 00000100:00100000:2.0:1783965116.856511:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715112960 00000100:00100000:2.0:1783965116.856588:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 223 00000100:00100000:2.0:1783965116.856597:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743fb99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9923189b-eb4a-470c-ab45-969435371000+65:11582:x1870622715112960:12345-192.168.204.12@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783965116.856622:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783965116.856642:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8ec00/0xe782b916994fe34e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5f02b9 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965116.856702:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8ec00/0xe782b916994fe34e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f02b9 expref: 66 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965116.856719:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8ec00/0xe782b916994fe34e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f02b9 expref: 66 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965116.856737:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff947402a2d900) 00010000:00010000:2.0:1783965116.856740:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783965116.856744:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94743fb8ec00, rc 0) 00000100:00100000:2.0:1783965116.856812:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743fb99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9923189b-eb4a-470c-ab45-969435371000+66:11582:x1870622715112960:12345-192.168.204.12@tcp:101:lhsmtool_posix.0 Request processed in 214us (474us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965116.856819:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 223 00010000:00010000:3.0:1783965116.858442:0:3308:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fe347 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965116.858457:0:3308:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fe347 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965116.858463:0:3308:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fe347 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965116.858478:0:3308:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947436f26200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1783965116.858483:0:3308:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fe347 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965116.858503:0:3308:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fe347 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965116.858520:0:3308:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff947402a2d900) 00010000:00010000:3.0:1783965116.858523:0:3308:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1783965116.858527:0:3308:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fe347 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965116.858532:0:3308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fe347 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783965116.861387:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965116.861583:0:6609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715113088 00000100:00100000:1.0:1783965116.861592:0:6609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715113088 00000100:00100000:1.0:1783965116.861659:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 63 00000100:00100000:1.0:1783965116.861670:0:6609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743fb99180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9923189b-eb4a-470c-ab45-969435371000+9:2360:x1870622715113088:12345-192.168.204.12@tcp:2:lhsmtool_posix.0 00000100:00080000:2.0:1783965116.861982:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783965116.862172:0:6609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743fb99180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:9923189b-eb4a-470c-ab45-969435371000+10:2360:x1870622715113088:12345-192.168.204.12@tcp:2:lhsmtool_posix.0 Request processed in 502us (793us total) trans 4294967319 rc 0/0 00000100:00100000:1.0:1783965116.862181:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 63 00000100:00100000:1.0:1783965116.867776:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965116.869553:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715113344 00000100:00100000:2.0:1783965116.869566:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715113344 00000100:00100000:2.0:1783965116.869709:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 60 00000100:00100000:2.0:1783965116.869721:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436307b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9923189b-eb4a-470c-ab45-969435371000+65:11582:x1870622715113344:12345-192.168.204.12@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1783965116.870793:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436307b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9923189b-eb4a-470c-ab45-969435371000+66:11582:x1870622715113344:12345-192.168.204.12@tcp:35:lhsmtool_posix.0 Request processed in 1070us (3022us total) trans 4294967506 rc 0/0 00000100:00100000:2.0:1783965116.870804:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 60 00000100:00100000:0.0:1783965116.878641:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965116.881391:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715113600 00000100:00100000:1.0:1783965116.881546:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715113600 00000100:00100000:1.0:1783965116.881633:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 224 00000100:00100000:1.0:1783965116.881645:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743fb9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9923189b-eb4a-470c-ab45-969435371000+66:11582:x1870622715113600:12345-192.168.204.12@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1783965116.883780:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743fb9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9923189b-eb4a-470c-ab45-969435371000+66:11582:x1870622715113600:12345-192.168.204.12@tcp:57:lhsmtool_posix.0 Request processed in 2125us (5138us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965116.883793:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 224 00000100:00100000:0.0:1783965116.887881:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965116.892343:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715113728 00000100:00100000:2.0:1783965116.892360:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715113728 00000100:00100000:2.0:1783965116.892435:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 225 00000100:00100000:2.0:1783965116.892446:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743fb99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9923189b-eb4a-470c-ab45-969435371000+66:11582:x1870622715113728:12345-192.168.204.12@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783965116.892479:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783965116.892503:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f600/0xe782b916994fe355 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5f02c0 expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965116.892599:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e400/0xe782b916994fe35c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965116.892614:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e400/0xe782b916994fe35c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965116.892627:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e400/0xe782b916994fe35c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783965116.892663:0:5813:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1783965116.892687:0:5813:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e400/0xe782b916994fe35c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965116.892713:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f600/0xe782b916994fe355 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f02c0 expref: 68 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965116.892732:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e400/0xe782b916994fe35c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f02c0 expref: 67 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965116.892741:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff947402a2d900) 00010000:00010000:2.0:1783965116.892744:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1783965116.892747:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94743fb8e400, rc 0) 00000100:00100000:2.0:1783965116.892870:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743fb99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9923189b-eb4a-470c-ab45-969435371000+67:11582:x1870622715113728:12345-192.168.204.12@tcp:101:lhsmtool_posix.0 Request processed in 425us (4998us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965116.892878:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 225 00000100:00100000:0.0:1783965116.899722:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965116.899990:0:8738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715113856 00000100:00100000:2.0:1783965116.900000:0:8738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715113856 00000100:00100000:2.0:1783965116.900057:0:8738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 64 00000100:00100000:2.0:1783965116.900068:0:8738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743fb98700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9923189b-eb4a-470c-ab45-969435371000+10:2359:x1870622715113856:12345-192.168.204.12@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783965116.900087:0:8738:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783965116.900120:0:8738:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bd475494/0xe782b916994fe363 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5f02c7 expref: -99 pid: 8738 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783965116.900149:0:8738:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a5525bc, blocks: 0x1 00010000:00010000:2.0:1783965116.900167:0:8738:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=351s v=(0 0) 00010000:00010000:2.0:1783965116.900171:0:8738:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783965116.900181:0:8738:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bd475494/0xe782b916994fe363 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f02c7 expref: 11 pid: 8738 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965116.900221:0:8738:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000bd475494/0xe782b916994fe363 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f02c7 expref: 11 pid: 8738 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965116.900236:0:8738:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94743fb8f600, rc 0) 00000100:00100000:2.0:1783965116.900295:0:8738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743fb98700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9923189b-eb4a-470c-ab45-969435371000+11:2359:x1870622715113856:12345-192.168.204.12@tcp:101:lhsmtool_posix.0 Request processed in 229us (591us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965116.900302:0:8738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 64 00000100:00100000:0.0:1783965116.904065:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965116.904256:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715114112 00000100:00100000:3.0:1783965116.904266:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715114112 00000100:00100000:3.0:1783965116.904326:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 226 00000100:00100000:3.0:1783965116.904337:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743fb9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9923189b-eb4a-470c-ab45-969435371000+67:11582:x1870622715114112:12345-192.168.204.12@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1783965116.904437:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743fb9bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9923189b-eb4a-470c-ab45-969435371000+67:11582:x1870622715114112:12345-192.168.204.12@tcp:57:lhsmtool_posix.0 Request processed in 101us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965116.904444:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 226 00000100:00100000:0.0:1783965116.912941:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965116.913041:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715114240 00000100:00100000:2.0:1783965116.913051:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715114240 00000100:00100000:2.0:1783965116.913195:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 65 00000100:00100000:2.0:1783965116.913450:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743fb99c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9923189b-eb4a-470c-ab45-969435371000+11:11582:x1870622715114240:12345-192.168.204.12@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783965116.913477:0:6608:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783965116.913497:0:6608:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f42876e3/0xe782b916994fe36a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5f02ce expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965116.913530:0:6608:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000bd475494/0xe782b916994fe363 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f02c7 expref: 12 pid: 8738 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965116.913540:0:6608:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783965116.913544:0:6608:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783965116.913550:0:6608:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f42876e3/0xe782b916994fe36a lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f02ce expref: 12 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965116.913585:0:6608:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000bd475494/0xe782b916994fe363 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f02c7 expref: 12 pid: 8738 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965116.913599:0:6608:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000bd475494/0xe782b916994fe363 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f02c7 expref: 12 pid: 8738 timeout: 451 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783965116.913614:0:6608:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947307dc7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6608:1870622732920704:192.168.204.12@tcp:104: 00000100:00100000:2.0:1783965116.913750:0:6608:0:(client.c:2702:ptlrpc_set_wait()) set ffff9474258159c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783965116.922717:0:6608:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947307dc7480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6608:1870622732920704:192.168.204.12@tcp:104: 00010000:00010000:2.0:1783965116.922759:0:6608:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f42876e3/0xe782b916994fe36a lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f02ce expref: 12 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965116.922811:0:6608:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94743fb8f000, rc 0) 00000100:00100000:2.0:1783965116.922872:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743fb99c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9923189b-eb4a-470c-ab45-969435371000+12:11582:x1870622715114240:12345-192.168.204.12@tcp:101:lhsmtool_posix.0 Request processed in 9425us (9941us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965116.922881:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 65 00000100:00100000:0.0:1783965116.923668:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965116.925539:0:8330:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715114368 00000100:00100000:1.0:1783965116.925555:0:8330:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715114368 00010000:00010000:1.0:1783965116.925600:0:8330:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000bd475494/0xe782b916994fe363 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f02c7 expref: 12 pid: 8738 timeout: 451 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783965116.925645:0:8330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 80 00000100:00100000:1.0:1783965116.925655:0:8330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947407248050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9923189b-eb4a-470c-ab45-969435371000+12:2359:x1870622715114368:12345-192.168.204.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783965116.925668:0:8330:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783965116.925693:0:8330:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000bd475494/0xe782b916994fe363 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f02c7 expref: 12 pid: 8738 timeout: 451 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965116.925708:0:8330:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000bd475494/0xe782b916994fe363 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f02c7 expref: 12 pid: 8738 timeout: 451 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965116.925731:0:8330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bd475494/0xe782b916994fe363 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f02c7 expref: 12 pid: 8738 timeout: 451 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965116.925748:0:8330:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783965116.925752:0:8330:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783965116.925760:0:8330:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000f42876e3/0xe782b916994fe36a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f02ce expref: 11 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965116.925790:0:8330:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f42876e3/0xe782b916994fe36a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f02ce expref: 11 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965116.925830:0:8330:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000f42876e3/0xe782b916994fe36a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f02ce expref: 11 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783965116.925843:0:8330:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743fb93480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8330:1870622732920832:192.168.204.12@tcp:105: 00000100:00100000:1.0:1783965116.925929:0:8330:0:(client.c:2702:ptlrpc_set_wait()) set ffff94743e29fb40 going to sleep for 11 seconds 00000100:00100000:0.0:1783965116.943488:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965116.943569:0:6613:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715114496 00000100:00100000:2.0:1783965116.943578:0:6613:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715114496 00002000:00100000:2.0:1783965116.943634:0:6613:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff94743fb9ad80 x1870622715114496/t0(0) o4->9923189b-eb4a-470c-ab45-969435371000@192.168.204.12@tcp:542/0 lens 504/0 e 0 to 0 dl 1783965127 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783965116.943646:0:6613:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff94743fb9ad80 with x1870622715114496 ext(0->12) 00002000:00010000:2.0:1783965116.943652:0:6613:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff94743fb9ad80 00000100:00100000:2.0:1783965116.943690:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 6 00000100:00100000:2.0:1783965116.943699:0:6613:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743fb9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9923189b-eb4a-470c-ab45-969435371000+12:2360:x1870622715114496:12345-192.168.204.12@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1783965116.944183:0:6613:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743fb9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:9923189b-eb4a-470c-ab45-969435371000+14:2360:x1870622715114496:12345-192.168.204.12@tcp:4:lhsmtool_posix.0 Request processed in 482us (701us total) trans 4294967320 rc 0/0 00000100:00100000:2.0:1783965116.944191:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 6 00002000:00100000:2.0:1783965116.944198:0:6613:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff94743fb9ad80 x1870622715114496/t4294967320(0) o4->9923189b-eb4a-470c-ab45-969435371000@192.168.204.12@tcp:542/0 lens 504/448 e 0 to 0 dl 1783965127 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1783965116.944231:0:6613:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff94743fb9ad80 with x1870622715114496 ext(0->12) 00002000:00010000:2.0:1783965116.944234:0:6613:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff94743fb9ad80 00000100:00100000:1.0:1783965116.944887:0:8330:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743fb93480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8330:1870622732920832:192.168.204.12@tcp:105: 00010000:00010000:1.0:1783965116.944911:0:8330:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783965116.944958:0:8330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947407248050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:9923189b-eb4a-470c-ab45-969435371000+13:2359:x1870622715114368:12345-192.168.204.12@tcp:103:ldlm_bl.0 Request processed in 19304us (21292us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965116.944967:0:8330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 80 00000100:00100000:0.0:1783965116.952524:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965116.952617:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715114624 00000100:00100000:3.0:1783965116.952626:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715114624 00000100:00100000:3.0:1783965116.952688:0:6632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 227 00000100:00100000:3.0:1783965116.952699:0:6632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743fb98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9923189b-eb4a-470c-ab45-969435371000+67:11582:x1870622715114624:12345-192.168.204.12@tcp:44:lhsmtool_posix.0 00000100:00100000:1.0:1783965116.971729:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743648e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3324:1870622732920960:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783965116.971790:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743fb98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3323:1870622732921344:0@lo:400:kworker.0 00000100:00100000:1.0:1783965116.971806:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783965116.971821:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783965116.971864:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743fb9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3324:1870622732921472:0@lo:400:kworker.0 00000100:00100000:1.0:1783965116.971906:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783965116.971925:0:3324:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1783965116.971931:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743fb98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ae0997f7-3a15-4fc6-865a-35b2f101956e:3324:1870622732921088:0@lo:400:kworker.0 00000100:00100000:1.0:1783965116.971955:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783965116.971977:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743fb98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3324:1870622732921600:0@lo:400:kworker.0 00000100:00100000:1.0:1783965116.972157:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783965116.972170:0:3323:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1783965116.972180:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743fb99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3323:1870622732921216:0@lo:400:kworker.0 00000100:00100000:1.0:1783965116.972198:0:6610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732920960 00000100:00100000:1.0:1783965116.972236:0:6610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732920960 00000100:00100000:0.0:1783965116.972239:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783965116.972254:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743fb9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3323:1870622732921728:0@lo:400:kworker.0 00000100:00100000:1.0:1783965116.972313:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1783965116.972323:0:6610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947429fec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3324:x1870622732920960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783965116.972360:0:6610:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783965116.972423:0:6610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947429fec850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3324:x1870622732920960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (616us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965116.972432:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1783965116.972696:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783965116.972937:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732921344 00000100:00100000:0.0:1783965116.972942:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732921344 00000100:00100000:0.0:1783965116.972966:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732921600 00000100:00100000:0.0:1783965116.972968:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732921600 00000100:00100000:0.0:1783965116.972980:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732921216 00000100:00100000:0.0:1783965116.972982:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732921216 00000100:00100000:0.0:1783965116.972995:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1783965116.973002:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743fb9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3323:x1870622732921344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783965116.973045:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743fb9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3323:x1870622732921344:12345-0@lo:400:kworker.0 Request processed in 44us (1223us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965116.973052:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1783965116.973067:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1783965116.973073:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743fb91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3324:x1870622732921600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783965116.973227:0:5813:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:2.0:1783965116.973238:0:5813:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_004' 00000100:00080000:2.0:1783965116.973256:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783965116.973260:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783965116.973485:0:5811:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 4 min 3 max 116 00000100:00100000:2.0:1783965116.973505:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1783965116.973513:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743fb9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3323:x1870622732921216:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783965116.973615:0:11945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732921472 00000100:00100000:3.0:1783965116.973620:0:11945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732921472 00000100:00100000:3.0:1783965116.973664:0:11945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732921728 00000100:00100000:3.0:1783965116.973667:0:11945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732921728 00000100:00100000:3.0:1783965116.973687:0:11945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1783965116.973694:0:11945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743fb93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3324:x1870622732921472:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783965116.978222:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732921088 00000100:00100000:1.0:1783965116.978239:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732921088 00000100:00100000:2.0:1783965116.978271:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743fb9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3323:x1870622732921216:12345-0@lo:400:kworker.0 Request processed in 4755us (6025us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965116.978283:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1783965116.978301:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:1.0:1783965116.978309:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947408ecb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae0997f7-3a15-4fc6-865a-35b2f101956e+19:3324:x1870622732921088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783965116.978333:0:8738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1783965116.978342:0:8738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743fb9e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3323:x1870622732921728:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783965116.978360:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947408ecb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:ae0997f7-3a15-4fc6-865a-35b2f101956e+19:3324:x1870622732921088:12345-0@lo:400:kworker.0 Request processed in 53us (6404us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965116.978367:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:2.0:1783965116.978386:0:8738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743fb9e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3323:x1870622732921728:12345-0@lo:400:kworker.0 Request processed in 46us (6092us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965116.978392:0:8738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1783965116.978416:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743fb98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ae0997f7-3a15-4fc6-865a-35b2f101956e:3324:1870622732921088:0@lo:400:kworker.0 00000100:00100000:1.0:1783965116.978442:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743648e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3324:1870622732920960:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783965116.978921:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743fb91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3324:x1870622732921600:12345-0@lo:400:kworker.0 Request processed in 5845us (6761us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965116.978930:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1783965116.978969:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743fb99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3323:1870622732921216:0@lo:400:kworker.0 00000100:00100000:0.0:1783965116.978980:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743fb9b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3323:1870622732921728:0@lo:400:kworker.0 00000100:00100000:0.0:1783965116.979004:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743fb98380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3323:1870622732921344:0@lo:400:kworker.0 00000100:00100000:1.0:1783965116.979533:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743fb98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3324:1870622732921600:0@lo:400:kworker.0 00000100:00100000:3.0:1783965116.981041:0:11945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743fb93480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3324:x1870622732921472:12345-0@lo:400:kworker.0 Request processed in 7340us (9126us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965116.981054:0:11945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1783965116.981595:0:3324:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:3.0:1783965116.981602:0:3324:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967309 00000004:00080000:3.0:1783965116.981801:0:3324:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94743648f480, transno 4294967307 00000004:00080000:3.0:1783965116.981813:0:3324:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967309 00000100:00100000:3.0:1783965116.981826:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743fb9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3324:1870622732921472:0@lo:400:kworker.0 00000001:00080000:2.0:1783965117.017661:0:5835:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967468 is committed 00000001:00080000:2.0:1783965117.017684:0:5835:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967501 is committed 00000004:00080000:2.0:1783965117.017691:0:5835:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000004:00080000:2.0:1783965117.017725:0:5835:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000001:00080000:2.0:1783965117.017736:0:5835:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000020:00080000:2.0:1783965117.017769:0:5835:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff947425815300 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:2.0:1783965117.017773:0:5835:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff947436c36d00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff947425815000 00000020:00080000:2.0:1783965117.017776:0:5835:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff947436c36400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff94743e565400 00000004:00080000:2.0:1783965117.017791:0:5835:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 9 committed 00000020:00080000:2.0:1783965117.017807:0:5835:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9474258aa000 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:2.0:1783965117.017809:0:5835:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff947425875f00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9474258aa6c0 00000020:00080000:2.0:1783965117.017812:0:5835:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff947425875200 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff947429f40c00 00000020:00080000:2.0:1783965117.017859:0:5846:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:2.0:1783965117.018055:0:5846:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:1.0:1783965117.018355:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783965117.018377:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743fb90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3322:1870622732921856:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1783965117.018447:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783965117.018515:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732921856 00000100:00100000:1.0:1783965117.018523:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732921856 00000100:00100000:1.0:1783965117.018583:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1783965117.018593:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743fb93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3322:x1870622732921856:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1783965117.018619:0:6608:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00002000:00010000:1.0:1783965117.018670:0:6608:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a5525bb, atime: 0x6a5525bb, ctime: 0x6a5525bb, blocks: 0xb 00010000:00010000:1.0:1783965117.018678:0:6608:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000826c8c7d/0xe782b916994fe371 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965117.018697:0:6608:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=351s v=(0 0) 00010000:00010000:1.0:1783965117.018702:0:6608:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783965117.018710:0:6608:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000826c8c7d/0xe782b916994fe371 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965117.018728:0:6608:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000826c8c7d/0xe782b916994fe371 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965117.018739:0:6608:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000826c8c7d/0xe782b916994fe371 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965117.018748:0:6608:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000826c8c7d/0xe782b916994fe371 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965117.018766:0:6608:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1783965117.019537:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743fb93100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3322:x1870622732921856:12345-0@lo:6:osp-syn-0-0.0 Request processed in 943us (1087us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1783965117.019546:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:1.0:1783965117.019573:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1783965117.019587:0:5800:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783965117.019593:0:5800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000826c8c7d/0xe782b916994fe371 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965117.019603:0:5800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743d9eec00 already unused, calling callback (ffffffffc168d230) 00010000:00010000:1.0:1783965117.019615:0:5800:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000826c8c7d/0xe782b916994fe371 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965117.019625:0:5800:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000826c8c7d/0xe782b916994fe371 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965117.019648:0:5800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000826c8c7d/0xe782b916994fe371 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965117.019656:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000826c8c7d/0xe782b916994fe371 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965117.019684:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783965117.019687:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783965117.019688:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1783965117.019721:0:3322:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff94743fb90e00/2, rc 0, transno 4294967310 00000100:00100000:1.0:1783965117.019729:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743fb90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3322:1870622732921856:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1783965117.021874:0:6632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743fb98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9923189b-eb4a-470c-ab45-969435371000+21:11582:x1870622715114624:12345-192.168.204.12@tcp:44:lhsmtool_posix.0 Request processed in 68179us (68362us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965117.022319:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947307dc7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3324:1870622732921984:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1783965117.022378:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783965117.022421:0:3324:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783965117.022427:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947307dc5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3324:1870622732922112:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1783965117.022445:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783965117.022576:0:6609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732921984 00000100:00100000:2.0:1783965117.022583:0:6609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732921984 00000100:00100000:2.0:1783965117.022639:0:6609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732922112 00000100:00100000:2.0:1783965117.022642:0:6609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732922112 00000100:00100000:2.0:1783965117.022658:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1783965117.022666:0:6609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743fb9a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3324:x1870622732921984:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1783965117.022688:0:6609:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00010000:00010000:2.0:1783965117.022713:0:6609:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bd475494/0xe782b916994fe378 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965117.022734:0:6609:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000003d89582a/0xe782b916994fe133 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f022d expref: 12 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965117.022743:0:6609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1783965117.022747:0:6609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783965117.022752:0:6609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bd475494/0xe782b916994fe378 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965117.022778:0:6609:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000003d89582a/0xe782b916994fe133 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f022d expref: 12 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965117.022791:0:6609:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000003d89582a/0xe782b916994fe133 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f022d expref: 12 pid: 6608 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783965117.022802:0:6609:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947307dc5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6609:1870622732922240:192.168.204.12@tcp:104: 00000100:00100000:2.0:1783965117.022852:0:6609:0:(client.c:2702:ptlrpc_set_wait()) set ffff947425815c00 going to sleep for 11 seconds 00000100:00100000:3.0:1783965117.023825:0:6632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 227 00000100:00100000:3.0:1783965117.023863:0:11945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1783965117.023872:0:11945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743fb98e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+7:3324:x1870622732922112:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1783965117.024051:0:11945:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1783965117.024055:0:11945:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1783965116 00002000:00010000:3.0:1783965117.024057:0:11945:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1783965117.024059:0:11945:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1783965116 -> 1783965116 00002000:00010000:3.0:1783965117.024061:0:11945:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1783965117.024368:0:11945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743fb98e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+8:3324:x1870622732922112:12345-0@lo:2:osp-syn-1-0.0 Request processed in 496us (1919us total) trans 4294967321 rc 0/0 00000100:00100000:3.0:1783965117.024375:0:11945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000004:00080000:2.0:1783965117.024607:0:3324:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff947307dc5500/2, rc 0, transno 4294967321 00000100:00100000:2.0:1783965117.024613:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947307dc5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3324:1870622732922112:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1783965117.030076:0:6609:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947307dc5180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6609:1870622732922240:192.168.204.12@tcp:104: 00010000:00010000:2.0:1783965117.030136:0:6609:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000bd475494/0xe782b916994fe378 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783965117.031254:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965117.032010:0:8738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715114752 00000100:00100000:1.0:1783965117.032021:0:8738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715114752 00000100:00100000:1.0:1783965117.032076:0:8738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 69 00000100:00100000:1.0:1783965117.032084:0:8738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743fb9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9923189b-eb4a-470c-ab45-969435371000+13:2360:x1870622715114752:12345-192.168.204.12@tcp:16:lhsmtool_posix.0 00000100:00100000:0.0:1783965117.043348:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965117.043749:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715114880 00000100:00100000:3.0:1783965117.043760:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715114880 00010000:00010000:3.0:1783965117.043799:0:5799:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000003d89582a/0xe782b916994fe133 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f022d expref: 14 pid: 6608 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783965117.043860:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 81 00000100:00100000:3.0:1783965117.043870:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743fb9d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9923189b-eb4a-470c-ab45-969435371000+14:2360:x1870622715114880:12345-192.168.204.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783965117.043895:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783965117.043902:0:5799:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000003d89582a/0xe782b916994fe133 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f022d expref: 14 pid: 6608 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965117.043917:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000003d89582a/0xe782b916994fe133 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f022d expref: 14 pid: 6608 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965117.043943:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003d89582a/0xe782b916994fe133 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f022d expref: 14 pid: 6608 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965117.043959:0:5799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783965117.043964:0:5799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783965117.043970:0:5799:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000bd475494/0xe782b916994fe378 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965117.043981:0:5799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bd475494/0xe782b916994fe378 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965117.044022:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783965117.044074:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743fb9d500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9923189b-eb4a-470c-ab45-969435371000+13:2360:x1870622715114880:12345-192.168.204.12@tcp:103:ldlm_bl.0 Request processed in 205us (735us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965117.044082:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 81 00010000:00010000:2.0:1783965117.044191:0:6609:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000bd475494/0xe782b916994fe378 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965117.044221:0:6609:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bd475494/0xe782b916994fe378 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965117.044230:0:6609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bd475494/0xe782b916994fe378 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965117.044238:0:6609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bd475494/0xe782b916994fe378 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965117.044256:0:6609:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1783965117.044868:0:6609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743fb9a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3324:x1870622732921984:12345-0@lo:6:osp-syn-1-0.0 Request processed in 22199us (22485us total) trans 4294967322 rc 0/0 00000100:00100000:2.0:1783965117.044878:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00010000:00010000:2.0:1783965117.044907:0:5801:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783965117.044913:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bd475494/0xe782b916994fe378 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965117.044922:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743fb8f600 already unused, calling callback (ffffffffc168d230) 00010000:00010000:2.0:1783965117.044927:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bd475494/0xe782b916994fe378 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965117.044950:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bd475494/0xe782b916994fe378 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965117.044965:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bd475494/0xe782b916994fe378 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965117.044973:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bd475494/0xe782b916994fe378 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965117.044991:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783965117.044993:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783965117.044994:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1783965117.045033:0:3324:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff947307dc7480/2, rc 0, transno 4294967322 00000100:00100000:2.0:1783965117.045041:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947307dc7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3324:1870622732921984:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1783965117.099514:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1783965117.102506:0:7523:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967317 is committed 00000001:00080000:3.0:1783965117.102523:0:7523:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967316 is committed 00000001:00080000:3.0:1783965117.102531:0:7523:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967319 is committed 00000001:00080000:3.0:1783965117.102537:0:7523:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967320 is committed 00000001:00080000:3.0:1783965117.102548:0:7523:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967321 is committed 00000100:00100000:0.0:1783965117.102746:0:8738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743fb9f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9923189b-eb4a-470c-ab45-969435371000+7:2360:x1870622715114752:12345-192.168.204.12@tcp:16:lhsmtool_posix.0 Request processed in 70655us (71492us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965117.102758:0:8738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 69 00000100:00100000:2.0:1783965117.109382:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965117.109510:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715115136 00000100:00100000:1.0:1783965117.109521:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715115136 00000100:00100000:1.0:1783965117.109641:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 228 00000100:00100000:1.0:1783965117.109652:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947307dc5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9923189b-eb4a-470c-ab45-969435371000+21:11582:x1870622715115136:12345-192.168.204.12@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1783965117.109706:0:5811:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783965117.109735:0:5811:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e400/0xe782b916994fe35c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f02c0 expref: 21 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965117.109754:0:5811:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff947402a2d900) 00010000:00010000:1.0:1783965117.109759:0:5811:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783965117.109804:0:5811:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efc00/0xe782b916994fe37f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965117.109819:0:5811:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efc00/0xe782b916994fe37f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965117.109828:0:5811:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efc00/0xe782b916994fe37f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1783965117.110340:0:5811:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000000cd916fe reply state 000000004c12e2e4 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efc00/0xe782b916994fe37f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783965117.110351:0:5811:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1783965117.110443:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947307dc5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9923189b-eb4a-470c-ab45-969435371000+22:11582:x1870622715115136:12345-192.168.204.12@tcp:36:lhsmtool_posix.0 Request processed in 792us (1071us total) trans 4294967507 rc 0/0 00000100:00100000:1.0:1783965117.110451:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 228 00000100:00080000:2.0:1783965117.111580:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1783965117.112982:0:3309:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efc00/0xe782b916994fe37f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965117.112997:0:3309:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efc00/0xe782b916994fe37f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965117.113004:0:3309:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efc00/0xe782b916994fe37f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965117.113010:0:3309:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743d9efc00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1783965117.113015:0:3309:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efc00/0xe782b916994fe37f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965117.113036:0:3309:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efc00/0xe782b916994fe37f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965117.113053:0:3309:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff947402a2d900) 00010000:00010000:2.0:1783965117.113056:0:3309:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783965117.113060:0:3309:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efc00/0xe782b916994fe37f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965117.113066:0:3309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efc00/0xe782b916994fe37f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5811 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783965117.115950:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965117.116068:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715115264 00000100:00100000:1.0:1783965117.116078:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715115264 00000100:00100000:1.0:1783965117.116138:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 70 00000100:00100000:1.0:1783965117.116160:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947307dc7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9923189b-eb4a-470c-ab45-969435371000+7:2359:x1870622715115264:12345-192.168.204.12@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1783965117.116454:0:6606:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1783965117.116458:0:6606:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1783965116 -> 1783965116 00002000:00010000:1.0:1783965117.116472:0:6606:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 1783965115 00002000:00010000:1.0:1783965117.116474:0:6606:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1783965116 -> 1783965116 00002000:00010000:1.0:1783965117.116477:0:6606:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1783965117.116533:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947307dc7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9923189b-eb4a-470c-ab45-969435371000+8:2359:x1870622715115264:12345-192.168.204.12@tcp:2:lhsmtool_posix.0 Request processed in 374us (641us total) trans 4294967323 rc 0/0 00000100:00100000:1.0:1783965117.116540:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 70 00000100:00100000:1.0:1783965117.121602:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965117.124819:0:12356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715115520 00000100:00100000:2.0:1783965117.124836:0:12356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715115520 00000100:00100000:3.0:1783965117.126387:0:12356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 229 00000100:00100000:3.0:1783965117.126409:0:12356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743fb98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9923189b-eb4a-470c-ab45-969435371000+21:11582:x1870622715115520:12345-192.168.204.12@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1783965117.126523:0:12356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fe386 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965117.126544:0:12356:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e800/0xe782b916994fe340 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f02b2 expref: 21 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965117.126554:0:12356:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fe386 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965117.126602:0:12356:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e800/0xe782b916994fe340 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f02b2 expref: 21 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965117.126617:0:12356:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e800/0xe782b916994fe340 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f02b2 expref: 21 pid: 5813 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783965117.126635:0:12356:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743648f480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12356:1870622732922368:192.168.204.12@tcp:104: 00000100:00100000:3.0:1783965117.126787:0:12356:0:(client.c:2702:ptlrpc_set_wait()) set ffff9474258aa6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783965117.130722:0:12356:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743648f480 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12356:1870622732922368:192.168.204.12@tcp:104: 00010000:00010000:2.0:1783965117.130754:0:12356:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fe386 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12356 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783965117.137002:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965117.141070:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715115648 00000100:00100000:3.0:1783965117.141095:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715115648 00010000:00010000:3.0:1783965117.141173:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e800/0xe782b916994fe340 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f02b2 expref: 22 pid: 5813 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783965117.141278:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 82 00000100:00100000:3.0:1783965117.141289:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743fb9b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9923189b-eb4a-470c-ab45-969435371000+22:2360:x1870622715115648:12345-192.168.204.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783965117.141311:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783965117.141320:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e800/0xe782b916994fe340 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f02b2 expref: 22 pid: 5813 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965117.141338:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e800/0xe782b916994fe340 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f02b2 expref: 22 pid: 5813 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965117.141370:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e800/0xe782b916994fe340 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f02b2 expref: 22 pid: 5813 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965117.141394:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff947402a2d900) 00010000:00010000:3.0:1783965117.141400:0:5797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fe386 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965117.141413:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fe386 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965117.141423:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fe386 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965117.141475:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783965117.141558:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743fb9b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9923189b-eb4a-470c-ab45-969435371000+21:2360:x1870622715115648:12345-192.168.204.12@tcp:103:ldlm_bl.0 Request processed in 270us (4571us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965117.141569:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 82 00010000:00010000:2.0:1783965117.141577:0:12356:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fe386 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965117.141596:0:12356:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fe386 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965117.141632:0:12356:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fe386 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965117.141640:0:12356:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fe386 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 12356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965117.141648:0:12356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fe386 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965117.141675:0:12356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947436f26200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1783965117.141680:0:12356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fe386 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 12356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965117.141688:0:12356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fe386 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 12356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965117.141706:0:12356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff947402a2d900) 00010000:00010000:2.0:1783965117.141709:0:12356:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1783965117.141714:0:12356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fe386 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965117.141721:0:12356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fe386 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 12356 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783965117.141821:0:12356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743fb98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9923189b-eb4a-470c-ab45-969435371000+20:11582:x1870622715115520:12345-192.168.204.12@tcp:55:lhsmtool_posix.0 Request processed in 15414us (20222us total) trans 0 rc -22/-22 00000100:00100000:2.0:1783965117.141832:0:12356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 229 00000100:00100000:1.0:1783965117.145386:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965117.145497:0:11945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715115776 00000100:00100000:3.0:1783965117.145526:0:11945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715115776 00000100:00100000:3.0:1783965117.145592:0:11945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 71 00000100:00100000:3.0:1783965117.145603:0:11945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94741cccdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9923189b-eb4a-470c-ab45-969435371000+8:2360:x1870622715115776:12345-192.168.204.12@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1783965117.145660:0:11945:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000003e4dc5f0/0xe782b916994fe38d lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965117.145686:0:11945:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f42876e3/0xe782b916994fe36a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f02ce expref: 8 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965117.145697:0:11945:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783965117.145702:0:11945:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783965117.145708:0:11945:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003e4dc5f0/0xe782b916994fe38d lrc: 4/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965117.145753:0:11945:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f42876e3/0xe782b916994fe36a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f02ce expref: 8 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965117.145770:0:11945:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f42876e3/0xe782b916994fe36a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f02ce expref: 8 pid: 6608 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783965117.145789:0:11945:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743648ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11945:1870622732922496:192.168.204.12@tcp:104: 00000100:00100000:3.0:1783965117.146092:0:11945:0:(client.c:2702:ptlrpc_set_wait()) set ffff9474258aa180 going to sleep for 11 seconds 00000100:00100000:1.0:1783965117.149264:0:11945:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743648ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:11945:1870622732922496:192.168.204.12@tcp:104: 00010000:00010000:1.0:1783965117.149307:0:11945:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003e4dc5f0/0xe782b916994fe38d lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783965117.150567:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965117.150858:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715115904 00000100:00100000:3.0:1783965117.150871:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715115904 00010000:00010000:3.0:1783965117.151042:0:5799:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f42876e3/0xe782b916994fe36a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f02ce expref: 9 pid: 6608 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783965117.151123:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 83 00000100:00100000:3.0:1783965117.151135:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743fb99f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9923189b-eb4a-470c-ab45-969435371000+9:2359:x1870622715115904:12345-192.168.204.12@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1783965117.151157:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783965117.151189:0:5799:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f42876e3/0xe782b916994fe36a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f02ce expref: 9 pid: 6608 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965117.151237:0:5799:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f42876e3/0xe782b916994fe36a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f02ce expref: 9 pid: 6608 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965117.151268:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f42876e3/0xe782b916994fe36a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f02ce expref: 9 pid: 6608 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965117.151287:0:5799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783965117.151292:0:5799:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783965117.151300:0:5799:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003e4dc5f0/0xe782b916994fe38d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965117.151311:0:5799:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003e4dc5f0/0xe782b916994fe38d lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965117.151338:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1783965117.151548:0:11945:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003e4dc5f0/0xe782b916994fe38d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965117.151560:0:11945:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003e4dc5f0/0xe782b916994fe38d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965117.151589:0:11945:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000003e4dc5f0/0xe782b916994fe38d lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965117.151621:0:11945:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003e4dc5f0/0xe782b916994fe38d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965117.151631:0:11945:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003e4dc5f0/0xe782b916994fe38d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965117.151640:0:11945:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947436f26400 already unused, calling callback (ffffffffc168d230) 00010000:00010000:1.0:1783965117.151646:0:11945:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003e4dc5f0/0xe782b916994fe38d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965117.151656:0:11945:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003e4dc5f0/0xe782b916994fe38d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965117.151670:0:11945:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003e4dc5f0/0xe782b916994fe38d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965117.151678:0:11945:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003e4dc5f0/0xe782b916994fe38d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783965117.151755:0:11945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94741cccdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9923189b-eb4a-470c-ab45-969435371000+8:2360:x1870622715115776:12345-192.168.204.12@tcp:1:lhsmtool_posix.0 Request processed in 6152us (6382us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965117.151766:0:11945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 71 00000100:00100000:3.0:1783965117.152388:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743fb99f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:9923189b-eb4a-470c-ab45-969435371000+7:2359:x1870622715115904:12345-192.168.204.12@tcp:103:ldlm_bl.0 Request processed in 1251us (1828us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965117.152397:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 83 00000100:00100000:1.0:1783965117.155700:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965117.155774:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715116160 00000100:00100000:3.0:1783965117.155787:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715116160 00000100:00100000:3.0:1783965117.155854:0:6632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 230 00000100:00100000:3.0:1783965117.155865:0:6632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743fb99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9923189b-eb4a-470c-ab45-969435371000+20:11582:x1870622715116160:12345-192.168.204.12@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1783965117.155991:0:6632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27000/0xe782b916994fe394 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965117.156013:0:6632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27000/0xe782b916994fe394 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965117.156026:0:6632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27000/0xe782b916994fe394 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965117.156338:0:6632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fe39b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965117.156351:0:6632:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8ec00/0xe782b916994fe34e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f02b9 expref: 21 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965117.156359:0:6632:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fe39b lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965117.156399:0:6632:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8ec00/0xe782b916994fe34e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f02b9 expref: 21 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965117.156413:0:6632:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8ec00/0xe782b916994fe34e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f02b9 expref: 21 pid: 5813 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783965117.156429:0:6632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743648ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6632:1870622732922624:192.168.204.12@tcp:104: 00000100:00100000:3.0:1783965117.156547:0:6632:0:(client.c:2702:ptlrpc_set_wait()) set ffff9474258aacc0 going to sleep for 11 seconds 00000100:00100000:2.0:1783965117.160152:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783965117.160347:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715116288 00000100:00100000:0.0:1783965117.160360:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715116288 00010000:00010000:0.0:1783965117.160424:0:5797:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8ec00/0xe782b916994fe34e lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f02b9 expref: 22 pid: 5813 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783965117.160475:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 84 00000100:00100000:0.0:1783965117.160485:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947307dc5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9923189b-eb4a-470c-ab45-969435371000+22:2359:x1870622715116288:12345-192.168.204.12@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783965117.160505:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783965117.160513:0:5797:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8ec00/0xe782b916994fe34e lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f02b9 expref: 22 pid: 5813 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965117.160528:0:5797:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8ec00/0xe782b916994fe34e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f02b9 expref: 22 pid: 5813 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965117.160556:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff947402a2d900) 00010000:00010000:0.0:1783965117.160563:0:5797:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fe39b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965117.160574:0:5797:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fe39b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965117.160605:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fe39b lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965117.160629:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783965117.160691:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947307dc5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9923189b-eb4a-470c-ab45-969435371000+22:2359:x1870622715116288:12345-192.168.204.12@tcp:103:ldlm_bl.0 Request processed in 207us (556us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965117.160700:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 84 00010000:00010000:3.0:1783965117.161528:0:6632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8ec00/0xe782b916994fe34e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f02b9 expref: 21 pid: 5813 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783965117.161551:0:6632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743648ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6632:1870622732922624:192.168.204.12@tcp:104: 00010000:00010000:3.0:1783965117.161577:0:6632:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fe39b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965117.161587:0:6632:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fe39b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965117.161593:0:6632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fe39b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1783965117.161836:0:6632:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:3.0:1783965117.162032:0:6632:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:3.0:1783965117.162079:0:6632:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:3.0:1783965117.162181:0:6632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743648ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6632:1870622732922752:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1783965117.162279:0:6632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783965117.162577:0:6632:0:(client.c:2702:ptlrpc_set_wait()) set ffff9474258aac00 going to sleep for 11 seconds 00000100:00100000:1.0:1783965117.163675:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732922752 00000100:00100000:1.0:1783965117.163689:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732922752 00000100:00100000:1.0:1783965117.163782:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1783965117.163793:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743648ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6632:x1870622732922752:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1783965117.163942:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743648ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6632:x1870622732922752:12345-0@lo:1000:mdt00_003.0 Request processed in 151us (1663us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965117.163951:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1783965117.164265:0:6632:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967321 gen 2 00000004:00080000:3.0:1783965117.164274:0:6632:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967321 00000004:00080000:3.0:1783965117.164301:0:6632:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff947307dc5500, transno 4294967321 00000100:00100000:3.0:1783965117.164322:0:6632:0:(client.c:3156:ptlrpc_free_committed()) @@@ stopping search req@ffff947307dc7480 x1870622732921984/t4294967322(4294967322) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1783965133 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783965117.164337:0:6632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743648ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6632:1870622732922752:0@lo:1000:mdt00_003.0 00000001:00080000:3.0:1783965117.166114:0:6632:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:3.0:1783965117.166263:0:6632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743648ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6632:1870622732922880:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1783965117.166345:0:6632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783965117.166521:0:6632:0:(client.c:2702:ptlrpc_set_wait()) set ffff9474258aacc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783965117.167153:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732922880 00000100:00100000:0.0:1783965117.167164:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732922880 00000100:00100000:0.0:1783965117.167357:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1783965117.167370:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743648f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:6632:x1870622732922880:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1783965117.167707:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743648f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:6632:x1870622732922880:12345-0@lo:1000:mdt00_003.0 Request processed in 338us (1360us total) trans 4294967324 rc 0/0 00000100:00100000:0.0:1783965117.167717:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1783965117.167829:0:6632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743648ed80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6632:1870622732922880:0@lo:1000:mdt00_003.0 00010000:00010000:3.0:1783965117.168169:0:6632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fe39b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965117.168181:0:6632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fe39b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965117.168190:0:6632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fe39b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965117.168197:0:6632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947436f26200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1783965117.168233:0:6632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fe39b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965117.168243:0:6632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fe39b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965117.168265:0:6632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff947402a2d900) 00010000:00010000:3.0:1783965117.168268:0:6632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783965117.168274:0:6632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fe39b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965117.168280:0:6632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26200/0xe782b916994fe39b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965117.168318:0:6632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27600/0xe782b916994fe2de lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965117.168325:0:6632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27600/0xe782b916994fe2de lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965117.168331:0:6632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27600/0xe782b916994fe2de lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965117.168354:0:6632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947436f27600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1783965117.168358:0:6632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27600/0xe782b916994fe2de lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965117.168364:0:6632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27600/0xe782b916994fe2de lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965117.168373:0:6632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff947402a2d300) 00010000:00010000:3.0:1783965117.168375:0:6632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1783965117.168383:0:6632:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27a00/0xe782b916994fe2e5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f029d expref: 24 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965117.168395:0:6632:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27a00/0xe782b916994fe2e5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f029d expref: 24 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965117.168405:0:6632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27a00/0xe782b916994fe2e5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f029d expref: 24 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965117.168457:0:6632:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27a00/0xe782b916994fe2e5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f029d expref: 24 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783965117.168484:0:6632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743648e300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6632:1870622732923008:192.168.204.12@tcp:105: 00000100:00100000:3.0:1783965117.168574:0:6632:0:(client.c:2702:ptlrpc_set_wait()) set ffff9474258aacc0 going to sleep for 11 seconds 00000100:00100000:2.0:1783965117.172286:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965117.172702:0:6632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743648e300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6632:1870622732923008:192.168.204.12@tcp:105: 00010000:00010000:3.0:1783965117.172741:0:6632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27600/0xe782b916994fe2de lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965117.172778:0:6632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27600/0xe782b916994fe2de lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965117.172825:0:6632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fe3a2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965117.172845:0:6632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fe3a2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965117.172860:0:6632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fe3a2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965117.172874:0:6632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fe3a2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965117.172897:0:6632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fe3a2 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965117.172904:0:6632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fe3a2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965117.172911:0:6632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947436f26e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1783965117.172915:0:6632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fe3a2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965117.172923:0:6632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fe3a2 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965117.172936:0:6632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff947402a2d300) 00010000:00010000:3.0:1783965117.172940:0:6632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783965117.172944:0:6632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fe3a2 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965117.172957:0:6632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fe3a2 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965117.172969:0:6632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27000/0xe782b916994fe394 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965117.172976:0:6632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27000/0xe782b916994fe394 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965117.173091:0:6632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27000/0xe782b916994fe394 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965117.173097:0:6632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947436f27000 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1783965117.173100:0:6632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27000/0xe782b916994fe394 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965117.173106:0:6632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27000/0xe782b916994fe394 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965117.173116:0:6632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff947402a2d300) 00010000:00010000:3.0:1783965117.173118:0:6632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1783965117.173121:0:6632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27000/0xe782b916994fe394 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965117.173127:0:6632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27000/0xe782b916994fe394 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783965117.173479:0:6632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743fb99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9923189b-eb4a-470c-ab45-969435371000+24:11582:x1870622715116160:12345-192.168.204.12@tcp:57:lhsmtool_posix.0 Request processed in 17612us (17789us total) trans 4294967512 rc 0/0 00000100:00100000:3.0:1783965117.173493:0:6632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 230 00000020:00080000:3.0:1783965117.173509:0:6632:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:1.0:1783965117.173685:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715116416 00000100:00100000:1.0:1783965117.173694:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715116416 00000100:00100000:1.0:1783965117.173748:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 61 00000100:00100000:1.0:1783965117.173759:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947307dc5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9923189b-eb4a-470c-ab45-969435371000+24:11581:x1870622715116416:12345-192.168.204.12@tcp:49:lfs.0 00000040:00080000:2.0:1783965117.174271:0:11561:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783965117.174280:0:11561:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783965117.174828:0:11561:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:2.0:1783965117.174842:0:11561:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1783965117.175313:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947307dc5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9923189b-eb4a-470c-ab45-969435371000+24:11581:x1870622715116416:12345-192.168.204.12@tcp:49:lfs.0 Request processed in 1547us (3036us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965117.175326:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 61 00000100:00100000:2.0:1783965117.178711:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965117.178749:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965117.178813:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715116928 00000100:00100000:3.0:1783965117.178825:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715116928 00000100:00100000:3.0:1783965117.178900:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 231 00000100:00100000:3.0:1783965117.178911:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947307dc4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9923189b-eb4a-470c-ab45-969435371000+24:11581:x1870622715116928:12345-192.168.204.12@tcp:58:lfs.0 00000040:00080000:2.0:1783965117.179846:0:5813:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:2.0:1783965117.180403:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947307dc4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9923189b-eb4a-470c-ab45-969435371000+24:11581:x1870622715116928:12345-192.168.204.12@tcp:58:lfs.0 Request processed in 1070us (1228us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965117.180442:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 231 00000100:00100000:1.0:1783965117.181311:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715116672 00000100:00100000:1.0:1783965117.181331:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715116672 00000100:00100000:1.0:1783965117.181398:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 62 00000100:00100000:1.0:1783965117.181422:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94740638a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9923189b-eb4a-470c-ab45-969435371000+24:11582:x1870622715116672:12345-192.168.204.12@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1783965117.182860:0:5815:0:(mdd_object.c:4016:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1783965117.183387:0:5815:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:1.0:1783965117.183578:0:5815:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eea00/0xe782b916994fe3a9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965117.183601:0:5815:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eea00/0xe782b916994fe3a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965117.183616:0:5815:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eea00/0xe782b916994fe3a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965117.183626:0:5815:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eea00/0xe782b916994fe3a9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965117.183644:0:5815:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eea00/0xe782b916994fe3a9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965117.183651:0:5815:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eea00/0xe782b916994fe3a9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965117.183715:0:5815:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1783965117.183871:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94740638a850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9923189b-eb4a-470c-ab45-969435371000+26:11582:x1870622715116672:12345-192.168.204.12@tcp:35:lhsmtool_posix.0 Request processed in 2458us (5168us total) trans 4294967514 rc 0/0 00000100:00100000:1.0:1783965117.183895:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 62 00000020:00080000:1.0:1783965117.183903:0:5815:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1783965117.188342:0:5801:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783965117.188361:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eea00/0xe782b916994fe3a9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965117.188375:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743d9eea00 already unused, calling callback (ffffffffc168d230) 00010000:00010000:2.0:1783965117.188381:0:5801:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eea00/0xe782b916994fe3a9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965117.188392:0:5801:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eea00/0xe782b916994fe3a9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965117.188425:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff947407b5c100) 00010000:00010000:2.0:1783965117.188429:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1783965117.188435:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eea00/0xe782b916994fe3a9 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965117.188442:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eea00/0xe782b916994fe3a9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5815 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965117.188491:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783965117.188494:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783965117.188496:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783965117.215811:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965117.216275:0:12356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715117056 00000100:00100000:3.0:1783965117.216289:0:12356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715117056 00000100:00100000:3.0:1783965117.216423:0:12356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 232 00000100:00100000:3.0:1783965117.216435:0:12356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947307dc7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9923189b-eb4a-470c-ab45-969435371000+26:11584:x1870622715117056:12345-192.168.204.12@tcp:101:lfs.0 00010000:00010000:3.0:1783965117.216478:0:12356:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783965117.216507:0:12356:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27800/0xe782b916994fe3b0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5f02d5 expref: -99 pid: 12356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965117.216592:0:12356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27000/0xe782b916994fe3b7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965117.216610:0:12356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27000/0xe782b916994fe3b7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965117.216625:0:12356:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27000/0xe782b916994fe3b7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965117.216642:0:12356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fe3be lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 12356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965117.216650:0:12356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fe3be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965117.216656:0:12356:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fe3be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 12356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965117.219001:0:12356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff947425975600/0xe782b916994fe3c5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965117.219030:0:12356:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fa00/0xe782b916994fe2d0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0296 expref: 27 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965117.219040:0:12356:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff947425975600/0xe782b916994fe3c5 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965117.219105:0:12356:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fa00/0xe782b916994fe2d0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0296 expref: 27 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965117.219127:0:12356:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fa00/0xe782b916994fe2d0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0296 expref: 27 pid: 5812 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783965117.219150:0:12356:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947307dc5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12356:1870622732923136:192.168.204.12@tcp:104: 00000100:00100000:2.0:1783965117.219820:0:12356:0:(client.c:2702:ptlrpc_set_wait()) set ffff947425815c00 going to sleep for 11 seconds 00000100:00100000:2.0:1783965117.223780:0:12356:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947307dc5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000_UUID:12356:1870622732923136:192.168.204.12@tcp:104: 00010000:00010000:2.0:1783965117.223823:0:12356:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff947425975600/0xe782b916994fe3c5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12356 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783965117.224894:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965117.225004:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715117312 00000100:00100000:3.0:1783965117.225014:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715117312 00000100:00100000:3.0:1783965117.225089:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 63 00000100:00100000:3.0:1783965117.225100:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947307dc5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9923189b-eb4a-470c-ab45-969435371000+28:5571:x1870622715117312:12345-192.168.204.12@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1783965117.225503:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947307dc5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9923189b-eb4a-470c-ab45-969435371000+29:5571:x1870622715117312:12345-192.168.204.12@tcp:35:ldlm_bl.0 Request processed in 402us (614us total) trans 4294967515 rc 0/0 00000100:00100000:3.0:1783965117.225512:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 63 00000100:00100000:3.0:1783965117.229342:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783965117.233084:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715117440 00000100:00100000:0.0:1783965117.233106:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715117440 00010000:00010000:0.0:1783965117.233176:0:5798:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fa00/0xe782b916994fe2d0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0296 expref: 29 pid: 5812 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783965117.233311:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 85 00000100:00100000:0.0:1783965117.233323:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743648e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9923189b-eb4a-470c-ab45-969435371000+29:2359:x1870622715117440:12345-192.168.204.12@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783965117.233344:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783965117.233352:0:5798:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fa00/0xe782b916994fe2d0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0296 expref: 29 pid: 5812 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965117.233367:0:5798:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fa00/0xe782b916994fe2d0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0296 expref: 29 pid: 5812 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965117.233415:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fa00/0xe782b916994fe2d0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0296 expref: 29 pid: 5812 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965117.233436:0:5798:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff947402a2d300) 00010000:00010000:0.0:1783965117.233442:0:5798:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff947425975600/0xe782b916994fe3c5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965117.233453:0:5798:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff947425975600/0xe782b916994fe3c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965117.233475:0:5798:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947425975600/0xe782b916994fe3c5 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 12356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965117.233514:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783965117.233587:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743648e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:9923189b-eb4a-470c-ab45-969435371000+28:2359:x1870622715117440:12345-192.168.204.12@tcp:103:ldlm_bl.0 Request processed in 266us (4261us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965117.233595:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 85 00010000:00010000:2.0:1783965117.233879:0:12356:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff947425975600/0xe782b916994fe3c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965117.233889:0:12356:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947425975600/0xe782b916994fe3c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12356 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783965117.233944:0:12356:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1783965117.233949:0:12356:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1783965117.233972:0:12356:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff947425975600/0xe782b916994fe3c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 12356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965117.233998:0:12356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947425975600/0xe782b916994fe3c5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 12356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965117.234009:0:12356:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27000/0xe782b916994fe3b7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965117.234025:0:12356:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27000/0xe782b916994fe3b7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965117.234032:0:12356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27000/0xe782b916994fe3b7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965117.234039:0:12356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947436f27000 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1783965117.234044:0:12356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27000/0xe782b916994fe3b7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965117.234052:0:12356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27000/0xe782b916994fe3b7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965117.234063:0:12356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94740a90c500) 00010000:00010000:2.0:1783965117.234066:0:12356:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783965117.234071:0:12356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27000/0xe782b916994fe3b7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965117.234078:0:12356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27000/0xe782b916994fe3b7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965117.234091:0:12356:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fe3be lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 12356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965117.234098:0:12356:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fe3be lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 12356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965117.234103:0:12356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fe3be lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965117.234109:0:12356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947436f26e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1783965117.234117:0:12356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fe3be lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 12356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965117.234124:0:12356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fe3be lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 12356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965117.234134:0:12356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff94740b97a200) 00010000:00010000:2.0:1783965117.234137:0:12356:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783965117.234140:0:12356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fe3be lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965117.234146:0:12356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26e00/0xe782b916994fe3be lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 12356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965117.234186:0:12356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27800/0xe782b916994fe3b0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f02d5 expref: 28 pid: 12356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965117.234242:0:12356:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff947425975600/0xe782b916994fe3c5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f02d5 expref: 27 pid: 12356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965117.234251:0:12356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff947402a2d300) 00010000:00010000:2.0:1783965117.234254:0:12356:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783965117.234257:0:12356:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff947425975600, rc 0) 00000100:00100000:2.0:1783965117.234298:0:12356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947307dc7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9923189b-eb4a-470c-ab45-969435371000+27:11584:x1870622715117056:12345-192.168.204.12@tcp:101:lfs.0 Request processed in 17865us (18502us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965117.234306:0:12356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 232 00000040:00080000:2.0:1783965118.047720:0:12394:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1783965118.047730:0:12394:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1783965118.047778:0:12394:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1783965118.047786:0:12394:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1783965118.124348:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1783965118.188841:0:11561:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1783965118.188849:0:11561:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1783965118.188966:0:11561:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1783965118.188973:0:11561:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1783965118.189103:0:11561:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743fb9d180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11561:1870622732923264:192.168.204.12@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1783965118.189292:0:11561:0:(client.c:2702:ptlrpc_set_wait()) set ffff947410edf240 going to sleep for 11 seconds 00000100:00100000:0.0:1783965118.202253:0:11561:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743fb9d180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11561:1870622732923264:192.168.204.12@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1783965118.204615:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965118.204705:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715117568 00000100:00100000:3.0:1783965118.204714:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715117568 00000100:00100000:3.0:1783965118.204773:0:6632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 233 00000100:00100000:3.0:1783965118.204783:0:6632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947307dc5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9923189b-eb4a-470c-ab45-969435371000+27:11596:x1870622715117568:12345-192.168.204.12@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1783965118.204824:0:6632:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1783965118.204950:0:6632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947307dc5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9923189b-eb4a-470c-ab45-969435371000+27:11596:x1870622715117568:12345-192.168.204.12@tcp:53:lhsmtool_posix.0 Request processed in 167us (345us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965118.204959:0:6632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 233 00000100:00100000:2.0:1783965118.207898:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783965118.208032:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715117824 00000100:00100000:0.0:1783965118.208042:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715117824 00000100:00100000:0.0:1783965118.208109:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 234 00000100:00100000:0.0:1783965118.208130:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947307dc6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9923189b-eb4a-470c-ab45-969435371000+27:11596:x1870622715117824:12345-192.168.204.12@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783965118.208153:0:5813:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783965118.208178:0:5813:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fde00/0xe782b916994fe3cc lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5f02dc expref: -99 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965118.208333:0:5813:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fd400/0xe782b916994fe3d3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965118.208350:0:5813:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fd400/0xe782b916994fe3d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965118.208363:0:5813:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fd400/0xe782b916994fe3d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5813 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783965118.208377:0:5813:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1783965118.208524:0:5813:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fde00/0xe782b916994fe3cc lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f02dc expref: 30 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965118.208547:0:5813:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fd400/0xe782b916994fe3d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f02dc expref: 29 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965118.208556:0:5813:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff947402a2d300) 00010000:00010000:0.0:1783965118.208558:0:5813:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1783965118.208562:0:5813:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94743e2fd400, rc 0) 00000100:00100000:0.0:1783965118.208620:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947307dc6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9923189b-eb4a-470c-ab45-969435371000+29:11596:x1870622715117824:12345-192.168.204.12@tcp:101:lhsmtool_posix.0 Request processed in 492us (730us total) trans 4294967516 rc 0/0 00000100:00100000:0.0:1783965118.208628:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 234 00000100:00100000:3.0:1783965118.212464:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965118.212534:0:12356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715118080 00000100:00100000:3.0:1783965118.212544:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965118.212553:0:12356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715118080 00000100:00100000:2.0:1783965118.212644:0:12356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 235 00000100:00100000:2.0:1783965118.212654:0:12356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743648fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9923189b-eb4a-470c-ab45-969435371000+29:11596:x1870622715118080:12345-192.168.204.12@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1783965118.212742:0:12356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff947425974e00/0xe782b916994fe3e1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 12356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965118.212761:0:12356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947425974e00/0xe782b916994fe3e1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965118.212774:0:12356:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947425974e00/0xe782b916994fe3e1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 12356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965118.213005:0:12356:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff947425974e00/0xe782b916994fe3e1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 12356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965118.213013:0:12356:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff947425974e00/0xe782b916994fe3e1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 12356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965118.213021:0:12356:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff947425974e00/0xe782b916994fe3e1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965118.213027:0:12356:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947425974e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1783965118.213032:0:12356:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947425974e00/0xe782b916994fe3e1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 12356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965118.213039:0:12356:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947425974e00/0xe782b916994fe3e1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 12356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965118.213052:0:12356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff947402a2d300) 00010000:00010000:2.0:1783965118.213063:0:12356:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1783965118.213069:0:12356:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff947425974e00/0xe782b916994fe3e1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965118.213075:0:12356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947425974e00/0xe782b916994fe3e1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 12356 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783965118.213295:0:12356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743648fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9923189b-eb4a-470c-ab45-969435371000+30:11596:x1870622715118080:12345-192.168.204.12@tcp:57:lhsmtool_posix.0 Request processed in 641us (856us total) trans 4294967517 rc 0/0 00000100:00100000:2.0:1783965118.213304:0:12356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 235 00000040:00080000:3.0:1783965118.213389:0:11561:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1783965118.213396:0:11561:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000100:00100000:0.0:1783965118.213567:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715118208 00000100:00100000:0.0:1783965118.213574:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715118208 00000100:00100000:0.0:1783965118.213633:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 17 00000100:00100000:0.0:1783965118.213642:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743648c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9923189b-eb4a-470c-ab45-969435371000+30:2357:x1870622715118208:12345-192.168.204.12@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783965118.213654:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783965118.213670:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fd400/0xe782b916994fe3d3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f02dc expref: 30 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965118.213692:0:5797:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff947402a2d300) 00010000:00010000:0.0:1783965118.213696:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783965118.213735:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743648c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:9923189b-eb4a-470c-ab45-969435371000+29:2357:x1870622715118208:12345-192.168.204.12@tcp:103:ldlm_bl.0 Request processed in 94us (1192us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965118.213742:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 17 00000040:00080000:3.0:1783965118.214802:0:11561:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1783965118.214820:0:11561:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1783965118.217121:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965118.217239:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715118464 00000100:00100000:2.0:1783965118.217252:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715118464 00000100:00100000:2.0:1783965118.217316:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 64 00000100:00100000:2.0:1783965118.217325:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743648d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9923189b-eb4a-470c-ab45-969435371000+29:11596:x1870622715118464:12345-192.168.204.12@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1783965118.217711:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743648d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9923189b-eb4a-470c-ab45-969435371000+30:11596:x1870622715118464:12345-192.168.204.12@tcp:35:lhsmtool_posix.0 Request processed in 382us (601us total) trans 4294967518 rc 0/0 00000100:00100000:3.0:1783965118.217746:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 64 00000100:00100000:2.0:1783965119.023286:0:3323:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783965119.023322:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743fb9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3323:1870622732923392:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783965119.023407:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783965119.024082:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732923392 00000100:00100000:0.0:1783965119.024093:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732923392 00000100:00100000:0.0:1783965119.024177:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1783965119.024188:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947307dc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3323:x1870622732923392:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783965119.024271:0:6611:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783965119.024346:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947307dc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3323:x1870622732923392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 159us (938us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965119.024354:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1783965119.024466:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743fb9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3323:1870622732923392:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1783965119.025586:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1783965119.148080:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783965119.356501:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965119.356535:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965119.356561:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965119.356581:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965119.356608:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965119.356919:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715118592 00000100:00100000:3.0:1783965119.356933:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715118592 00000100:00100000:3.0:1783965119.357067:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 295 00000100:00100000:3.0:1783965119.357080:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947405adfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+13:2360:x1870622715118592:12345-192.168.204.12@tcp:400:kworker.0 00000100:00100000:3.0:1783965119.357177:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947405adfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+13:2360:x1870622715118592:12345-192.168.204.12@tcp:400:kworker.0 Request processed in 100us (691us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965119.357186:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 295 00000100:00100000:0.0:1783965119.358642:0:8738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715118976 00000100:00100000:2.0:1783965119.359026:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715118848 00000100:00100000:2.0:1783965119.359042:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715118848 00000100:00100000:2.0:1783965119.359138:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 76 00000100:00100000:2.0:1783965119.359149:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947307dc5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9923189b-eb4a-470c-ab45-969435371000+5:2360:x1870622715118848:12345-192.168.204.12@tcp:400:kworker.0 00000100:00100000:2.0:1783965119.359269:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947307dc5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9923189b-eb4a-470c-ab45-969435371000+5:2360:x1870622715118848:12345-192.168.204.12@tcp:400:kworker.0 Request processed in 121us (2731us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965119.359278:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 76 00000100:00080000:2.0:1783965119.359304:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783965119.359377:0:8738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715118976 00000100:00100000:0.0:1783965119.359476:0:8738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 77 00000100:00100000:0.0:1783965119.359486:0:8738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947425979f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9923189b-eb4a-470c-ab45-969435371000+7:2360:x1870622715118976:12345-192.168.204.12@tcp:400:kworker.0 00000100:00100000:0.0:1783965119.359522:0:8738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947425979f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9923189b-eb4a-470c-ab45-969435371000+7:2360:x1870622715118976:12345-192.168.204.12@tcp:400:kworker.0 Request processed in 39us (2912us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965119.359529:0:8738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 77 00000100:00100000:0.0:1783965119.359564:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715119104 00000100:00100000:0.0:1783965119.359569:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715119104 00000100:00100000:0.0:1783965119.359604:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715118720 00000100:00100000:0.0:1783965119.359608:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715118720 00000100:00100000:0.0:1783965119.359638:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 153 00000100:00100000:0.0:1783965119.359645:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947307dc7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49bbacc1-b013-4591-8d15-02f4f0d1884e+5:2360:x1870622715119104:12345-192.168.204.12@tcp:400:kworker.0 00000100:00100000:0.0:1783965119.359691:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947307dc7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49bbacc1-b013-4591-8d15-02f4f0d1884e+5:2360:x1870622715119104:12345-192.168.204.12@tcp:400:kworker.0 Request processed in 46us (3128us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965119.359698:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 153 00000100:00100000:0.0:1783965119.359711:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 154 00000100:00100000:0.0:1783965119.359718:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947307dc4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9923189b-eb4a-470c-ab45-969435371000+30:2360:x1870622715118720:12345-192.168.204.12@tcp:400:kworker.0 00000100:00100000:0.0:1783965119.359755:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947307dc4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:9923189b-eb4a-470c-ab45-969435371000+30:2360:x1870622715118720:12345-192.168.204.12@tcp:400:kworker.0 Request processed in 37us (3172us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965119.359761:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 154 00000100:00080000:2.0:1783965119.361517:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1783965119.361528:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:1.0:1783965119.925912:0:12445:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1783965119.925921:0:12445:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1783965119.925969:0:12445:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1783965119.925975:0:12445:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1783965120.109871:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965120.109925:0:12356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715119360 00000100:00100000:2.0:1783965120.109936:0:12356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715119360 00000100:00100000:2.0:1783965120.110021:0:12356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 236 00000100:00100000:2.0:1783965120.110032:0:12356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947425978e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9923189b-eb4a-470c-ab45-969435371000+30:11617:x1870622715119360:12345-192.168.204.12@tcp:101:lfs.0 00010000:00010000:2.0:1783965120.110054:0:12356:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783965120.110080:0:12356:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947425974e00/0xe782b916994fe3e8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5f02e3 expref: -99 pid: 12356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965120.110293:0:12356:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff947425974600/0xe782b916994fe3ef lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 12356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965120.110309:0:12356:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947425974600/0xe782b916994fe3ef lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 12356 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965120.110322:0:12356:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947425974600/0xe782b916994fe3ef lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 12356 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783965120.110336:0:12356:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1783965120.110487:0:12356:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947425974e00/0xe782b916994fe3e8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f02e3 expref: 33 pid: 12356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965120.110506:0:12356:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff947425974600/0xe782b916994fe3ef lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f02e3 expref: 32 pid: 12356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965120.110524:0:12356:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff947402a2d300) 00010000:00010000:2.0:1783965120.110527:0:12356:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1783965120.110530:0:12356:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff947425974600, rc 0) 00000100:00100000:2.0:1783965120.110594:0:12356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947425978e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9923189b-eb4a-470c-ab45-969435371000+32:11617:x1870622715119360:12345-192.168.204.12@tcp:101:lfs.0 Request processed in 563us (746us total) trans 4294967519 rc 0/0 00000100:00100000:2.0:1783965120.110601:0:12356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 236 00000100:00100000:1.0:1783965120.114482:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965120.114519:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715119488 00000100:00100000:1.0:1783965120.114529:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715119488 00000100:00100000:1.0:1783965120.114575:0:6632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 237 00000100:00100000:1.0:1783965120.114586:0:6632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743fb98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9923189b-eb4a-470c-ab45-969435371000+32:11617:x1870622715119488:12345-192.168.204.12@tcp:54:lfs.0 00010000:00010000:1.0:1783965120.114664:0:6632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efe00/0xe782b916994fe3fd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965120.114684:0:6632:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efe00/0xe782b916994fe3fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965120.114696:0:6632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efe00/0xe782b916994fe3fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965120.114733:0:6632:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efe00/0xe782b916994fe3fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965120.114740:0:6632:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efe00/0xe782b916994fe3fd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965120.114748:0:6632:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efe00/0xe782b916994fe3fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965120.114754:0:6632:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743d9efe00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1783965120.114758:0:6632:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efe00/0xe782b916994fe3fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965120.114766:0:6632:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efe00/0xe782b916994fe3fd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965120.114777:0:6632:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff947402a2d300) 00010000:00010000:1.0:1783965120.114780:0:6632:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1783965120.114784:0:6632:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efe00/0xe782b916994fe3fd lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965120.114791:0:6632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efe00/0xe782b916994fe3fd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6632 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783965120.114862:0:6632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743fb98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9923189b-eb4a-470c-ab45-969435371000+32:11617:x1870622715119488:12345-192.168.204.12@tcp:54:lfs.0 Request processed in 278us (390us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965120.114870:0:6632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 237 00010000:00010000:1.0:1783965120.172092:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783965120.178634:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965120.178744:0:11945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715119616 00000100:00100000:1.0:1783965120.178756:0:11945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715119616 00000100:00100000:1.0:1783965120.178833:0:11945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 72 00000100:00100000:1.0:1783965120.178843:0:11945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94742597bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9923189b-eb4a-470c-ab45-969435371000+7:2359:x1870622715119616:12345-192.168.204.12@tcp:101:cat.0 00010000:00010000:1.0:1783965120.178863:0:11945:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783965120.178886:0:11945:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007169540f/0xe782b916994fe404 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5f02ea expref: -99 pid: 11945 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1783965120.178914:0:11945:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a5525bc, atime: 0x6a5525bb, ctime: 0x6a5525bc, blocks: 0xb 00010000:00010000:1.0:1783965120.178935:0:11945:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=354s v=(0 0) 00010000:00010000:1.0:1783965120.178940:0:11945:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783965120.178949:0:11945:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007169540f/0xe782b916994fe404 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f02ea expref: 8 pid: 11945 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965120.178966:0:11945:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000007169540f/0xe782b916994fe404 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f02ea expref: 8 pid: 11945 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965120.178978:0:11945:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94743d9efe00, rc 0) 00000100:00100000:1.0:1783965120.179043:0:11945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94742597bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9923189b-eb4a-470c-ab45-969435371000+8:2359:x1870622715119616:12345-192.168.204.12@tcp:101:cat.0 Request processed in 202us (419us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965120.179050:0:11945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 72 00000100:00100000:2.0:1783965120.184535:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965120.184776:0:6614:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715119744 00000100:00100000:1.0:1783965120.184787:0:6614:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715119744 00002000:00100000:1.0:1783965120.184839:0:6614:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff94743e29bb80 x1870622715119744/t0(0) o3->9923189b-eb4a-470c-ab45-969435371000@192.168.204.12@tcp:546/0 lens 488/0 e 0 to 0 dl 1783965131 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783965120.184849:0:6614:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff94743e29bb80 with x1870622715119744 ext(0->4095) 00002000:00010000:1.0:1783965120.184855:0:6614:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff94743e29bb80 00000100:00100000:1.0:1783965120.184907:0:6614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 7 00000100:00100000:1.0:1783965120.185108:0:6614:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e29bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9923189b-eb4a-470c-ab45-969435371000+8:2360:x1870622715119744:12345-192.168.204.12@tcp:3:cat.0 00000100:00100000:1.0:1783965120.185508:0:6614:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e29bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:9923189b-eb4a-470c-ab45-969435371000+8:2360:x1870622715119744:12345-192.168.204.12@tcp:3:cat.0 Request processed in 402us (981us total) trans 0 rc 4096/4096 00000100:00100000:1.0:1783965120.185517:0:6614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 7 00002000:00100000:1.0:1783965120.185524:0:6614:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff94743e29bb80 x1870622715119744/t0(0) o3->9923189b-eb4a-470c-ab45-969435371000@192.168.204.12@tcp:546/0 lens 488/4536 e 0 to 0 dl 1783965131 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1783965120.185533:0:6614:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff94743e29bb80 with x1870622715119744 ext(0->4095) 00002000:00010000:1.0:1783965120.185537:0:6614:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff94743e29bb80 00010000:00010000:2.0:1783965121.199128:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1783965121.657521:0:6637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000100:00100000:3.0:1783965122.091607:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743fb99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ae0997f7-3a15-4fc6-865a-35b2f101956e:3323:1870622732923520:0@lo:400:kworker.0 00000100:00100000:1.0:1783965122.091633:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743fb9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3322:1870622732923904:0@lo:400:kworker.0 00000100:00100000:0.0:1783965122.091738:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743fb98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3325:1870622732923776:0@lo:400:kworker.0 00000100:00100000:1.0:1783965122.093143:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783965122.093302:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783965122.093313:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743fb98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3322:1870622732924032:0@lo:400:kworker.0 00000100:00100000:1.0:1783965122.093376:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783965122.093409:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732924032 00000100:00100000:1.0:1783965122.093417:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732924032 00000100:00100000:1.0:1783965122.093476:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1783965122.093487:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e611f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3322:x1870622732924032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783965122.093541:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e611f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3322:x1870622732924032:12345-0@lo:400:kworker.0 Request processed in 57us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965122.093548:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:1.0:1783965122.093567:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783965122.093593:0:3322:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:1.0:1783965122.093598:0:3322:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff94743fb90e00, transno 4294967310 00000100:00100000:1.0:1783965122.093610:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743fb98000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3322:1870622732924032:0@lo:400:kworker.0 00000100:00100000:1.0:1783965122.093877:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743648ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3324:1870622732923648:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783965122.093907:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783965122.093935:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947436e39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3324:1870622732924160:0@lo:400:kworker.0 00000100:00100000:1.0:1783965122.093955:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783965122.095238:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783965122.095311:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732923648 00000100:00100000:0.0:1783965122.095311:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783965122.095322:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732923648 00000100:00100000:1.0:1783965122.095394:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1783965122.095404:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e611880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3324:x1870622732923648:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783965122.095438:0:6611:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783965122.095487:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e611880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3324:x1870622732923648:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (1579us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965122.095493:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1783965122.097195:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732923520 00000100:00100000:3.0:1783965122.097231:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732923520 00000100:00100000:3.0:1783965122.097279:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:3.0:1783965122.097293:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947405add850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae0997f7-3a15-4fc6-865a-35b2f101956e+19:3323:x1870622732923520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783965122.097510:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732923904 00000100:00100000:2.0:1783965122.097517:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732923904 00000100:00100000:2.0:1783965122.097559:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732924160 00000100:00100000:2.0:1783965122.097562:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732924160 00000100:00100000:2.0:1783965122.097593:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1783965122.097600:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e2a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3322:x1870622732923904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783965122.100891:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e2a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3322:x1870622732923904:12345-0@lo:400:kworker.0 Request processed in 3279us (7740us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965122.100909:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1783965122.100946:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732923776 00000100:00100000:2.0:1783965122.100954:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732923776 00000100:00100000:2.0:1783965122.100996:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1783965122.101005:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743fb98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3324:x1870622732924160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783965122.101063:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743fb98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3324:x1870622732924160:12345-0@lo:400:kworker.0 Request processed in 61us (7107us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965122.101070:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1783965122.101088:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1783965122.101113:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743fb9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3325:x1870622732923776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783965122.101141:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743fb9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3325:x1870622732923776:12345-0@lo:400:kworker.0 Request processed in 29us (5833us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965122.101145:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00080000:1.0:1783965122.102125:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1783965122.102134:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783965122.102473:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743648ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3324:1870622732923648:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783965122.102498:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947436e39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3324:1870622732924160:0@lo:400:kworker.0 00000100:00100000:1.0:1783965122.102554:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743fb9a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3322:1870622732923904:0@lo:400:kworker.0 00000100:00100000:3.0:1783965122.103197:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947405add850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae0997f7-3a15-4fc6-865a-35b2f101956e+19:3323:x1870622732923520:12345-0@lo:400:kworker.0 Request processed in 5902us (7969us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965122.103228:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:3.0:1783965122.104970:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743fb99c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ae0997f7-3a15-4fc6-865a-35b2f101956e:3323:1870622732923520:0@lo:400:kworker.0 00000100:00100000:0.0:1783965122.109943:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743fb98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3325:1870622732923776:0@lo:400:kworker.0 00000100:00100000:0.0:1783965122.109964:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947436e3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3325:1870622732924288:0@lo:400:kworker.0 00000100:00100000:0.0:1783965122.110025:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783965122.110076:0:6609:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732924288 00000100:00100000:0.0:1783965122.110082:0:6609:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732924288 00000100:00100000:0.0:1783965122.110953:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1783965122.110967:0:6609:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743fb9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3325:x1870622732924288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783965122.111036:0:6609:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743fb9d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3325:x1870622732924288:12345-0@lo:400:kworker.0 Request processed in 72us (1010us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965122.111055:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1783965122.112142:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947436e3ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3325:1870622732924288:0@lo:400:kworker.0 00000001:00080000:2.0:1783965122.191604:0:7523:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00000001:00080000:2.0:1783965122.191623:0:7523:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967323 is committed 00000001:00080000:2.0:1783965122.202599:0:5835:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967516 is committed 00000001:00080000:2.0:1783965122.202629:0:5835:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:2.0:1783965122.202642:0:5835:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:2.0:1783965122.202667:0:5835:0:(update_trans.c:58:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9474258aac00 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:2.0:1783965122.202672:0:5835:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff947425875900 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9474258aa600 00000020:00080000:2.0:1783965122.202675:0:5835:0:(update_trans.c:66:top_multiple_thandle_dump()) st ffff947425875100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff94743d9c3400 00000020:00080000:0.0:1783965122.202733:0:5846:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:0.0:1783965122.202963:0:5846:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00010000:00010000:1.0:1783965122.219552:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783965123.248697:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783965124.139607:0:3323:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1783965124.139642:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743fb9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3323:1870622732924416:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783965124.139725:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783965124.143385:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732924416 00000100:00100000:0.0:1783965124.143401:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732924416 00000100:00100000:0.0:1783965124.143564:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1783965124.143574:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743648ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3323:x1870622732924416:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783965124.143615:0:6611:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783965124.143698:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743648ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3323:x1870622732924416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 127us (3974us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965124.143705:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1783965124.148598:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743fb9c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3323:1870622732924416:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1783965124.153686:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1783965124.267390:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783965124.480052:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965124.480111:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965124.480139:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965124.480153:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965124.480171:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965124.480230:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715120128 00000100:00100000:1.0:1783965124.480249:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715120128 00000100:00100000:1.0:1783965124.480301:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715120256 00000100:00100000:1.0:1783965124.480304:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715120256 00000100:00100000:1.0:1783965124.480336:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 80 00000100:00100000:1.0:1783965124.480346:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743fb9a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9923189b-eb4a-470c-ab45-969435371000+5:2358:x1870622715120128:12345-192.168.204.12@tcp:400:kworker.0 00000100:00100000:1.0:1783965124.480452:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743fb9a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9923189b-eb4a-470c-ab45-969435371000+5:2358:x1870622715120128:12345-192.168.204.12@tcp:400:kworker.0 Request processed in 107us (339us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965124.480460:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 80 00000100:00100000:1.0:1783965124.480478:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 81 00000100:00100000:1.0:1783965124.480484:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436e3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9923189b-eb4a-470c-ab45-969435371000+7:2358:x1870622715120256:12345-192.168.204.12@tcp:400:kworker.0 00000100:00100000:1.0:1783965124.480511:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436e3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:9923189b-eb4a-470c-ab45-969435371000+7:2358:x1870622715120256:12345-192.168.204.12@tcp:400:kworker.0 Request processed in 26us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965124.480517:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 81 00000100:00080000:1.0:1783965124.480533:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783965124.480537:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783965124.480603:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715119872 00000100:00100000:0.0:1783965124.480607:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715119872 00000100:00100000:0.0:1783965124.480644:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 297 00000100:00100000:0.0:1783965124.480651:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947405adf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+13:2358:x1870622715119872:12345-192.168.204.12@tcp:400:kworker.0 00000100:00100000:0.0:1783965124.480677:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947405adf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+13:2358:x1870622715119872:12345-192.168.204.12@tcp:400:kworker.0 Request processed in 28us (638us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965124.480683:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 297 00000100:00100000:2.0:1783965124.484630:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715120384 00000100:00100000:2.0:1783965124.484651:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715120384 00000100:00100000:2.0:1783965124.484723:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715120000 00000100:00100000:2.0:1783965124.484727:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715120000 00000100:00100000:2.0:1783965124.484754:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 158 00000100:00100000:2.0:1783965124.484764:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743fb98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49bbacc1-b013-4591-8d15-02f4f0d1884e+5:2358:x1870622715120384:12345-192.168.204.12@tcp:400:kworker.0 00000100:00100000:2.0:1783965124.484842:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743fb98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:49bbacc1-b013-4591-8d15-02f4f0d1884e+5:2358:x1870622715120384:12345-192.168.204.12@tcp:400:kworker.0 Request processed in 79us (4701us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965124.484850:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 158 00000100:00100000:2.0:1783965124.484867:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 159 00000100:00100000:2.0:1783965124.484874:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743fb99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9923189b-eb4a-470c-ab45-969435371000+19:2358:x1870622715120000:12345-192.168.204.12@tcp:400:kworker.0 00000100:00100000:2.0:1783965124.484900:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743fb99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:9923189b-eb4a-470c-ab45-969435371000+19:2358:x1870622715120000:12345-192.168.204.12@tcp:400:kworker.0 Request processed in 27us (4745us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965124.484916:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 159 00000100:00080000:2.0:1783965124.485112:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1783965125.294787:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1783965125.420930:0:11561:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1783965125.420944:0:11561:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1783965125.424084:0:11561:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:3.0:1783965125.424109:0:11561:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1783965125.494859:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965125.495055:0:12356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715120512 00000100:00100000:1.0:1783965125.495066:0:12356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715120512 00000100:00100000:1.0:1783965125.495132:0:12356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 238 00000100:00100000:1.0:1783965125.495142:0:12356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e299180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9923189b-eb4a-470c-ab45-969435371000+19:11270:x1870622715120512:12345-192.168.204.12@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1783965125.495310:0:12356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e299180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:9923189b-eb4a-470c-ab45-969435371000+19:11270:x1870622715120512:12345-192.168.204.12@tcp:60:lhsmtool_posix.0 Request processed in 159us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965125.495319:0:12356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 238 00000100:00100000:2.0:1783965125.499014:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965125.499160:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715120768 00000100:00100000:3.0:1783965125.499172:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715120768 00000100:00100000:3.0:1783965125.499278:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 65 00000100:00100000:3.0:1783965125.499288:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e299880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9923189b-eb4a-470c-ab45-969435371000+19:11270:x1870622715120768:12345-192.168.204.12@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1783965125.501381:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e299880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9923189b-eb4a-470c-ab45-969435371000+20:11270:x1870622715120768:12345-192.168.204.12@tcp:35:lhsmtool_posix.0 Request processed in 2085us (2369us total) trans 4294967520 rc 0/0 00000100:00100000:3.0:1783965125.501396:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 65 00000100:00100000:3.0:1783965125.938719:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965125.938838:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715120896 00000100:00100000:2.0:1783965125.938848:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715120896 00000100:00100000:2.0:1783965125.938912:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 239 00000100:00100000:2.0:1783965125.938921:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743d9c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49bbacc1-b013-4591-8d15-02f4f0d1884e+5:12068:x1870622715120896:12345-192.168.204.12@tcp:101:lsof.0 00010000:00010000:2.0:1783965125.938942:0:5812:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783965125.938991:0:5812:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947425975800/0xe782b916994fe40b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5f02f1 expref: -99 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965125.939074:0:5812:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff947425975a00/0xe782b916994fe412 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965125.939088:0:5812:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947425975a00/0xe782b916994fe412 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965125.939100:0:5812:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947425975a00/0xe782b916994fe412 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783965125.939993:0:5812:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1783965125.940000:0:5812:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:2.0:1783965125.940101:0:5812:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff947425975a00/0xe782b916994fe412 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5812 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965125.940133:0:5812:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947425975800/0xe782b916994fe40b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f02f1 expref: 7 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965125.940169:0:5812:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff947425975a00/0xe782b916994fe412 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f02f1 expref: 6 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965125.940176:0:5812:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94740b97a600) 00010000:00010000:2.0:1783965125.940179:0:5812:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783965125.940183:0:5812:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff947425975a00, rc 0) 00000100:00100000:2.0:1783965125.940378:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743d9c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:49bbacc1-b013-4591-8d15-02f4f0d1884e+6:12068:x1870622715120896:12345-192.168.204.12@tcp:101:lsof.0 Request processed in 1456us (1667us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965125.940389:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 239 00010000:00010000:0.0:1783965126.316362:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783965127.214984:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743d9cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3323:1870622732924544:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783965127.215059:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783965127.215298:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732924544 00000100:00100000:3.0:1783965127.215306:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732924544 00000100:00100000:3.0:1783965127.215375:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1783965127.215385:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743fb9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3323:x1870622732924544:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783965127.215421:0:6611:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783965127.215472:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743fb9fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3323:x1870622732924544:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (412us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965127.215479:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1783965127.215523:0:3323:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:3.0:1783965127.215529:0:3323:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff947307dc7480, transno 4294967322 00000004:00080000:3.0:1783965127.215541:0:3323:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:3.0:1783965127.215570:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743d9cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3323:1870622732924544:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1783965127.216051:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783965127.219542:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947436e39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ae0997f7-3a15-4fc6-865a-35b2f101956e:3324:1870622732924672:0@lo:400:kworker.0 00000100:00100000:0.0:1783965127.219607:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947436e74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3325:1870622732924800:0@lo:400:kworker.0 00000100:00100000:1.0:1783965127.219620:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783965127.220414:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783965127.220471:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732924800 00000100:00100000:0.0:1783965127.220478:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732924800 00000100:00100000:0.0:1783965127.220521:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1783965127.220531:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743fb9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3325:x1870622732924800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783965127.221407:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743fb9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3325:x1870622732924800:12345-0@lo:400:kworker.0 Request processed in 874us (989us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965127.221417:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1783965127.221468:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947436e74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3325:1870622732924800:0@lo:400:kworker.0 00000100:00100000:0.0:1783965127.221525:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743fb90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3322:1870622732924928:0@lo:400:kworker.0 00000100:00100000:2.0:1783965127.221653:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732924672 00000100:00100000:2.0:1783965127.221659:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732924672 00000100:00100000:2.0:1783965127.221692:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:2.0:1783965127.221699:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947405adf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae0997f7-3a15-4fc6-865a-35b2f101956e+19:3324:x1870622732924672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783965127.221735:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947405adf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae0997f7-3a15-4fc6-865a-35b2f101956e+19:3324:x1870622732924672:12345-0@lo:400:kworker.0 Request processed in 37us (2117us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965127.221742:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:0.0:1783965127.221766:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783965127.221800:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783965127.221807:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743fb93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3322:1870622732925056:0@lo:400:kworker.0 00000100:00100000:1.0:1783965127.221923:0:12356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732924928 00000100:00100000:1.0:1783965127.221927:0:12356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732924928 00000100:00100000:1.0:1783965127.221968:0:12356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1783965127.221975:0:12356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743fb9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3322:x1870622732924928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783965127.222009:0:12356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743fb9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:lustre-MDT0000-lwp-OST0000_UUID+5:3322:x1870622732924928:12345-0@lo:400:kworker.0 Request processed in 34us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965127.222015:0:12356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00080000:1.0:1783965127.222115:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783965127.222143:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947436e39c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ae0997f7-3a15-4fc6-865a-35b2f101956e:3324:1870622732924672:0@lo:400:kworker.0 00000100:00100000:1.0:1783965127.222151:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743fb93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3324:1870622732925184:0@lo:400:kworker.0 00000100:00100000:1.0:1783965127.222178:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783965127.222367:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732925184 00000100:00100000:1.0:1783965127.222372:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732925184 00000100:00100000:1.0:1783965127.222403:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1783965127.222411:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9474368d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3324:x1870622732925184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783965127.222425:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783965127.222459:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9474368d5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3324:x1870622732925184:12345-0@lo:400:kworker.0 Request processed in 49us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965127.222460:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743fb90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3322:1870622732924928:0@lo:400:kworker.0 00000100:00100000:1.0:1783965127.222472:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00080000:1.0:1783965127.222493:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783965127.222498:0:11945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732925056 00000100:00100000:0.0:1783965127.222503:0:11945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732925056 00000100:00100000:1.0:1783965127.222516:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743fb93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3324:1870622732925184:0@lo:400:kworker.0 00000100:00080000:1.0:1783965127.222544:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783965127.222559:0:11945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1783965127.222568:0:11945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743fb9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3322:x1870622732925056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783965127.222620:0:11945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743fb9ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3322:x1870622732925056:12345-0@lo:400:kworker.0 Request processed in 53us (195us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965127.222627:0:11945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1783965127.222657:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743fb93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3322:1870622732925056:0@lo:400:kworker.0 00000020:00080000:1.0:1783965127.275062:0:5835:0:(update_trans.c:1348:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000001:00080000:1.0:1783965127.275093:0:5835:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:0.0:1783965127.275153:0:5846:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:0.0:1783965127.275165:0:5846:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:2.0:1783965127.339397:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783965128.363466:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783965129.259656:0:3324:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783965129.259682:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743fb9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3324:1870622732925312:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783965129.259763:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783965129.259912:0:6611:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732925312 00000100:00100000:3.0:1783965129.259920:0:6611:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732925312 00000100:00100000:3.0:1783965129.260005:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1783965129.260015:0:6611:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9474368d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3324:x1870622732925312:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783965129.260049:0:6611:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783965129.260107:0:6611:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9474368d7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3324:x1870622732925312:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965129.260114:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1783965129.260238:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743fb9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3324:1870622732925312:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1783965129.260410:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1783965129.391158:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783965129.604076:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965129.604127:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965129.604170:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783965129.604342:0:8738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715121280 00000100:00100000:0.0:1783965129.604353:0:8738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715121280 00000100:00100000:0.0:1783965129.604414:0:8738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 83 00000100:00100000:0.0:1783965129.604424:0:8738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743d9cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9923189b-eb4a-470c-ab45-969435371000+5:2359:x1870622715121280:12345-192.168.204.12@tcp:400:kworker.0 00000100:00100000:0.0:1783965129.604515:0:8738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743d9cb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9923189b-eb4a-470c-ab45-969435371000+5:2359:x1870622715121280:12345-192.168.204.12@tcp:400:kworker.0 Request processed in 92us (387us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965129.604523:0:8738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 83 00000100:00080000:0.0:1783965129.604550:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783965129.604800:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715121024 00000100:00100000:1.0:1783965129.604805:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715121024 00000100:00100000:1.0:1783965129.604845:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 299 00000100:00100000:1.0:1783965129.604853:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947405adf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+13:2359:x1870622715121024:12345-192.168.204.12@tcp:400:kworker.0 00000100:00100000:1.0:1783965129.604890:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947405adf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+13:2359:x1870622715121024:12345-192.168.204.12@tcp:400:kworker.0 Request processed in 38us (825us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965129.604897:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 299 00000100:00100000:1.0:1783965129.604934:0:12356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715121536 00000100:00100000:1.0:1783965129.604938:0:12356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715121536 00000100:00100000:1.0:1783965129.604971:0:12356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 163 00000100:00100000:1.0:1783965129.604979:0:12356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743d9c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:49bbacc1-b013-4591-8d15-02f4f0d1884e+6:2359:x1870622715121536:12345-192.168.204.12@tcp:400:kworker.0 00000100:00100000:1.0:1783965129.605011:0:12356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743d9c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:49bbacc1-b013-4591-8d15-02f4f0d1884e+6:2359:x1870622715121536:12345-192.168.204.12@tcp:400:kworker.0 Request processed in 33us (841us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965129.605017:0:12356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 163 00000100:00080000:0.0:1783965129.605197:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783965129.605736:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965129.605773:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783965129.606080:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715121152 00000100:00100000:0.0:1783965129.606086:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715121152 00000100:00100000:0.0:1783965129.606141:0:6632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 164 00000100:00100000:0.0:1783965129.606149:0:6632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743d9c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9923189b-eb4a-470c-ab45-969435371000+19:2359:x1870622715121152:12345-192.168.204.12@tcp:400:kworker.0 00000100:00100000:0.0:1783965129.606249:0:6632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743d9c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9923189b-eb4a-470c-ab45-969435371000+19:2359:x1870622715121152:12345-192.168.204.12@tcp:400:kworker.0 Request processed in 99us (513us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965129.606256:0:6632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 164 00000100:00080000:0.0:1783965129.606275:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783965129.606747:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715121408 00000100:00100000:1.0:1783965129.606751:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715121408 00000100:00100000:1.0:1783965129.606808:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 84 00000100:00100000:1.0:1783965129.606816:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947307dc7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9923189b-eb4a-470c-ab45-969435371000+7:2359:x1870622715121408:12345-192.168.204.12@tcp:400:kworker.0 00000100:00100000:1.0:1783965129.606859:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947307dc7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9923189b-eb4a-470c-ab45-969435371000+7:2359:x1870622715121408:12345-192.168.204.12@tcp:400:kworker.0 Request processed in 43us (1085us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965129.606867:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 84 00000100:00080000:0.0:1783965129.607645:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1783965130.411409:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1783965130.823915:0:12651:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 13:52:08 (1783965128) 00010000:00010000:0.0:1783965131.436369:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783965132.335167:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743648ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3322:1870622732925440:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783965132.335271:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783965132.337418:0:6610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732925440 00000100:00100000:2.0:1783965132.337431:0:6610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732925440 00000100:00100000:2.0:1783965132.337765:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1783965132.337780:0:6610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9474368d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1870622732925440:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783965132.337821:0:6610:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783965132.337915:0:6610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9474368d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1870622732925440:12345-0@lo:13:osp-pre-1-0.0 Request processed in 139us (2644us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965132.337933:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:2.0:1783965132.337962:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783965132.338070:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e29aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3325:1870622732925824:0@lo:400:kworker.0 00000100:00100000:2.0:1783965132.338119:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783965132.338152:0:3325:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783965132.338158:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e298000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3325:1870622732925696:0@lo:400:kworker.0 00000100:00100000:2.0:1783965132.338195:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783965132.341568:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e299f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ae0997f7-3a15-4fc6-865a-35b2f101956e:3323:1870622732925568:0@lo:400:kworker.0 00000100:00100000:1.0:1783965132.341649:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783965132.341720:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e29b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3323:1870622732926080:0@lo:400:kworker.0 00000100:00100000:1.0:1783965132.341757:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783965132.341797:0:3323:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783965132.341807:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e29b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3323:1870622732925952:0@lo:400:kworker.0 00000100:00100000:1.0:1783965132.341839:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783965132.341879:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732925824 00000100:00100000:1.0:1783965132.341888:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732925824 00000100:00100000:1.0:1783965132.341951:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732925696 00000100:00100000:1.0:1783965132.341955:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732925696 00000100:00100000:1.0:1783965132.341973:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732926080 00000100:00100000:1.0:1783965132.341975:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732926080 00000100:00100000:1.0:1783965132.341991:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1783965132.341999:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e298e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3325:x1870622732925824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783965132.342073:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e298e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3325:x1870622732925824:12345-0@lo:400:kworker.0 Request processed in 74us (3952us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965132.342082:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:1.0:1783965132.342104:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1783965132.342112:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436336d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3325:x1870622732925696:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783965132.342148:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436336d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3325:x1870622732925696:12345-0@lo:400:kworker.0 Request processed in 38us (3952us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965132.342155:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1783965132.342180:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1783965132.342187:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9474368d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3323:x1870622732926080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783965132.342248:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9474368d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3323:x1870622732926080:12345-0@lo:400:kworker.0 Request processed in 62us (492us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965132.342256:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:1.0:1783965132.342276:0:11945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732925952 00000100:00100000:1.0:1783965132.342287:0:11945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732925952 00000100:00100000:1.0:1783965132.342319:0:11945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1783965132.342326:0:11945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9474368d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3323:x1870622732925952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783965132.342359:0:11945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9474368d6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3323:x1870622732925952:12345-0@lo:400:kworker.0 Request processed in 33us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965132.342366:0:11945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00080000:1.0:1783965132.342393:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1783965132.342398:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783965132.342430:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e29b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3323:1870622732925952:0@lo:400:kworker.0 00000100:00100000:1.0:1783965132.342442:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e29b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3323:1870622732926080:0@lo:400:kworker.0 00000100:00100000:1.0:1783965132.344750:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743648ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3322:1870622732925440:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1783965132.346290:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732925568 00000100:00100000:3.0:1783965132.346304:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732925568 00000100:00100000:3.0:1783965132.346363:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:3.0:1783965132.346377:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947405adcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae0997f7-3a15-4fc6-865a-35b2f101956e+19:3323:x1870622732925568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783965132.346481:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947405adcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:ae0997f7-3a15-4fc6-865a-35b2f101956e+19:3323:x1870622732925568:12345-0@lo:400:kworker.0 Request processed in 108us (4832us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965132.346490:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:3.0:1783965132.346553:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e299f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:ae0997f7-3a15-4fc6-865a-35b2f101956e:3323:1870622732925568:0@lo:400:kworker.0 00000100:00100000:2.0:1783965132.349443:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e298000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3325:1870622732925696:0@lo:400:kworker.0 00000100:00100000:2.0:1783965132.349465:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e29aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3325:1870622732925824:0@lo:400:kworker.0 00010000:00010000:0.0:1783965132.465919:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783965133.489982:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783965134.379550:0:3325:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783965134.379581:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743fb9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3325:1870622732926208:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783965134.379657:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783965134.379892:0:6610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732926208 00000100:00100000:0.0:1783965134.379900:0:6610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732926208 00000100:00100000:0.0:1783965134.379959:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1783965134.379968:0:6610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743648ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3325:x1870622732926208:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783965134.380004:0:6610:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783965134.380059:0:6610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743648ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3325:x1870622732926208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965134.380067:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1783965134.380499:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743fb9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3325:1870622732926208:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1783965134.385101:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1783965134.509034:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783965134.713802:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783965134.713856:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783965134.713897:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783965134.713931:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783965134.713961:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783965134.713990:0:6632:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715122176 00000100:00100000:0.0:1783965134.714000:0:6632:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715122176 00000100:00100000:0.0:1783965134.714058:0:6632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 168 00000100:00100000:0.0:1783965134.714071:0:6632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743fb9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49bbacc1-b013-4591-8d15-02f4f0d1884e+6:2360:x1870622715122176:12345-192.168.204.12@tcp:400:kworker.0 00000100:00100000:3.0:1783965134.714170:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715121792 00000100:00100000:0.0:1783965134.714173:0:6632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743fb9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:49bbacc1-b013-4591-8d15-02f4f0d1884e+6:2360:x1870622715122176:12345-192.168.204.12@tcp:400:kworker.0 Request processed in 104us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965134.714176:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715121792 00000100:00100000:0.0:1783965134.714185:0:6632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 168 00000100:00100000:0.0:1783965134.714246:0:6632:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 169 00000100:00100000:1.0:1783965134.714309:0:5806:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715121664 00000100:00100000:1.0:1783965134.714313:0:5806:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715121664 00000100:00100000:1.0:1783965134.714345:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 301 00000100:00100000:1.0:1783965134.714351:0:5806:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947405add450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+13:2360:x1870622715121664:12345-192.168.204.12@tcp:400:kworker.0 00000100:00100000:1.0:1783965134.714379:0:5806:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947405add450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+13:2360:x1870622715121664:12345-192.168.204.12@tcp:400:kworker.0 Request processed in 29us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965134.714385:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 301 00000100:00080000:1.0:1783965134.714424:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783965134.714436:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715121920 00000100:00100000:1.0:1783965134.714440:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715121920 00000100:00100000:1.0:1783965134.714468:0:6606:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715122048 00000100:00100000:1.0:1783965134.714471:0:6606:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715122048 00000100:00100000:1.0:1783965134.714492:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 86 00000100:00100000:1.0:1783965134.714499:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743fb9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9923189b-eb4a-470c-ab45-969435371000+5:2360:x1870622715121920:12345-192.168.204.12@tcp:400:kworker.0 00000100:00100000:1.0:1783965134.714544:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743fb9df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9923189b-eb4a-470c-ab45-969435371000+5:2360:x1870622715121920:12345-192.168.204.12@tcp:400:kworker.0 Request processed in 46us (688us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965134.714551:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 86 00000100:00100000:1.0:1783965134.714563:0:6606:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 87 00000100:00100000:1.0:1783965134.714569:0:6606:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743fb9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9923189b-eb4a-470c-ab45-969435371000+7:2360:x1870622715122048:12345-192.168.204.12@tcp:400:kworker.0 00000100:00100000:1.0:1783965134.714594:0:6606:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743fb9ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:9923189b-eb4a-470c-ab45-969435371000+7:2360:x1870622715122048:12345-192.168.204.12@tcp:400:kworker.0 Request processed in 25us (632us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965134.714599:0:6606:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 87 00000100:00080000:1.0:1783965134.714616:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1783965134.714619:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783965134.714817:0:6632:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743fb9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9923189b-eb4a-470c-ab45-969435371000+19:2360:x1870622715121792:12345-192.168.204.12@tcp:400:kworker.0 00000100:00100000:0.0:1783965134.714859:0:6632:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743fb9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:9923189b-eb4a-470c-ab45-969435371000+19:2360:x1870622715121792:12345-192.168.204.12@tcp:400:kworker.0 Request processed in 607us (928us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965134.723228:0:6632:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 169 00000100:00100000:0.0:1783965135.376131:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965135.379438:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715122432 00000100:00100000:3.0:1783965135.379472:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715122432 00000100:00100000:3.0:1783965135.379609:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 66 00000100:00100000:3.0:1783965135.379620:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743fb9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9923189b-eb4a-470c-ab45-969435371000+19:12290:x1870622715122432:12345-192.168.204.12@tcp:35:umount.0 00000100:00100000:3.0:1783965135.380336:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743fb9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9923189b-eb4a-470c-ab45-969435371000+20:12290:x1870622715122432:12345-192.168.204.12@tcp:35:umount.0 Request processed in 715us (4221us total) trans 4294967521 rc 0/0 00000100:00100000:3.0:1783965135.380347:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 66 00000100:00100000:1.0:1783965135.389749:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965135.389926:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715122688 00000100:00100000:2.0:1783965135.389936:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715122688 00000100:00100000:2.0:1783965135.390049:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 67 00000100:00100000:2.0:1783965135.390060:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9474368d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9923189b-eb4a-470c-ab45-969435371000+20:12290:x1870622715122688:12345-192.168.204.12@tcp:35:umount.0 00000100:00100000:2.0:1783965135.391029:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9474368d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9923189b-eb4a-470c-ab45-969435371000+21:12290:x1870622715122688:12345-192.168.204.12@tcp:35:umount.0 Request processed in 967us (1287us total) trans 4294967522 rc 0/0 00000100:00100000:2.0:1783965135.391041:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 67 00000100:00100000:1.0:1783965135.401754:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965135.401957:0:5814:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715122944 00000100:00100000:3.0:1783965135.401968:0:5814:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715122944 00000100:00100000:3.0:1783965135.402072:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 68 00000100:00100000:3.0:1783965135.402082:0:5814:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947406388850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9923189b-eb4a-470c-ab45-969435371000+21:12290:x1870622715122944:12345-192.168.204.12@tcp:35:umount.0 00000100:00100000:3.0:1783965135.408127:0:5814:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947406388850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:9923189b-eb4a-470c-ab45-969435371000+22:12290:x1870622715122944:12345-192.168.204.12@tcp:35:umount.0 Request processed in 6028us (6363us total) trans 4294967523 rc 0/0 00000100:00100000:3.0:1783965135.408140:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 68 00000100:00100000:0.0:1783965135.412550:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965135.413132:0:5815:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715123200 00000100:00100000:2.0:1783965135.413143:0:5815:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715123200 00000100:00100000:2.0:1783965135.413237:0:5815:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 69 00000100:00100000:2.0:1783965135.413247:0:5815:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743fb9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9923189b-eb4a-470c-ab45-969435371000+22:12290:x1870622715123200:12345-192.168.204.12@tcp:35:umount.0 00000100:00100000:2.0:1783965135.414817:0:5815:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743fb9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:9923189b-eb4a-470c-ab45-969435371000+23:12290:x1870622715123200:12345-192.168.204.12@tcp:35:umount.0 Request processed in 1564us (2270us total) trans 4294967524 rc 0/0 00000100:00100000:2.0:1783965135.414830:0:5815:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 69 00000100:00100000:1.0:1783965135.424321:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783965135.424637:0:8738:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715123584 00000100:00100000:0.0:1783965135.424648:0:8738:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715123584 00000100:00100000:0.0:1783965135.424721:0:8738:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 73 00000100:00100000:0.0:1783965135.424732:0:8738:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9474368d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9923189b-eb4a-470c-ab45-969435371000+7:2356:x1870622715123584:12345-192.168.204.12@tcp:9:umount.0 00000020:00000080:0.0:1783965135.424785:0:8738:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe782b916994fd9ca 00000020:00010000:0.0:1783965135.424796:0:8738:0:(genops.c:1942:obd_stale_export_put()) Put export ffff947307df8000: total 0 00000100:00080000:0.0:1783965135.424801:0:8738:0:(import.c:65:import_set_state_nolock()) ffff947307dfc800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1783965135.424849:0:8738:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:1.0:1783965135.424953:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965135.424981:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000020:00010000:3.0:1783965135.425457:0:5801:0:(genops.c:1928:obd_stale_export_get()) Get export ffff947307df8000: total 0 00010000:00010000:3.0:1783965135.425535:0:5801:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff947307df8000, canceled 0 locks, left on hash table 2. 00010000:00010000:3.0:1783965135.425611:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007169540f/0xe782b916994fe404 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f02ea expref: 6 pid: 11945 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965135.425676:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006834d07f/0xe782b916994fdd66 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f011c expref: 5 pid: 6608 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965135.425694:0:5801:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff947307df8000, canceled 2 locks, left on hash table 0. 00010000:00010000:3.0:1783965135.425705:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783965135.425708:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783965135.425710:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783965135.425954:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965135.425996:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715123712 00000100:00100000:1.0:1783965135.426003:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715123712 00000100:00100000:1.0:1783965135.426047:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715123968 00000100:00100000:1.0:1783965135.426051:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715123968 00000100:00100000:1.0:1783965135.426064:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715123840 00000100:00100000:1.0:1783965135.426067:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715123840 00000100:00100000:1.0:1783965135.426080:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 18 00000100:00100000:1.0:1783965135.426087:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947407248450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+15:2357:x1870622715123712:12345-192.168.204.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783965135.426100:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783965135.426129:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff947425974800/0xe782b916994fd428 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5efe7c expref: 15 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965135.426156:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783965135.426311:0:8330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 19 00000100:00100000:2.0:1783965135.426327:0:8330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9474368d5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+14:2357:x1870622715123968:12345-192.168.204.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783965135.426336:0:8330:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783965135.426344:0:8330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94743fb8ea00/0xe782b916994fd674 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5eff47 expref: 14 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965135.426498:0:8330:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783965135.426612:0:8330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9474368d5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+13:2357:x1870622715123968:12345-192.168.204.12@tcp:103:ldlm_bl.0 Request processed in 286us (1628us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965135.426620:0:8330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 19 00000100:00100000:2.0:1783965135.426641:0:8330:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 20 00000100:00100000:2.0:1783965135.426647:0:8330:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9474368d6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+12:2357:x1870622715123840:12345-192.168.204.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783965135.426655:0:8330:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783965135.426664:0:8330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9474420ffc00/0xe782b916994fd3f0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5efe44 expref: 12 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965135.426673:0:8330:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783965135.426695:0:8330:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9474368d6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+11:2357:x1870622715123840:12345-192.168.204.12@tcp:103:ldlm_bl.0 Request processed in 48us (744us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965135.426700:0:8330:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 20 00000100:00100000:0.0:1783965135.427050:0:8738:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9474368d5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:9923189b-eb4a-470c-ab45-969435371000+2:2356:x1870622715123584:12345-192.168.204.12@tcp:9:umount.0 Request processed in 2319us (2739us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965135.427058:0:8738:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 73 00000100:00100000:1.0:1783965135.427975:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947407248450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+10:2357:x1870622715123712:12345-192.168.204.12@tcp:103:ldlm_bl.0 Request processed in 1883us (3017us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965135.427986:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 18 00000100:00100000:1.0:1783965135.459659:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965135.459789:0:11945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715124096 00000100:00100000:2.0:1783965135.459806:0:11945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715124096 00000100:00100000:2.0:1783965135.459896:0:11945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 74 00000100:00100000:2.0:1783965135.459908:0:11945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743fb9b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9923189b-eb4a-470c-ab45-969435371000+5:2356:x1870622715124096:12345-192.168.204.12@tcp:9:umount.0 00000020:00000080:2.0:1783965135.459942:0:11945:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe782b916994fd762 00000100:00080000:2.0:1783965135.459951:0:11945:0:(import.c:65:import_set_state_nolock()) ffff947436b4e000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1783965135.460005:0:11945:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:2.0:1783965135.460358:0:11945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743fb9b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:9923189b-eb4a-470c-ab45-969435371000+2:2356:x1870622715124096:12345-192.168.204.12@tcp:9:umount.0 Request processed in 452us (715us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965135.460367:0:11945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 74 00010000:00010000:1.0:1783965135.460446:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783965135.493695:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965135.493820:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715125120 00000100:00100000:1.0:1783965135.493830:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715125120 00000100:00100000:1.0:1783965135.493906:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 240 00000100:00100000:1.0:1783965135.493916:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436334380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9923189b-eb4a-470c-ab45-969435371000+23:2356:x1870622715125120:12345-192.168.204.12@tcp:39:umount.0 00000020:00000080:1.0:1783965135.493950:0:5813:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe782b916994fd3fe 00000020:00010000:1.0:1783965135.493966:0:5813:0:(genops.c:1942:obd_stale_export_put()) Put export ffff9474059b6000: total 0 00000100:00080000:1.0:1783965135.493970:0:5813:0:(import.c:65:import_set_state_nolock()) ffff9474059b6800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1783965135.493999:0:5813:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000020:00010000:3.0:1783965135.494350:0:5801:0:(genops.c:1928:obd_stale_export_get()) Get export ffff9474059b6000: total 0 00010000:00010000:3.0:1783965135.494382:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783965135.494456:0:5801:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff9474059b6000, canceled 0 locks, left on hash table 14. 00000100:00100000:1.0:1783965135.494483:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436334380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:9923189b-eb4a-470c-ab45-969435371000+22:2356:x1870622715125120:12345-192.168.204.12@tcp:39:umount.0 Request processed in 566us (795us total) trans 4294967525 rc 0/0 00000100:00100000:1.0:1783965135.494495:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 240 00010000:00010000:3.0:1783965135.494523:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94740a90c500) 00010000:00010000:3.0:1783965135.494537:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1783965135.494552:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fc800/0xe782b916994fdde4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f013f expref: 21 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965135.495046:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94740a90c900) 00010000:00010000:1.0:1783965135.495051:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783965135.495060:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e000/0xe782b916994fdc47 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f00cf expref: 20 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965135.495080:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94740a90c900) 00010000:00010000:1.0:1783965135.495093:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783965135.495098:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743e2fd200/0xe782b916994fdd43 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f010e expref: 19 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965135.495151:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9474186e7a00) 00010000:00010000:1.0:1783965135.495154:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1783965135.495158:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27200/0xe782b916994fd738 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5eff71 expref: 18 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965135.495171:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff947402a2d300) 00010000:00010000:1.0:1783965135.495173:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783965135.495176:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27a00/0xe782b916994fe2e5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f029d expref: 17 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965135.495189:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94740b97a600) 00010000:00010000:1.0:1783965135.495191:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783965135.495195:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26800/0xe782b916994fddc8 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0138 expref: 16 pid: 6632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965135.495254:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9474186e7d00) 00010000:00010000:1.0:1783965135.495257:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783965135.495261:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26000/0xe782b916994fd6e4 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5eff5c expref: 15 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965135.495280:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94740a90c900) 00010000:00010000:1.0:1783965135.495282:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1783965135.495286:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee000/0xe782b916994fdd51 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0115 expref: 14 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965135.495301:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff947402a2d300) 00010000:00010000:1.0:1783965135.495303:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783965135.495312:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947425975600/0xe782b916994fe3c5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f02d5 expref: 13 pid: 12356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965135.495326:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff947402a2d300) 00010000:00010000:1.0:1783965135.495328:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1783965135.495332:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947425974600/0xe782b916994fe3ef lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f02e3 expref: 12 pid: 12356 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965135.495345:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff94740a90c900) 00010000:00010000:1.0:1783965135.495348:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1783965135.495351:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947436f27400/0xe782b916994fdd19 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1a/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0107 expref: 11 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965135.495365:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9474186e7500) 00010000:00010000:1.0:1783965135.495368:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1783965135.495371:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26a00/0xe782b916994fd6c8 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5eff55 expref: 10 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965135.495383:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff94740a90c500) 00010000:00010000:1.0:1783965135.495385:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1783965135.495388:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f800/0xe782b916994fe0c3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0211 expref: 9 pid: 5813 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965135.495401:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9474186e7a00) 00010000:00010000:1.0:1783965135.495403:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1783965135.495406:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947436f26600/0xe782b916994fda25 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0043 expref: 8 pid: 5811 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965135.495416:0:5801:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff9474059b6000, canceled 14 locks, left on hash table 0. 00010000:00010000:1.0:1783965135.495453:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783965135.495456:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783965135.495458:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783965135.537274:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1783965135.660122:0:11561:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1783965135.660136:0:11561:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1783965135.660621:0:11561:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:3.0:1783965135.660630:0:11561:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1783965136.560191:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1783965137.048898:0:6637:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 9923189b-eb4a-470c-ab45-969435371000 00000020:00000080:1.0:1783965137.048910:0:6637:0:(genops.c:906:class_export_put()) final put ffff947436b4f000/9923189b-eb4a-470c-ab45-969435371000 00000020:00000080:0.0:1783965137.049046:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff947436b4f000/9923189b-eb4a-470c-ab45-969435371000 for lustre-OST0000 00000020:00000080:0.0:1783965137.049137:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff947436b4e000 for lustre-OST0000 00000100:00100000:2.0:1783965137.453829:0:3324:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783965137.453856:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947436c3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3324:1870622732926336:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783965137.453928:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783965137.454454:0:6610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732926336 00000100:00100000:0.0:1783965137.454463:0:6610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732926336 00000100:00100000:0.0:1783965137.454603:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1783965137.454615:0:6610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436c3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3324:x1870622732926336:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1783965137.454650:0:6610:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783965137.454699:0:6610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436c3c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3324:x1870622732926336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (770us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965137.454706:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:1.0:1783965137.455293:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783965137.455313:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743fb99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ae0997f7-3a15-4fc6-865a-35b2f101956e:3322:1870622732926464:0@lo:400:kworker.0 00000100:00100000:1.0:1783965137.455359:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783965137.455403:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e299f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3322:1870622732926976:0@lo:400:kworker.0 00000100:00100000:1.0:1783965137.455430:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783965137.455451:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783965137.455458:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e299880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3322:1870622732926592:0@lo:400:kworker.0 00000100:00100000:1.0:1783965137.455480:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783965137.456804:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732926464 00000100:00100000:1.0:1783965137.456815:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732926464 00000100:00100000:1.0:1783965137.456869:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:1.0:1783965137.456878:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947405ade050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+19:3322:x1870622732926464:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783965137.458445:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732926976 00000100:00100000:0.0:1783965137.458457:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732926976 00000100:00100000:0.0:1783965137.458507:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732926592 00000100:00100000:0.0:1783965137.458510:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732926592 00000100:00100000:0.0:1783965137.458535:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1783965137.458545:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e29b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3322:x1870622732926976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783965137.463189:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947436c3fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3324:1870622732926336:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1783965137.466364:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783965137.466396:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1783965137.466413:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e29b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3322:x1870622732926592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783965137.468145:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e29b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3322:x1870622732926592:12345-0@lo:400:kworker.0 Request processed in 1730us (12655us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965137.468160:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1783965137.468255:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e299880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3322:1870622732926592:0@lo:400:kworker.0 00000100:00100000:0.0:1783965137.468408:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e298000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3325:1870622732926848:0@lo:400:kworker.0 00000100:00100000:0.0:1783965137.468450:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783965137.468460:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947405ade050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+19:3322:x1870622732926464:12345-0@lo:400:kworker.0 Request processed in 11583us (13099us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965137.468469:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:0.0:1783965137.468489:0:6608:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732926848 00000100:00100000:0.0:1783965137.468495:0:6608:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732926848 00000100:00100000:1.0:1783965137.468506:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743fb99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ae0997f7-3a15-4fc6-865a-35b2f101956e:3322:1870622732926464:0@lo:400:kworker.0 00000100:00080000:1.0:1783965137.468525:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783965137.468549:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1783965137.468556:0:6608:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743fb9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3325:x1870622732926848:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783965137.468598:0:6608:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743fb9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3325:x1870622732926848:12345-0@lo:400:kworker.0 Request processed in 43us (147us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965137.468603:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1783965137.468627:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e298000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3325:1870622732926848:0@lo:400:kworker.0 00000100:00100000:1.0:1783965137.468653:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e29b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3322:x1870622732926976:12345-0@lo:400:kworker.0 Request processed in 10111us (13222us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965137.468660:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:0.0:1783965137.468669:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e299f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3322:1870622732926976:0@lo:400:kworker.0 00000100:00100000:2.0:1783965137.468909:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e29aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3324:1870622732926720:0@lo:400:kworker.0 00000100:00100000:2.0:1783965137.468939:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783965137.469104:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732926720 00000100:00100000:1.0:1783965137.469109:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732926720 00000100:00100000:1.0:1783965137.469163:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1783965137.469171:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436c3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3324:x1870622732926720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783965137.469246:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436c3fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3324:x1870622732926720:12345-0@lo:400:kworker.0 Request processed in 77us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965137.469252:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1783965137.469281:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e29aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3324:1870622732926720:0@lo:400:kworker.0 00000100:00080000:2.0:1783965137.471113:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00100000:1.0:1783965137.523763:0:5835:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 9923189b-eb4a-470c-ab45-969435371000 00000001:00080000:1.0:1783965137.523785:0:5835:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000020:00000080:1.0:1783965137.523808:0:5835:0:(genops.c:906:class_export_put()) final put ffff9474059b6000/9923189b-eb4a-470c-ab45-969435371000 00000020:00000080:1.0:1783965137.523832:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9474059b6000/9923189b-eb4a-470c-ab45-969435371000 for lustre-MDT0000 00000020:00000080:1.0:1783965137.523895:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff9474059b6800 for lustre-MDT0000 00000001:00100000:0.0:1783965137.535713:0:7523:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 9923189b-eb4a-470c-ab45-969435371000 00000020:00000080:0.0:1783965137.535726:0:7523:0:(genops.c:906:class_export_put()) final put ffff947307df8000/9923189b-eb4a-470c-ab45-969435371000 00000020:00000080:1.0:1783965137.536106:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff947307df8000/9923189b-eb4a-470c-ab45-969435371000 for lustre-OST0001 00000020:00000080:1.0:1783965137.536156:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff947307dfc800 for lustre-OST0001 00010000:00010000:1.0:1783965137.580157:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783965137.799698:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965137.799747:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965137.799791:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783965137.799895:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715125376 00000100:00100000:0.0:1783965137.799906:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715125376 00000100:00100000:0.0:1783965137.799972:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715125248 00000100:00100000:0.0:1783965137.799976:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715125248 00000100:00100000:0.0:1783965137.799991:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715125504 00000100:00100000:0.0:1783965137.799993:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715125504 00000100:00100000:0.0:1783965137.800011:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 21 00000100:00100000:0.0:1783965137.800020:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743648d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+12:2359:x1870622715125376:12345-192.168.204.12@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783965137.800036:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783965137.800056:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94743fb8f200/0xe782b916994fd66d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5eff40 expref: 12 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965137.800086:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783965137.800150:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743648d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+11:2359:x1870622715125376:12345-192.168.204.12@tcp:103:ldlm_bl.0 Request processed in 130us (463us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965137.800158:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 21 00000100:00100000:0.0:1783965137.800177:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 22 00000100:00100000:0.0:1783965137.800183:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743648e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+10:2358:x1870622715125248:12345-192.168.204.12@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783965137.800242:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783965137.800252:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94743d9ee600/0xe782b916994fd4d0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5efe91 expref: 10 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965137.800266:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783965137.800286:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743648e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+9:2358:x1870622715125248:12345-192.168.204.12@tcp:103:ldlm_bl.0 Request processed in 103us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965137.800292:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 22 00000100:00100000:0.0:1783965137.800307:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 23 00000100:00100000:0.0:1783965137.800313:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743648c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+8:2358:x1870622715125504:12345-192.168.204.12@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783965137.800321:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783965137.800328:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff947425974200/0xe782b916994fd4d7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5efebb expref: 8 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965137.800336:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783965137.800354:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743648c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+7:2358:x1870622715125504:12345-192.168.204.12@tcp:103:ldlm_bl.0 Request processed in 42us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965137.800359:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 23 00000100:00100000:0.0:1783965137.807860:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965137.811320:0:12356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715125760 00000100:00100000:1.0:1783965137.811336:0:12356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715125760 00000100:00100000:1.0:1783965137.811450:0:12356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 241 00000100:00100000:1.0:1783965137.811461:0:12356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743fb9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:49bbacc1-b013-4591-8d15-02f4f0d1884e+6:2356:x1870622715125760:12345-192.168.204.12@tcp:39:umount.0 00000020:00000080:1.0:1783965137.811504:0:12356:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe782b916994fd4e5 00000020:00010000:1.0:1783965137.811511:0:12356:0:(genops.c:1942:obd_stale_export_put()) Put export ffff947304bd2800: total 0 00000100:00080000:1.0:1783965137.811515:0:12356:0:(import.c:65:import_set_state_nolock()) ffff947304bd7000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1783965137.811548:0:12356:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000020:00010000:3.0:1783965137.811619:0:5801:0:(genops.c:1928:obd_stale_export_get()) Get export ffff947304bd2800: total 0 00010000:00010000:3.0:1783965137.811714:0:5801:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff947304bd2800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1783965137.811772:0:5801:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff94740b97a600) 00010000:00010000:3.0:1783965137.811777:0:5801:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783965137.811791:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947425975a00/0xe782b916994fe412 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f02f1 expref: 5 pid: 5812 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965137.811835:0:5801:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff947304bd2800, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1783965137.811853:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783965137.811857:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783965137.811860:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783965137.812052:0:12356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743fb9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:49bbacc1-b013-4591-8d15-02f4f0d1884e+3:2356:x1870622715125760:12345-192.168.204.12@tcp:39:umount.0 Request processed in 590us (4200us total) trans 4294967526 rc 0/0 00000100:00100000:1.0:1783965137.812063:0:12356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 241 00000100:00080000:2.0:1783965137.812254:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783965137.822111:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965137.830802:0:5807:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715126016 00000100:00100000:1.0:1783965137.830824:0:5807:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715126016 00000100:00100000:2.0:1783965137.834018:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 303 00000100:00100000:2.0:1783965137.834041:0:5807:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947405ade850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+7:2356:x1870622715126016:12345-192.168.204.12@tcp:251:umount.0 00000020:00000080:2.0:1783965137.834125:0:5807:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe782b916994fd3db 00000020:00010000:2.0:1783965137.834137:0:5807:0:(genops.c:1942:obd_stale_export_put()) Put export ffff947304b9a000: total 0 00000100:00080000:2.0:1783965137.834143:0:5807:0:(import.c:65:import_set_state_nolock()) ffff947304b9c000 : changing import state from FULL to CLOSED 00000100:00100000:2.0:1783965137.834457:0:5807:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947405ade850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:56dff3de-fa1d-4c82-b4b6-6be55f741fe3+3:2356:x1870622715126016:12345-192.168.204.12@tcp:251:umount.0 Request processed in 421us (12366us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965137.834467:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 303 00000020:00010000:0.0:1783965137.835957:0:5800:0:(genops.c:1928:obd_stale_export_get()) Get export ffff947304b9a000: total 0 00010000:00010000:0.0:1783965137.835971:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783965137.836045:0:5800:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff947304b9a000, canceled 0 locks, left on hash table 1. 00010000:00010000:0.0:1783965137.836105:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff947425975000/0xe782b916994fd42f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5efe83 expref: 2 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965137.836131:0:5800:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff947304b9a000, canceled 1 locks, left on hash table 0. 00000020:00000080:0.0:1783965137.836163:0:5800:0:(genops.c:906:class_export_put()) final put ffff947304b9a000/56dff3de-fa1d-4c82-b4b6-6be55f741fe3 00010000:00010000:0.0:1783965137.836183:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783965137.836185:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783965137.836187:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1783965137.837451:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff947304b9a000/56dff3de-fa1d-4c82-b4b6-6be55f741fe3 for MGS 00000020:00000080:2.0:1783965137.837623:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff947304b9c000 for MGS 00010000:00010000:3.0:1783965138.604462:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783965139.500073:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743fb9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3323:1870622732927104:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783965139.503438:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783965139.503633:0:6610:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732927104 00000100:00100000:0.0:1783965139.503647:0:6610:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732927104 00000100:00100000:0.0:1783965139.503769:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1783965139.503782:0:6610:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947307dc5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3323:x1870622732927104:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783965139.503835:0:6610:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783965139.503927:0:6610:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947307dc5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3323:x1870622732927104:12345-0@lo:13:osp-pre-0-0.0 Request processed in 148us (501us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965139.503935:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:1.0:1783965139.504478:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783965139.508313:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743fb9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3323:1870622732927104:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1783965139.635302:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1783965139.776073:0:12851:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1783965139.798395:0:12851:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:1.0:1783965139.798454:0:12851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.112@tcp lock: ffff947425975c00/0xe782b916994fd46e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fd475 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965139.798469:0:12851:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.112@tcp lock: ffff947425975c00/0xe782b916994fd46e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xe782b916994fd475 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965139.798477:0:12851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.112@tcp lock: ffff947425975c00/0xe782b916994fd46e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xe782b916994fd475 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965139.798483:0:12851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.112@tcp lock: ffff947425975c00/0xe782b916994fd46e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0xe782b916994fd475 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965139.798507:0:12851:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1783965139.798512:0:12851:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1783965139.798534:0:12851:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1783965139.798538:0:12851:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1783965139.798570:0:12851:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1783965139.798595:0:12851:0:(import.c:65:import_set_state_nolock()) ffff947403dec000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1783965139.798662:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e29aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3321:1870622732927232:0@lo:39:umount.0 00000100:00100000:2.0:1783965139.798777:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1783965139.799388:0:5801:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783965139.799398:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.112@tcp lock: ffff947425975c00/0xe782b916994fd46e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xe782b916994fd475 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965139.799408:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947425975c00 already unused, calling callback (ffffffffc1ca8c20) 10000000:00010000:0.0:1783965139.799412:0:5801:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.112@tcp lock: ffff947425975c00/0xe782b916994fd46e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0xe782b916994fd475 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965139.799421:0:5801:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.112@tcp lock: ffff947425975c00/0xe782b916994fd46e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0xe782b916994fd475 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783965139.799428:0:5801:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.112@tcp lock: ffff947425975c00/0xe782b916994fd46e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0xe782b916994fd475 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783965139.799435:0:5801:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1783965139.799446:0:5801:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1783965139.799449:0:5801:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1783965139.799484:0:5801:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.112@tcp lock: ffff947425975c00/0xe782b916994fd46e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xe782b916994fd475 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965139.799492:0:5801:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783965139.799522:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.112@tcp lock: ffff947425975c00/0xe782b916994fd46e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xe782b916994fd475 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965139.799530:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.112@tcp lock: ffff947425975c00/0xe782b916994fd46e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0xe782b916994fd475 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965139.799543:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783965139.799545:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783965139.799548:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783965139.800004:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743fb9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ae0997f7-3a15-4fc6-865a-35b2f101956e:3324:1870622732927360:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783965139.800061:0:5812:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732927232 00000100:00100000:2.0:1783965139.800067:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783965139.800068:0:5812:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732927232 00000100:00100000:1.0:1783965139.800114:0:5812:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1783965139.800123:0:5812:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436c3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1870622732927232:12345-0@lo:39:umount.0 00000020:00000080:1.0:1783965139.800149:0:5812:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe782b916994fd1ea 00000100:00080000:1.0:1783965139.800156:0:5812:0:(import.c:65:import_set_state_nolock()) ffff947403deb000 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1783965139.800256:0:5812:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436c3e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+1:3321:x1870622732927232:12345-0@lo:39:umount.0 Request processed in 133us (1477us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965139.800263:0:5812:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:1.0:1783965139.800273:0:5812:0:(genops.c:906:class_export_put()) final put ffff947436323000/lustre-MDT0000-lwp-MDT0000_UUID 00000100:00100000:0.0:1783965139.800454:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732927360 00000100:00100000:0.0:1783965139.800460:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732927360 00000100:00100000:0.0:1783965139.800541:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1783965139.800549:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947407295500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ae0997f7-3a15-4fc6-865a-35b2f101956e+19:3324:x1870622732927360:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783965139.800570:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783965139.800591:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff947401482e00/0xe782b916994fd475 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe782b916994fd46e expref: 19 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965139.800614:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00080000:2.0:1783965139.800625:0:3321:0:(import.c:65:import_set_state_nolock()) ffff947403dec000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:2.0:1783965139.800636:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e29aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3321:1870622732927232:0@lo:39:umount.0 00000100:00100000:0.0:1783965139.800642:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947407295500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ae0997f7-3a15-4fc6-865a-35b2f101956e+18:3324:x1870622732927360:12345-0@lo:103:ldlm_bl.0 Request processed in 95us (575us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965139.800648:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000020:00000080:3.0:1783965139.803671:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff947436323000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:3.0:1783965139.803768:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff947403deb000 for lustre-MDT0000 00000100:00080000:1.0:1783965139.807143:0:12851:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1783965139.807152:0:12851:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1783965139.807159:0:12851:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1783965139.808049:0:12851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.112@tcp lock: ffff947401483600/0xe782b916994fd47c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fd483 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965139.808065:0:12851:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.112@tcp lock: ffff947401483600/0xe782b916994fd47c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xe782b916994fd483 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965139.808072:0:12851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.112@tcp lock: ffff947401483600/0xe782b916994fd47c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xe782b916994fd483 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965139.808079:0:12851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.112@tcp lock: ffff947401483600/0xe782b916994fd47c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0xe782b916994fd483 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965139.808104:0:12851:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783965139.808110:0:12851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.112@tcp lock: ffff947401482200/0xe782b916994fd395 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fd39c expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965139.808129:0:12851:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.112@tcp lock: ffff947401482200/0xe782b916994fd395 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe782b916994fd39c expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965139.808135:0:12851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.112@tcp lock: ffff947401482200/0xe782b916994fd395 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xe782b916994fd39c expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965139.808141:0:12851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.112@tcp lock: ffff947401482200/0xe782b916994fd395 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xe782b916994fd39c expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965139.808148:0:12851:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1783965139.808153:0:12851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.112@tcp lock: ffff94743fb8e200/0xe782b916994fd697 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fd69e expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965139.808160:0:12851:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.112@tcp lock: ffff94743fb8e200/0xe782b916994fd697 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe782b916994fd69e expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965139.808166:0:12851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.112@tcp lock: ffff94743fb8e200/0xe782b916994fd697 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xe782b916994fd69e expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965139.808172:0:12851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.112@tcp lock: ffff94743fb8e200/0xe782b916994fd697 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xe782b916994fd69e expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965139.808178:0:12851:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1783965139.808182:0:12851:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.112@tcp lock: ffff947430c11200/0xe782b916994fd149 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fd150 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965139.808188:0:12851:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.112@tcp lock: ffff947430c11200/0xe782b916994fd149 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe782b916994fd150 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965139.808280:0:12851:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.112@tcp lock: ffff947430c11200/0xe782b916994fd149 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xe782b916994fd150 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965139.808287:0:12851:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.112@tcp lock: ffff947430c11200/0xe782b916994fd149 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xe782b916994fd150 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965139.808295:0:12851:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 10000000:01000000:1.0:1783965139.808299:0:12851:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:2.0:1783965139.808321:0:5801:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00000020:01000004:1.0:1783965139.808323:0:12851:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:1.0:1783965139.808327:0:12851:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00010000:00010000:2.0:1783965139.808330:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.112@tcp lock: ffff947401483600/0xe782b916994fd47c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xe782b916994fd483 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:1.0:1783965139.808331:0:12851:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00010000:00010000:2.0:1783965139.808337:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947401483600 already unused, calling callback (ffffffffc1ca8c20) 00000020:00000080:1.0:1783965139.808337:0:12851:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/7 10000000:00010000:2.0:1783965139.808341:0:5801:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.112@tcp lock: ffff947401483600/0xe782b916994fd47c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0xe782b916994fd483 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1783965139.808345:0:12851:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff947304b9b800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00010000:00010000:2.0:1783965139.808349:0:5801:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.112@tcp lock: ffff947401483600/0xe782b916994fd47c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0xe782b916994fd483 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1783965139.808350:0:12851:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff947405903000 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 10000000:00010000:2.0:1783965139.808357:0:5801:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.112@tcp lock: ffff947401483600/0xe782b916994fd47c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0xe782b916994fd483 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00080000:1.0:1783965139.808357:0:12851:0:(genops.c:1840:print_export_data()) lustre-MDT0000: UNLINKED ffff947304bd2800 49bbacc1-b013-4591-8d15-02f4f0d1884e 192.168.204.12@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:1.0:1783965139.808362:0:12851:0:(genops.c:1574:class_disconnect_exports()) OBD device 5 (ffff947429e74d40) has exports, disconnecting them 10000000:01000000:2.0:1783965139.808363:0:5801:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1783965139.808366:0:5801:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00000020:00080000:1.0:1783965139.808366:0:12851:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff947304b9b800), last request at 1783965137 10000000:01000000:2.0:1783965139.808368:0:5801:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 00000020:00000080:1.0:1783965139.808372:0:12851:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe782b916994fd35d 00000100:00080000:1.0:1783965139.808387:0:12851:0:(import.c:65:import_set_state_nolock()) ffff947304b98800 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1783965139.808414:0:5801:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.112@tcp lock: ffff947401483600/0xe782b916994fd47c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xe782b916994fd483 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965139.808420:0:5801:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000020:00080000:1.0:1783965139.808424:0:12851:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff947304b9b800): rc 0 00000020:00000080:1.0:1783965139.808426:0:12851:0:(genops.c:906:class_export_put()) final put ffff947304b9b800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:1.0:1783965139.808436:0:12851:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff947405903000), last request at 1783965137 00000020:00000080:1.0:1783965139.808440:0:12851:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe782b916994fd2a0 00010000:00010000:2.0:1783965139.808441:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.112@tcp lock: ffff947401483600/0xe782b916994fd47c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xe782b916994fd483 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1783965139.808444:0:12851:0:(import.c:65:import_set_state_nolock()) ffff947405902000 : changing import state from FULL to CLOSED 00000020:00080000:1.0:1783965139.808450:0:12851:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff947405903000): rc 0 00000020:00000080:1.0:1783965139.808452:0:12851:0:(genops.c:906:class_export_put()) final put ffff947405903000/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:1.0:1783965139.808458:0:12851:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb07303e27ae0 00000100:00080000:1.0:1783965139.808481:0:12851:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1783965139.808484:0:12851:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:1.0:1783965139.808496:0:12851:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:1.0:1783965139.808551:0:12851:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00010000:00010000:2.0:1783965139.808558:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.112@tcp lock: ffff947401483600/0xe782b916994fd47c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0xe782b916994fd483 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1783965139.808564:0:12851:0:(import.c:65:import_set_state_nolock()) ffff947425afd800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:1.0:1783965139.808575:0:12851:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1783965139.808577:0:12851:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 3 00010000:00010000:2.0:1783965139.808579:0:5801:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1783965139.808583:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.112@tcp lock: ffff947401482200/0xe782b916994fd395 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xe782b916994fd39c expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783965139.808585:0:12851:0:(osp_dev.c:1634:osp_import_event()) got inactive 00010000:00010000:2.0:1783965139.808588:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947401482200 already unused, calling callback (ffffffffc1ca8c20) 10000000:00010000:2.0:1783965139.808591:0:5801:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.112@tcp lock: ffff947401482200/0xe782b916994fd395 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xe782b916994fd39c expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965139.808598:0:5801:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.112@tcp lock: ffff947401482200/0xe782b916994fd395 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xe782b916994fd39c expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783965139.808604:0:5801:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.112@tcp lock: ffff947401482200/0xe782b916994fd395 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xe782b916994fd39c expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783965139.808609:0:5801:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1783965139.808611:0:5801:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1783965139.808613:0:5801:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1783965139.808628:0:5801:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.112@tcp lock: ffff947401482200/0xe782b916994fd395 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xe782b916994fd39c expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965139.808634:0:5801:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00080000:1.0:1783965139.808640:0:12851:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00010000:00010000:2.0:1783965139.808648:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.112@tcp lock: ffff947401482200/0xe782b916994fd395 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xe782b916994fd39c expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1783965139.808648:0:12851:0:(import.c:65:import_set_state_nolock()) ffff947405907800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00010000:00010000:2.0:1783965139.808654:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.112@tcp lock: ffff947401482200/0xe782b916994fd395 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xe782b916994fd39c expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965139.808664:0:5801:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1783965139.808667:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.112@tcp lock: ffff94743fb8e200/0xe782b916994fd697 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xe782b916994fd69e expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965139.808677:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743fb8e200 already unused, calling callback (ffffffffc1ca8c20) 00000020:00080000:1.0:1783965139.808677:0:12851:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff947429e74d40) has no exports 10000000:00010000:2.0:1783965139.808680:0:5801:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.112@tcp lock: ffff94743fb8e200/0xe782b916994fd697 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xe782b916994fd69e expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965139.808687:0:5801:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.112@tcp lock: ffff94743fb8e200/0xe782b916994fd697 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xe782b916994fd69e expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783965139.808693:0:5801:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.112@tcp lock: ffff94743fb8e200/0xe782b916994fd697 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xe782b916994fd69e expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783965139.808698:0:5801:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1783965139.808700:0:5801:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:2.0:1783965139.808701:0:5801:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:2.0:1783965139.808714:0:5801:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.112@tcp lock: ffff94743fb8e200/0xe782b916994fd697 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xe782b916994fd69e expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965139.808721:0:5801:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783965139.808731:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.112@tcp lock: ffff94743fb8e200/0xe782b916994fd697 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xe782b916994fd69e expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965139.808737:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.112@tcp lock: ffff94743fb8e200/0xe782b916994fd697 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0xe782b916994fd69e expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965139.808745:0:5801:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783965139.808747:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.112@tcp lock: ffff947430c11200/0xe782b916994fd149 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xe782b916994fd150 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965139.808752:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947430c11200 already unused, calling callback (ffffffffc1ca8c20) 10000000:00010000:2.0:1783965139.808755:0:5801:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.112@tcp lock: ffff947430c11200/0xe782b916994fd149 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xe782b916994fd150 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965139.808766:0:5801:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.112@tcp lock: ffff947430c11200/0xe782b916994fd149 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xe782b916994fd150 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783965139.808772:0:5801:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.112@tcp lock: ffff947430c11200/0xe782b916994fd149 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xe782b916994fd150 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783965139.808778:0:5801:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:2.0:1783965139.808780:0:5801:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:2.0:1783965139.808782:0:5801:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:2.0:1783965139.808795:0:5801:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.112@tcp lock: ffff947430c11200/0xe782b916994fd149 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xe782b916994fd150 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965139.808800:0:5801:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783965139.808806:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.112@tcp lock: ffff947430c11200/0xe782b916994fd149 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xe782b916994fd150 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965139.808812:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.112@tcp lock: ffff947430c11200/0xe782b916994fd149 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0xe782b916994fd150 expref: -99 pid: 5793 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965139.808823:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783965139.808825:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783965139.808827:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783965139.808848:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743706ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ae0997f7-3a15-4fc6-865a-35b2f101956e:3322:1870622732927744:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783965139.808923:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783965139.808983:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783965139.808990:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743706c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ae0997f7-3a15-4fc6-865a-35b2f101956e:3322:1870622732928000:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783965139.809019:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783965139.809065:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732927744 00000020:00000080:2.0:1783965139.809070:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff947304b9b800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000100:00100000:3.0:1783965139.809073:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732927744 00000020:00000080:2.0:1783965139.809112:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff947405903000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000100:00100000:3.0:1783965139.809126:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732928000 00000100:00100000:3.0:1783965139.809130:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732928000 00000100:00100000:3.0:1783965139.809154:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000020:00000080:2.0:1783965139.809158:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff947304b98800 for lustre-MDT0000 00000100:00100000:3.0:1783965139.809164:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94740724ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ae0997f7-3a15-4fc6-865a-35b2f101956e+19:3322:x1870622732927744:12345-0@lo:103:ldlm_bl.0 00000020:00000080:2.0:1783965139.809167:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff947405902000 for lustre-MDT0000 00010000:00010000:3.0:1783965139.809181:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783965139.809198:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff947430c11600/0xe782b916994fd39c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe782b916994fd395 expref: 19 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783965139.810422:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e299880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3321:1870622732927616:0@lo:9:umount.0 00010000:00010000:3.0:1783965139.810591:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783965139.810606:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783965139.810644:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e29aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3321:1870622732927872:0@lo:9:umount.0 00000100:00100000:3.0:1783965139.810661:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94740724ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ae0997f7-3a15-4fc6-865a-35b2f101956e+18:3322:x1870622732927744:12345-0@lo:103:ldlm_bl.0 Request processed in 1497us (1736us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965139.810674:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1783965139.810675:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783965139.810724:0:11945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732927616 00000100:00100000:2.0:1783965139.810730:0:11945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732927616 00000100:00100000:3.0:1783965139.810737:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1783965139.810747:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743706f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ae0997f7-3a15-4fc6-865a-35b2f101956e+17:3322:x1870622732928000:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783965139.810760:0:5798:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1783965139.810768:0:11945:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732927872 00000100:00100000:2.0:1783965139.810773:0:11945:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732927872 00010000:00010000:3.0:1783965139.810778:0:5798:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff947430c10200/0xe782b916994fd69e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe782b916994fd697 expref: 17 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965139.810794:0:5798:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783965139.810808:0:11945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1783965139.810816:0:11945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743706f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3321:x1870622732927616:12345-0@lo:9:umount.0 00000100:00100000:3.0:1783965139.810835:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743706f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:ae0997f7-3a15-4fc6-865a-35b2f101956e+16:3322:x1870622732928000:12345-0@lo:103:ldlm_bl.0 Request processed in 89us (1816us total) trans 0 rc 0/0 00000020:00000080:2.0:1783965139.810838:0:11945:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe782b916994fd2df 00000100:00100000:3.0:1783965139.810844:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00080000:2.0:1783965139.810848:0:11945:0:(import.c:65:import_set_state_nolock()) ffff94743e4cc800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1783965139.810881:0:11945:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:3.0:1783965139.811075:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743706c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ae0997f7-3a15-4fc6-865a-35b2f101956e:3322:1870622732928000:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783965139.811086:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743706ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ae0997f7-3a15-4fc6-865a-35b2f101956e:3322:1870622732927744:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783965139.812737:0:11945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743706f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+2:3321:x1870622732927616:12345-0@lo:9:umount.0 Request processed in 1915us (2126us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965139.812750:0:11945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1783965139.812773:0:11945:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1783965139.812782:0:11945:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743706df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3321:x1870622732927872:12345-0@lo:9:umount.0 00000020:00000080:2.0:1783965139.812804:0:11945:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe782b916994fd3cd 00000100:00080000:2.0:1783965139.812812:0:11945:0:(import.c:65:import_set_state_nolock()) ffff947304b9f800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1783965139.812837:0:11945:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:2.0:1783965139.813098:0:11945:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743706df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+2:3321:x1870622732927872:12345-0@lo:9:umount.0 Request processed in 318us (2425us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965139.813105:0:11945:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:2.0:1783965139.813128:0:5808:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1783965139.813150:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1783965139.814152:0:3321:0:(import.c:65:import_set_state_nolock()) ffff947425afd800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1783965139.814163:0:3321:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1783965139.814165:0:3321:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1783965139.814171:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e299880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3321:1870622732927616:0@lo:9:umount.0 00000100:00080000:2.0:1783965139.814213:0:3321:0:(import.c:65:import_set_state_nolock()) ffff947405907800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:2.0:1783965139.814224:0:3321:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:2.0:1783965139.814225:0:3321:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1783965139.814228:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e29aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3321:1870622732927872:0@lo:9:umount.0 00000100:00100000:2.0:1783965139.815598:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947407296300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ae0997f7-3a15-4fc6-865a-35b2f101956e:3325:1870622732927488:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783965139.815671:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783965139.815720:0:3325:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783965139.815726:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743706ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ae0997f7-3a15-4fc6-865a-35b2f101956e:3325:1870622732928128:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783965139.815746:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783965139.815776:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783965139.815799:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743fb9c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ae0997f7-3a15-4fc6-865a-35b2f101956e:3324:1870622732927360:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783965139.816049:0:5797:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732927488 00000100:00100000:0.0:1783965139.816058:0:5797:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732927488 00000100:00100000:3.0:1783965139.816154:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732928128 00000100:00100000:3.0:1783965139.816160:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732928128 00000100:00100000:3.0:1783965139.816244:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1783965139.816255:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743706c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ae0997f7-3a15-4fc6-865a-35b2f101956e+17:3325:x1870622732928128:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783965139.816272:0:5799:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783965139.816294:0:5799:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff947430c11c00/0xe782b916994fd150 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe782b916994fd149 expref: 17 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965139.816316:0:5799:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783965139.816371:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743706c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:ae0997f7-3a15-4fc6-865a-35b2f101956e+16:3325:x1870622732928128:12345-0@lo:103:ldlm_bl.0 Request processed in 118us (622us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965139.816380:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1783965139.816473:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1783965139.816481:0:5797:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743706ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ae0997f7-3a15-4fc6-865a-35b2f101956e+15:3325:x1870622732927488:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783965139.816504:0:5797:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783965139.816514:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff947401483400/0xe782b916994fd483 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe782b916994fd47c expref: 15 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965139.816526:0:5797:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783965139.816553:0:5797:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743706ea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:ae0997f7-3a15-4fc6-865a-35b2f101956e+14:3325:x1870622732927488:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (882us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965139.816560:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1783965139.816568:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743706ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ae0997f7-3a15-4fc6-865a-35b2f101956e:3325:1870622732928128:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783965139.816577:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947407296300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ae0997f7-3a15-4fc6-865a-35b2f101956e:3325:1870622732927488:0@lo:103:ldlm_bl.0 00000020:00080000:0.0:1783965139.839817:0:12851:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff947429e74d40) has no exports 00000020:00000080:0.0:1783965139.926051:0:12851:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe782b916994fd1a4 00000020:00000080:0.0:1783965139.926066:0:12851:0:(genops.c:906:class_export_put()) final put ffff94743719c000/lustre-QMT0000_UUID 00000020:01000000:0.0:1783965139.926194:0:12851:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:0.0:1783965139.926290:0:12851:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783965139.926300:0:12851:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1783965139.926305:0:12851:0:(genops.c:1579:class_disconnect_exports()) OBD device 7 (ffff947407223380) has no exports 00000020:00000080:0.0:1783965139.927191:0:12851:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe782b916994fd19d 00000020:00000080:0.0:1783965139.927218:0:12851:0:(genops.c:906:class_export_put()) final put ffff94743fa74800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1783965139.927386:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff94743719c000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:1.0:1783965139.927461:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff94743fa74800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1783965139.927526:0:12851:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783965139.927535:0:12851:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1783965139.927540:0:12851:0:(genops.c:906:class_export_put()) final put ffff94743fa71000/lustre-QMT0000_UUID 00000020:00000080:0.0:1783965139.927542:0:12851:0:(genops.c:865:class_export_destroy()) destroying export ffff94743fa71000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1783965139.927551:0:12851:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00010000:00010000:2.0:1783965140.651440:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783965141.677125:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1783965142.103574:0:6637:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1783965142.103588:0:6637:0:(genops.c:906:class_export_put()) final put ffff94743e4ce800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1783965142.103631:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff94743e4ce800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:0.0:1783965142.103683:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff94743e4cc800 for lustre-OST0000 00000100:00100000:1.0:1783965142.571422:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947307dc5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ae0997f7-3a15-4fc6-865a-35b2f101956e:3325:1870622732928256:0@lo:400:kworker.0 00000100:00100000:3.0:1783965142.571441:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9474368d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3322:1870622732928384:0@lo:400:kworker.0 00000100:00100000:0.0:1783965142.571635:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9474368d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3323:1870622732928512:0@lo:400:kworker.0 00000100:00100000:1.0:1783965142.583672:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783965142.583921:0:5805:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732928256 00000100:00100000:1.0:1783965142.583934:0:5805:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732928256 00000100:00100000:1.0:1783965142.584075:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:1.0:1783965142.584087:0:5805:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947405adc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+14:3325:x1870622732928256:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783965142.584158:0:5805:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947405adc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:ae0997f7-3a15-4fc6-865a-35b2f101956e+14:3325:x1870622732928256:12345-0@lo:400:kworker.0 Request processed in 74us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965142.584167:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:1.0:1783965142.584424:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947307dc5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ae0997f7-3a15-4fc6-865a-35b2f101956e:3325:1870622732928256:0@lo:400:kworker.0 00000100:00100000:3.0:1783965142.586819:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783965142.587722:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783965142.588127:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732928384 00000100:00100000:3.0:1783965142.588141:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732928384 00000100:00100000:3.0:1783965142.588507:0:5813:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732928512 00000100:00100000:3.0:1783965142.588513:0:5813:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732928512 00000100:00100000:3.0:1783965142.588541:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1783965142.588551:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743648d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3322:x1870622732928384:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1783965142.588563:0:5813:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1783965142.588821:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743648d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3322:x1870622732928384:12345-0@lo:400:kworker.0 Request processed in 269us (2006us total) trans 0 rc -107/-107 00000100:00100000:3.0:1783965142.588829:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1783965142.588851:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1783965142.588856:0:5813:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743fb9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3323:x1870622732928512:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1783965142.588861:0:5813:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1783965142.588913:0:5813:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743fb9c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3323:x1870622732928512:12345-0@lo:400:kworker.0 Request processed in 45us (1188us total) trans 0 rc -107/-107 00000100:00100000:3.0:1783965142.588921:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00080000:1.0:1783965142.590531:0:3323:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1783965142.590550:0:3323:0:(import.c:65:import_set_state_nolock()) ffff947304b99800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:1.0:1783965142.590556:0:3323:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1783965142.596800:0:3322:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1783965142.596815:0:3322:0:(import.c:65:import_set_state_nolock()) ffff947304bd5800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1783965142.596823:0:3322:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:3.0:1783965142.596830:0:3322:0:(import.c:65:import_set_state_nolock()) ffff947304bd5800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783965142.596835:0:3322:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 168 00000100:00080000:3.0:1783965142.596846:0:3322:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff947304bd5800 using connection 192.168.204.112@tcp/0@lo 00000100:00100000:3.0:1783965142.600081:0:3322:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94743648e300 x1870622732928640/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783965142.600132:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9474368d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3322:1870622732928384:0@lo:400:kworker.0 00000100:00100000:3.0:1783965142.600347:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743648e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3321:1870622732928640:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1783965142.600551:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783965142.601114:0:5811:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732928640 00000100:00100000:3.0:1783965142.601125:0:5811:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732928640 00000100:00100000:3.0:1783965142.601319:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1783965142.601331:0:5811:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743648c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3321:x1870622732928640:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:3.0:1783965142.601356:0:5811:0:(ldlm_lib.c:1205:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:1.0:1783965142.603801:0:3323:0:(import.c:65:import_set_state_nolock()) ffff947304b99800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783965142.603811:0:3323:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 184 00000100:00080000:1.0:1783965142.603821:0:3323:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff947304b99800 using connection 192.168.204.112@tcp/0@lo 00000100:00100000:1.0:1783965142.603856:0:3323:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94743e299f80 x1870622732928768/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783965142.605321:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9474368d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3323:1870622732928512:0@lo:400:kworker.0 00000100:00100000:3.0:1783965142.633652:0:5811:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743648c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3321:x1870622732928640:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 32312us (33093us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783965142.633670:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1783965142.633733:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e299f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3321:1870622732928768:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:3.0:1783965142.633774:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1783965142.633835:0:3321:0:(import.c:65:import_set_state_nolock()) ffff947304bd5800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783965142.633854:0:3321:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783965142.633858:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743648e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3321:1870622732928640:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:3.0:1783965142.633893:0:12356:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732928768 00000100:00100000:3.0:1783965142.633900:0:12356:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732928768 00000100:00100000:3.0:1783965142.633936:0:12356:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1783965142.633945:0:12356:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9474368d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3321:x1870622732928768:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:3.0:1783965142.633966:0:12356:0:(ldlm_lib.c:1205:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1783965142.636338:0:12356:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9474368d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_004:0+-99:3321:x1870622732928768:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 2383us (2553us total) trans 0 rc -19/-19 00000100:00100000:3.0:1783965142.636650:0:12356:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00080000:3.0:1783965142.636715:0:3321:0:(import.c:65:import_set_state_nolock()) ffff947304b99800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783965142.636721:0:3321:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1783965142.636726:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e299f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3321:1870622732928768:0@lo:38:ptlrpcd_00_01.0 00000001:00100000:1.0:1783965142.645830:0:5835:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 49bbacc1-b013-4591-8d15-02f4f0d1884e 00000001:00080000:1.0:1783965142.645852:0:5835:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:1.0:1783965142.645857:0:5835:0:(genops.c:906:class_export_put()) final put ffff947304bd2800/49bbacc1-b013-4591-8d15-02f4f0d1884e 00000020:00000080:3.0:1783965142.646002:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff947304bd2800/49bbacc1-b013-4591-8d15-02f4f0d1884e for lustre-MDT0000 00000020:00000080:3.0:1783965142.646063:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff947304bd7000 for lustre-MDT0000 00000001:00100000:1.0:1783965142.656494:0:7523:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1783965142.656503:0:7523:0:(genops.c:906:class_export_put()) final put ffff947304b9a800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1783965142.656670:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff947304b9a800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1783965142.656733:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff947304b9f800 for lustre-OST0001 00010000:00010000:2.0:1783965142.701066:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783965143.724162:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783965144.748652:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783965145.772717:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1783965145.963512:0:12851:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff947437112120 - data ffff947438774870/ffff94743e2ef800 00000020:01000000:0.0:1783965145.963688:0:12851:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff947429eda8a0 - data ffff947425c76798/ffff947437192800 00000001:00000004:0.0:1783965145.978167:0:12851:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00080000:2.0:1783965146.128562:0:12851:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1783965146.128571:0:12851:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:2.0:1783965146.128598:0:12851:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1783965146.128601:0:12851:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1783965146.130610:0:6633:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1783965146.130616:0:6633:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:1.0:1783965146.130627:0:6633:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:2.0:1783965146.132225:0:12851:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1783965146.132241:0:12851:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:2.0:1783965146.132256:0:12851:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1783965146.132269:0:12851:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1783965146.132750:0:7972:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1783965146.132756:0:7972:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:0.0:1783965146.132767:0:7972:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:0.0:1783965146.248113:0:12851:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe782b916994fd16c 00000020:00000080:0.0:1783965146.248127:0:12851:0:(genops.c:906:class_export_put()) final put ffff947436322800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1783965146.248478:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff947436322800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1783965146.252179:0:12851:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe782b916994fd181 00000020:00000080:0.0:1783965146.252193:0:12851:0:(genops.c:906:class_export_put()) final put ffff947437198800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1783965146.252483:0:12851:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:0.0:1783965146.252490:0:12851:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783965146.252501:0:12851:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1783965146.252505:0:12851:0:(genops.c:1579:class_disconnect_exports()) OBD device 4 (ffff947429e719c0) has no exports 00000004:01000000:0.0:1783965146.252717:0:12851:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1783965146.252727:0:12851:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe782b916994fd3bf 00000020:00000080:0.0:1783965146.252731:0:12851:0:(genops.c:906:class_export_put()) final put ffff9474059b0800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1783965146.253139:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff947437198800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1783965146.253187:0:12851:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:0.0:1783965146.253192:0:12851:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783965146.253223:0:12851:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1783965146.253226:0:12851:0:(genops.c:1579:class_disconnect_exports()) OBD device 17 (ffff947305034d40) has no exports 00000020:00000080:0.0:1783965146.253235:0:12851:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe782b916994fd3b8 00000020:00000080:0.0:1783965146.253240:0:12851:0:(genops.c:906:class_export_put()) final put ffff947405900000/lustre-MDT0000-osd_UUID 00010000:01000000:0.0:1783965146.254296:0:12851:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:0.0:1783965146.254303:0:12851:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1783965146.254308:0:12851:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:0.0:1783965146.254315:0:12851:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1783965146.254318:0:12851:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1783965146.254684:0:12851:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783965146.254696:0:12851:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1783965146.254716:0:12851:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe782b916994fd2bc 00000020:00000080:0.0:1783965146.254748:0:12851:0:(genops.c:906:class_export_put()) final put ffff9473051eb800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1783965146.254755:0:12851:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:0.0:1783965146.254759:0:12851:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783965146.254764:0:12851:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1783965146.254767:0:12851:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff94743729cd40) has no exports 00000020:00000080:0.0:1783965146.254773:0:12851:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe782b916994fd2ae 00000020:00000080:0.0:1783965146.254776:0:12851:0:(genops.c:906:class_export_put()) final put ffff947425afc000/lustre-MDT0000-osd_UUID 00010000:01000000:0.0:1783965146.255534:0:12851:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:0.0:1783965146.255540:0:12851:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1783965146.255543:0:12851:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:0.0:1783965146.255548:0:12851:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1783965146.255550:0:12851:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1783965146.255579:0:12851:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783965146.255585:0:12851:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1783965146.255636:0:12851:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783965146.255640:0:12851:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1783965146.255645:0:12851:0:(genops.c:906:class_export_put()) final put ffff947436324800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1783965146.255648:0:12851:0:(genops.c:865:class_export_destroy()) destroying export ffff947436324800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1783965146.255654:0:12851:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1783965146.255834:0:12851:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe782b916994fd188 00000020:00000080:0.0:1783965146.255841:0:12851:0:(genops.c:906:class_export_put()) final put ffff94743719b800/lustre-MDD0000_UUID 00000020:01000000:0.0:1783965146.255847:0:12851:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1783965146.255851:0:12851:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783965146.255855:0:12851:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1783965146.255857:0:12851:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff94743729b380) has no exports 00000020:00000080:0.0:1783965146.255876:0:12851:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783965146.255880:0:12851:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1783965146.255884:0:12851:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe782b916994fd18f 00000020:00000080:0.0:1783965146.255887:0:12851:0:(genops.c:906:class_export_put()) final put ffff947437199800/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1783965146.255893:0:12851:0:(tgt_mount.c:187:server_put_mount()) put mount ffff947403dc3000 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1783965146.255896:0:12851:0:(obd_mount.c:710:lustre_put_lsi()) put ffff947403dc3000 3 00000020:01000004:0.0:1783965146.255899:0:12851:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff947403dc3000 from lustre-MDT0000 00000020:00000080:0.0:1783965146.255942:0:12851:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783965146.255945:0:12851:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1783965146.255948:0:12851:0:(genops.c:906:class_export_put()) final put ffff947436327800/lustre-MDT0000_UUID 00000020:00000080:0.0:1783965146.255950:0:12851:0:(genops.c:865:class_export_destroy()) destroying export ffff947436327800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1783965146.255957:0:12851:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1783965146.255989:0:12851:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:0.0:1783965146.255992:0:12851:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1783965146.255995:0:12851:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1783965146.255997:0:12851:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783965146.256000:0:12851:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1783965146.256006:0:12851:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff94741cdba800 ae0997f7-3a15-4fc6-865a-35b2f101956e 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1783965146.256011:0:12851:0:(genops.c:1574:class_disconnect_exports()) OBD device 1 (ffff947429e73380) has exports, disconnecting them 00000020:00080000:0.0:1783965146.256014:0:12851:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff94741cdba800), last request at 1783964918 00000020:00000080:0.0:1783965146.256027:0:12851:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe782b916994fd12d 00000020:00010000:0.0:1783965146.256031:0:12851:0:(genops.c:1942:obd_stale_export_put()) Put export ffff94741cdba800: total 6 00000100:00080000:0.0:1783965146.256035:0:12851:0:(import.c:65:import_set_state_nolock()) ffff94741cdbe800 : changing import state from FULL to CLOSED 00000020:00000080:1.0:1783965146.256189:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9474059b0800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1783965146.256219:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff947405900000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1783965146.256227:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff947405907800 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1783965146.256232:0:36:0:(genops.c:906:class_export_put()) final put ffff947304973800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1783965146.256234:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff947304973800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1783965146.256237:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1783965146.256278:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9473051eb800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1783965146.256288:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff947425afc000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1783965146.256292:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff947425afd800 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1783965146.256296:0:36:0:(genops.c:906:class_export_put()) final put ffff947304977000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1783965146.256298:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff947304977000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1783965146.256301:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1783965146.256402:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff94743719b800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1783965146.256406:0:36:0:(genops.c:906:class_export_put()) final put ffff9474063c0000/lustre-MDD0000_UUID 00000020:00000080:1.0:1783965146.256408:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff9474063c0000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1783965146.256411:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1783965146.256572:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff947437199800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00080000:0.0:1783965146.256839:0:12851:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff94741cdba800): rc 0 00000020:00080000:0.0:1783965146.256844:0:12851:0:(genops.c:1579:class_disconnect_exports()) OBD device 1 (ffff947429e73380) has no exports 00000100:00100000:0.0:1783965146.257295:0:5807:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff947403cf6800:5807] 2 exiting: rc = 0 00000100:00100000:1.0:1783965146.257689:0:5806:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9474258a3200:5806] 1 exiting: rc = 0 00000100:00100000:1.0:1783965146.257750:0:5805:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff94742592d200:5805] 0 exiting: rc = 1 00000100:00100000:0.0:1783965146.257837:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.257845:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.257851:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.257856:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.257862:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.257868:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.257874:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.257881:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.257887:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.257893:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.257899:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.257905:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.257920:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.257939:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.257944:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.257949:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.257955:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.257959:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.257964:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.257970:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.257977:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.257985:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.257990:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.257996:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.258002:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.258008:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.258015:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.258020:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.258025:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.258030:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.258035:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.258040:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.258058:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.258064:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.258069:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.258075:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.258080:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.258085:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.258090:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.258094:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.258100:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.258105:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.258111:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.258116:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.258121:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.258127:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.258133:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.258138:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.258153:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.258158:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.258164:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.258169:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.258174:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.258180:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.258184:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.258190:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.258196:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.258231:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.258238:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.258245:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.258252:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.258257:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.258262:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.258268:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:0.0:1783965146.258894:0:12851:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1783965146.258898:0:12851:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:00010000:2.0:1783965146.263794:0:5801:0:(genops.c:1928:obd_stale_export_get()) Get export ffff94741cdba800: total 0 00010000:00010000:0.0:1783965146.264420:0:5801:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff94741cdba800, canceled 0 locks, left on hash table 8. 00010000:00010000:0.0:1783965146.264458:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff947436f27e00/0xe782b916994fd43d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe782b916994fd436 expref: 9 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965146.264477:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff947425975400/0xe782b916994fd44b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe782b916994fd444 expref: 8 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965146.264491:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff947425975e00/0xe782b916994fd459 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe782b916994fd452 expref: 7 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965146.264503:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff947400031a00/0xe782b916994fd467 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe782b916994fd460 expref: 6 pid: 5806 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965146.264517:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94743fb8ee00/0xe782b916994fd682 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe782b916994fd67b expref: 5 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965146.264544:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff947430c11e00/0xe782b916994fd237 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe782b916994fd230 expref: 4 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965146.264560:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff947430c10000/0xe782b916994fd690 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe782b916994fd689 expref: 3 pid: 5805 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965146.264574:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff947401482a00/0xe782b916994fd491 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0xe782b916994fd48a expref: 2 pid: 5807 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965146.264584:0:5801:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff94741cdba800, canceled 8 locks, left on hash table 0. 00000020:00000080:0.0:1783965146.264598:0:5801:0:(genops.c:906:class_export_put()) final put ffff94741cdba800/ae0997f7-3a15-4fc6-865a-35b2f101956e 00010000:00010000:0.0:1783965146.264627:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783965146.264630:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783965146.264632:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1783965146.264773:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff94741cdba800/ae0997f7-3a15-4fc6-865a-35b2f101956e for MGS 00000020:00000080:2.0:1783965146.264814:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff94741cdbe800 for MGS 00000020:01000000:2.0:1783965146.265163:0:12851:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff94743d9f1c60 - data ffff947425eb35e8/ffff947436b14800 00000020:01000000:2.0:1783965146.265313:0:12851:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff94741d44cd20 - data ffff947412672798/ffff94740951f800 00000020:00000080:2.0:1783965146.265812:0:12851:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe782b916994fd111 00000020:00000080:2.0:1783965146.265821:0:12851:0:(genops.c:906:class_export_put()) final put ffff94740532d000/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1783965146.265837:0:12851:0:(tgt_mount.c:187:server_put_mount()) put mount ffff947403dc3000 from MGS, refs=2 00000020:01000004:2.0:1783965146.265841:0:12851:0:(obd_mount.c:710:lustre_put_lsi()) put ffff947403dc3000 2 00000020:01000004:2.0:1783965146.265844:0:12851:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff947403dc3000 from MGS 00000020:00000080:2.0:1783965146.265874:0:12851:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783965146.265881:0:12851:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:2.0:1783965146.265883:0:12851:0:(genops.c:906:class_export_put()) final put ffff94740532c000/MGS 00000020:00000080:2.0:1783965146.265885:0:12851:0:(genops.c:865:class_export_destroy()) destroying export ffff94740532c000/MGS for MGS 00000020:01000000:2.0:1783965146.265891:0:12851:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:2.0:1783965146.265946:0:12851:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:2.0:1783965146.265950:0:12851:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783965146.265955:0:12851:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1783965146.265960:0:12851:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff947403dea800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1783965146.265966:0:12851:0:(genops.c:1574:class_disconnect_exports()) OBD device 8 (ffff9474259c99c0) has exports, disconnecting them 00000020:00080000:2.0:1783965146.265969:0:12851:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff947403dea800), last request at 1783964919 00000020:00000080:2.0:1783965146.265974:0:12851:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe782b916994fd1dc 00000020:00080000:2.0:1783965146.265983:0:12851:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff947403dea800): rc 0 00000020:00000080:2.0:1783965146.265989:0:12851:0:(genops.c:906:class_export_put()) final put ffff947403dea800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1783965146.266686:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff94740532d000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1783965146.266697:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff947403dea800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1783965146.312843:0:12851:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1783965146.312852:0:12851:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1783965146.312857:0:12851:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1783965146.312934:0:12851:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1783965146.313275:0:12851:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783965146.313286:0:12851:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1783965146.313305:0:12851:0:(obd_mount.c:710:lustre_put_lsi()) put ffff947403dc3000 1 00000020:00000080:2.0:1783965146.313313:0:12851:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe782b916994fd103 00000020:00000080:2.0:1783965146.313321:0:12851:0:(genops.c:906:class_export_put()) final put ffff94740532d800/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1783965146.313645:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff947403dec000 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:1.0:1783965146.313654:0:36:0:(genops.c:906:class_export_put()) final put ffff947436360800/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:1.0:1783965146.313657:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff947436360800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:1.0:1783965146.313672:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000000:2.0:1783965146.313846:0:12851:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1783965146.313852:0:12851:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783965146.313857:0:12851:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1783965146.313861:0:12851:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff9474072219c0) has no exports 00000020:00000080:1.0:1783965146.313963:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff94740532d800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1783965146.424544:0:12851:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783965146.424559:0:12851:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:2.0:1783965146.424565:0:12851:0:(genops.c:906:class_export_put()) final put ffff947403dc0000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1783965146.424569:0:12851:0:(genops.c:865:class_export_destroy()) destroying export ffff947403dc0000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:2.0:1783965146.424576:0:12851:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:2.0:1783965146.424693:0:12851:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff947403dc2000 00000020:01000000:2.0:1783965146.424718:0:12851:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:2.0:1783965146.424722:0:12851:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783965146.424726:0:12851:0:(obd_config.c:955:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1783965146.424730:0:12851:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff947429e70000) has no exports 00000100:00100000:1.0:1783965146.427816:0:5812:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff947429f92e00:5812] 1 exiting: rc = 0 00000100:00100000:2.0:1783965146.427991:0:5813:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff947429f93a00:5813] 2 exiting: rc = 0 00000100:00100000:2.0:1783965146.428134:0:6632:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff947304be3200:6632] 3 exiting: rc = 0 00000100:00100000:3.0:1783965146.428525:0:5811:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff947407211e00:5811] 0 exiting: rc = 1 00000100:00100000:3.0:1783965146.428586:0:12356:0:(service.c:3183:ptlrpc_main()) mdt00_004: service thread [ffff947305c17400:12356] 4 exiting: rc = 0 00000100:00100000:0.0:1783965146.429584:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.429594:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.429600:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.429607:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.429613:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.429622:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.429629:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.429635:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.429641:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.429647:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.429653:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.429658:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.429664:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.429670:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.429691:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.429697:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.429702:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.429707:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.429713:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.429719:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.429726:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.429732:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.429738:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.429743:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.429752:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.429758:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.429763:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.429769:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.429774:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.429780:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.429784:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.429789:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.429794:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.429812:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.429818:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.429824:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.429830:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.429835:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.429840:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.429845:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.429850:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.429855:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.429860:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.429865:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.429871:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.429876:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.429881:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.429886:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.429891:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.429914:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.429920:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.429929:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.429934:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.429939:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.429944:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.429949:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.429953:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.429958:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.429964:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.429969:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.429975:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.429980:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.429985:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.430002:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783965146.436239:0:5815:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9474258a2000:5815] 1 exiting: rc = 0 00000100:00100000:3.0:1783965146.436567:0:5814:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9474258a3800:5814] 0 exiting: rc = 1 00000100:00100000:0.0:1783965146.436853:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.436862:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.436870:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.436877:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.436883:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.436888:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.436895:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.436900:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.436917:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.436924:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.436930:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.436936:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.436943:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.436952:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.436957:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.436963:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.436968:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.436973:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.436979:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.436985:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.437003:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.437008:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.437014:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.437020:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.437025:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.437031:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.437036:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.437057:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.437063:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.437068:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.437074:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.437079:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.437085:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.437091:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.437096:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.437102:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.437108:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.437113:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.437118:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.437123:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.437128:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.437133:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.437138:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.437142:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.437147:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.437152:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.437158:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.437162:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.437168:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.437172:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.437178:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.437184:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.437190:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.437196:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.437241:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.437255:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.437261:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.437266:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.437272:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.437278:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.437284:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.437290:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.437295:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.437301:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.437850:0:5816:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9474258a3e00:5816] 0 exiting: rc = 1 00000100:00100000:0.0:1783965146.437962:0:12328:0:(service.c:3183:ptlrpc_main()) mdt_out00_002: service thread [ffff947308135600:12328] 2 exiting: rc = 0 00000100:00100000:2.0:1783965146.438120:0:5817:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9474073f3600:5817] 1 exiting: rc = 0 00000100:00100000:0.0:1783965146.438313:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.438321:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.438327:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.438333:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.438340:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.438346:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.438352:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.438369:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.438377:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.438385:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.438391:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.438397:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.438417:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.438424:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.438431:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.438437:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.438444:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.438450:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.438456:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.438463:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.438471:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.438477:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.438487:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.438494:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.438526:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.438534:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.438540:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.438546:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.438553:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.438559:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.438565:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.438571:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.438577:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.438582:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.438588:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.438594:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.438616:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.438626:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.438633:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.438638:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.438643:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.438648:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.438654:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.438660:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.438667:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.438673:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.438678:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.438684:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.438703:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.438709:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.438716:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.438722:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.438737:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.438751:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.438761:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.438768:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.438775:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.438780:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.438787:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.438803:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.438828:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.438836:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.438842:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.438849:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.448684:0:5819:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9474073f3e00:5819] 1 exiting: rc = 0 00000100:00100000:3.0:1783965146.448989:0:5818:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff947425923800:5818] 0 exiting: rc = 1 00000100:00100000:0.0:1783965146.449620:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.449628:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.449633:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.449638:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.449643:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.449647:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.449652:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.449657:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.449663:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.449668:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.449674:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.449680:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.449684:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.449688:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.449693:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.449698:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.449703:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.449707:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.449711:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.449716:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.449720:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.449724:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.449730:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.449734:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.449739:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.449745:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.449750:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.449755:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.449761:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.449780:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.449785:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.449790:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.449795:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.449800:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.449805:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.449811:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.449816:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.449821:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.449826:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.449831:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.449836:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.449842:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.449847:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.449851:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.449855:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.449860:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.449865:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.449870:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.449875:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.449880:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.449885:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.449890:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.449894:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.449898:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.449915:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.449921:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.449927:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.449932:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.449937:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.449943:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.449948:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.449952:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.449957:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.449962:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.450433:0:5820:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9474073f3400:5820] 0 exiting: rc = 1 00000100:00100000:0.0:1783965146.450516:0:5821:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9474073f2800:5821] 1 exiting: rc = 0 00000100:00100000:0.0:1783965146.450563:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.450569:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.450576:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.450581:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.450587:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.450592:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.450599:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.450604:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.450609:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.450614:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.450619:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.450624:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.450629:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.450635:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.450640:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.450646:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.450652:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.450658:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.450663:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.450669:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.450675:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.450680:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.450686:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.450691:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.450696:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.450701:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.450706:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.450710:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.450714:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.450719:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.450723:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.450727:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.450731:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.450744:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.450749:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.450753:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.450758:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.450762:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.450768:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.450773:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.450778:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.450783:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.450789:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.450794:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.450799:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.450804:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.450810:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.450816:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.450821:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.450826:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.450832:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.450837:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.450842:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.450846:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.450851:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.450856:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.450861:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.450866:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.450871:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.450876:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.450882:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.450886:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.450890:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.450894:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.451223:0:5823:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9474073f2400:5823] 1 exiting: rc = 0 00000100:00100000:3.0:1783965146.451698:0:5822:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9474072bec00:5822] 0 exiting: rc = 1 00000100:00100000:0.0:1783965146.452032:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.452284:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.452290:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.452306:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.452310:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.452314:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.452332:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.452337:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.452341:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.452346:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.452351:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.452356:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.452469:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.452480:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.452485:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.452489:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.452494:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.452499:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.452503:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.452508:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.452512:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.452517:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.452521:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.452525:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.452529:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.452534:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.452538:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.452543:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.452548:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.452552:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.452558:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.452563:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.452567:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.452572:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.452577:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.452582:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.452586:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.452590:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.452603:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.452608:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.452614:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.452619:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.452624:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.452629:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.452634:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.452638:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.452643:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.452649:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.452654:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.452659:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.452663:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.452668:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.452672:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.452677:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.452682:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.452686:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.452690:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.452694:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.452700:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.452704:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.452709:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.452714:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.452719:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.452724:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965146.453955:0:5824:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9474259e1400:5824] 0 exiting: rc = 1 00000100:00100000:2.0:1783965146.454476:0:5826:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9474259e0200:5826] 2 exiting: rc = 0 00000100:00100000:3.0:1783965146.454680:0:5825:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9474259e0800:5825] 1 exiting: rc = 0 00000100:00100000:0.0:1783965146.454891:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.454899:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.454912:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.454918:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.454923:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.454929:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.454936:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.454942:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.454963:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.454984:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.454988:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.454993:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.454998:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.455003:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.455008:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.455013:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.455019:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.455024:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.455029:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.455034:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.455051:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.455057:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.455063:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.455068:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.455073:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.455079:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.455083:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.455088:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.455093:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.455099:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.455104:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.455110:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.455128:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.455135:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.455140:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.455145:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.455151:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.455156:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.455163:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.455168:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.455173:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.455178:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.455184:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.455190:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.455231:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.455237:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.455242:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.455248:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.455254:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.455259:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.455264:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.455271:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.455278:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.455283:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.455288:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.455294:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.455314:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.455333:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.455339:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.455345:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.455351:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.455356:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.455529:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965146.455535:0:12851:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1783965146.464150:0:12851:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783965146.464168:0:12851:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:0.0:1783965146.464174:0:12851:0:(genops.c:906:class_export_put()) final put ffff94740532f000/MDS_uuid 00000020:00000080:0.0:1783965146.464179:0:12851:0:(genops.c:865:class_export_destroy()) destroying export ffff94740532f000/MDS_uuid for MDS 00000020:01000000:0.0:1783965146.464190:0:12851:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:0.0:1783965146.464564:0:12851:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:2.0:1783965146.796262:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1783965147.694853:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783965147.694863:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783965147.694867:0:36:0:(import.c:65:import_set_state_nolock()) ffff947304bd5800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783965147.694887:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 376 00000100:00080000:0.0:1783965147.694894:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1783965147.694904:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff947304bd5800 using connection 192.168.204.112@tcp/0@lo 00000100:00100000:0.0:1783965147.694938:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94743fb9f100 x1870622732929024/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783965147.694972:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1783965147.694977:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1783965147.694979:0:36:0:(import.c:65:import_set_state_nolock()) ffff947304b99800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783965147.694984:0:36:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 376 00000100:00080000:0.0:1783965147.694987:0:36:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:0.0:1783965147.694992:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff947304b99800 using connection 192.168.204.112@tcp/0@lo 00000100:00100000:0.0:1783965147.695010:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94743fb9dc00 x1870622732929152/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783965147.695080:0:3325:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1783965147.695105:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743fb9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ae0997f7-3a15-4fc6-865a-35b2f101956e:3325:1870622732928896:0@lo:400:kworker.0 00000400:00000100:0.0:1783965147.695174:0:3325:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870622732928896 offset 0 length 224: 4 00000100:00100000:0.0:1783965147.695285:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743fb9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3321:1870622732929024:0@lo:38:kworker.0 00000400:00000100:0.0:1783965147.695311:0:3321:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1870622732929024 offset 0 length 520: 4 00000100:00100000:0.0:1783965147.695328:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743fb9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3321:1870622732929152:0@lo:38:kworker.0 00000400:00000100:0.0:1783965147.695346:0:3321:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1870622732929152 offset 0 length 520: 4 00010000:00010000:0.0:1783965147.872887:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783965148.907616:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783965149.932518:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1783965150.176508:0:13003:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1783965150.188392:0:13003:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:1.0:1783965150.188467:0:13003:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.112@tcp lock: ffff947400031600/0xe782b916994fd452 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fd459 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965150.188486:0:13003:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.112@tcp lock: ffff947400031600/0xe782b916994fd452 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xe782b916994fd459 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965150.188494:0:13003:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.112@tcp lock: ffff947400031600/0xe782b916994fd452 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xe782b916994fd459 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965150.188519:0:13003:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.112@tcp lock: ffff947400031600/0xe782b916994fd452 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0xe782b916994fd459 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965150.188535:0:13003:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1783965150.188542:0:13003:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1783965150.188573:0:13003:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1783965150.188587:0:13003:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff94743fb9f100 x1870622732929024/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1783965162 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00010000:00010000:2.0:1783965150.188597:0:5800:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:1.0:1783965150.188609:0:13003:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:1.0:1783965150.188617:0:13003:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00010000:00010000:2.0:1783965150.188618:0:5800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.112@tcp lock: ffff947400031600/0xe782b916994fd452 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xe782b916994fd459 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1783965150.188624:0:13003:0:(import.c:65:import_set_state_nolock()) ffff947304bd5800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1783965150.188631:0:13003:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00010000:00010000:2.0:1783965150.188633:0:5800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947400031600 already unused, calling callback (ffffffffc1ca8c20) 00000100:00100000:1.0:1783965150.188636:0:13003:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff94743fb9f100 x1870622732929024/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1783965162 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:00010000:2.0:1783965150.188640:0:5800:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.112@tcp lock: ffff947400031600/0xe782b916994fd452 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0xe782b916994fd459 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965150.188665:0:5800:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.112@tcp lock: ffff947400031600/0xe782b916994fd452 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0xe782b916994fd459 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783965150.188673:0:5800:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.112@tcp lock: ffff947400031600/0xe782b916994fd452 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0xe782b916994fd459 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783965150.188680:0:5800:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1783965150.188683:0:5800:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1783965150.188686:0:5800:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1783965150.188747:0:5800:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.112@tcp lock: ffff947400031600/0xe782b916994fd452 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xe782b916994fd459 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965150.188754:0:5800:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783965150.188786:0:5800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.112@tcp lock: ffff947400031600/0xe782b916994fd452 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xe782b916994fd459 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965150.188795:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.112@tcp lock: ffff947400031600/0xe782b916994fd452 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0xe782b916994fd459 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965150.188810:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783965150.188812:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783965150.188814:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783965150.188825:0:3324:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783965150.188856:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743706ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ae0997f7-3a15-4fc6-865a-35b2f101956e:3324:1870622732929280:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1783965150.188955:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783965150.189430:0:13003:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1783965150.189436:0:13003:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 16s for inflight to error out 00000100:00100000:0.0:1783965150.190570:0:5799:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732929280 00000100:00100000:0.0:1783965150.190587:0:5799:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732929280 00000100:00100000:0.0:1783965150.190709:0:5799:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1783965150.190721:0:5799:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743706e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3324:x1870622732929280:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1783965150.190730:0:5799:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1783965150 with bad export cookie 16682099476446302509 00000100:00100000:3.0:1783965150.192044:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743fb9f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3321:1870622732929024:0@lo:38:kworker.0 00010000:00010000:1.0:1783965150.194735:0:13003:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.112@tcp lock: ffff947401483000/0xe782b916994fd460 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fd467 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965150.194761:0:13003:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.112@tcp lock: ffff947401483000/0xe782b916994fd460 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xe782b916994fd467 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965150.194768:0:13003:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.112@tcp lock: ffff947401483000/0xe782b916994fd460 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xe782b916994fd467 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965150.194775:0:13003:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.112@tcp lock: ffff947401483000/0xe782b916994fd460 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0xe782b916994fd467 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965150.194847:0:13003:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783965150.194858:0:13003:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.112@tcp lock: ffff94743fb8e600/0xe782b916994fd689 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fd690 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965150.194866:0:13003:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.112@tcp lock: ffff94743fb8e600/0xe782b916994fd689 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe782b916994fd690 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965150.194872:0:13003:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.112@tcp lock: ffff94743fb8e600/0xe782b916994fd689 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xe782b916994fd690 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965150.194880:0:13003:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.112@tcp lock: ffff94743fb8e600/0xe782b916994fd689 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xe782b916994fd690 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965150.194918:0:13003:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1783965150.194923:0:13003:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:1.0:1783965150.194958:0:13003:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:1.0:1783965150.194964:0:13003:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:1.0:1783965150.194970:0:13003:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1783965150.194978:0:13003:0:(obd_config.c:955:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1783965150.194984:0:13003:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff9474372999c0) has no exports 00000020:00080000:1.0:1783965150.195027:0:13003:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff9474372999c0) has no exports 00010000:00010000:3.0:1783965150.196294:0:5801:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783965150.196309:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.112@tcp lock: ffff947401483000/0xe782b916994fd460 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xe782b916994fd467 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965150.196358:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947401483000 already unused, calling callback (ffffffffc1ca8c20) 10000000:00010000:3.0:1783965150.196363:0:5801:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.112@tcp lock: ffff947401483000/0xe782b916994fd460 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0xe782b916994fd467 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965150.196374:0:5801:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.112@tcp lock: ffff947401483000/0xe782b916994fd460 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0xe782b916994fd467 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783965150.196383:0:5801:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.112@tcp lock: ffff947401483000/0xe782b916994fd460 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0xe782b916994fd467 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783965150.196390:0:5801:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1783965150.196393:0:5801:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:3.0:1783965150.196397:0:5801:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:3.0:1783965150.196456:0:5801:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.112@tcp lock: ffff947401483000/0xe782b916994fd460 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xe782b916994fd467 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965150.196463:0:5801:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783965150.196502:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.112@tcp lock: ffff947401483000/0xe782b916994fd460 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xe782b916994fd467 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965150.196510:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.112@tcp lock: ffff947401483000/0xe782b916994fd460 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0xe782b916994fd467 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965150.196532:0:5801:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783965150.196538:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.112@tcp lock: ffff94743fb8e600/0xe782b916994fd689 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xe782b916994fd690 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965150.196545:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743fb8e600 already unused, calling callback (ffffffffc1ca8c20) 10000000:00010000:3.0:1783965150.196547:0:5801:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.112@tcp lock: ffff94743fb8e600/0xe782b916994fd689 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xe782b916994fd690 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965150.196563:0:5801:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.112@tcp lock: ffff94743fb8e600/0xe782b916994fd689 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xe782b916994fd690 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783965150.196570:0:5801:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.112@tcp lock: ffff94743fb8e600/0xe782b916994fd689 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xe782b916994fd690 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783965150.196576:0:5801:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1783965150.196578:0:5801:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1783965150.196581:0:5801:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1783965150.196600:0:5801:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.112@tcp lock: ffff94743fb8e600/0xe782b916994fd689 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xe782b916994fd690 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965150.196619:0:5801:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783965150.196627:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.112@tcp lock: ffff94743fb8e600/0xe782b916994fd689 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xe782b916994fd690 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965150.196633:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.112@tcp lock: ffff94743fb8e600/0xe782b916994fd689 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0xe782b916994fd690 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965150.196644:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783965150.196646:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783965150.196648:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783965150.196674:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9474368d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ae0997f7-3a15-4fc6-865a-35b2f101956e:3322:1870622732929408:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783965150.196845:0:5799:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743706e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3324:x1870622732929280:12345-0@lo:103:ldlm_bl.0 Request processed in 6109us (7873us total) trans 0 rc -107/-107 00000100:00100000:3.0:1783965150.196849:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783965150.196864:0:5799:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1783965150.196928:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783965150.196936:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9474368d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ae0997f7-3a15-4fc6-865a-35b2f101956e:3322:1870622732929536:0@lo:103:ldlm_bl.0 00000100:00080000:0.0:1783965150.196948:0:3324:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.112@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1783965150.196955:0:3324:0:(import.c:65:import_set_state_nolock()) ffff94740be4b000 MGS: changing import state from FULL to DISCONN 00000100:02020000:0.0:1783965150.196961:0:3324:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.204.112@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00100000:3.0:1783965150.196971:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783965150.197297:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732929408 00000100:00100000:3.0:1783965150.197306:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732929408 00000100:00100000:3.0:1783965150.197712:0:5798:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732929536 00000100:00100000:3.0:1783965150.197718:0:5798:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732929536 00000100:00100000:3.0:1783965150.197736:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1783965150.197745:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9474368d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3322:x1870622732929408:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1783965150.197753:0:5798:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1783965150 with bad export cookie 16682099476446302509 00000100:00100000:3.0:1783965150.197802:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9474368d6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3322:x1870622732929408:12345-0@lo:103:ldlm_bl.0 Request processed in 57us (955us total) trans 0 rc -107/-107 00000100:00100000:3.0:1783965150.197809:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1783965150.197822:0:5798:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1783965150.197826:0:5798:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9474368d4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3322:x1870622732929536:12345-0@lo:103:ldlm_bl.0 00010000:00020000:3.0:1783965150.197840:0:5798:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1783965150 with bad export cookie 16682099476446302509 00000100:00100000:3.0:1783965150.197863:0:5798:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9474368d4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3322:x1870622732929536:12345-0@lo:103:ldlm_bl.0 Request processed in 36us (901us total) trans 0 rc -107/-107 00000100:00100000:3.0:1783965150.197870:0:5798:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:3.0:1783965150.198265:0:3322:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.204.112@tcp of MGS@0@lo abruptly disconnected: reconnecting 00010000:00010000:2.0:1783965150.200111:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1783965150.202777:0:3324:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.204.112@tcp not replayable, auto-deactivating 00000100:00080000:0.0:1783965150.202783:0:3324:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1783965150.202796:0:3324:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff94743fb9ea00 x1870622732928896/t0(0) o400->MGC192.168.204.112@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1783965163 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783965150.202817:0:3324:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff94743706ed80 x1870622732929280/t0(0) o103->MGC192.168.204.112@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1783965166 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783965150.202828:0:3324:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9474368d5180 x1870622732929408/t0(0) o103->MGC192.168.204.112@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1783965166 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783965150.202854:0:3324:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9474368d6a00 x1870622732929536/t0(0) o103->MGC192.168.204.112@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1783965166 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1783965150.202863:0:3324:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1783965150.202867:0:3324:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1783965150.202869:0:3324:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1783965150.203598:0:3322:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff94740be4b000 already not connected (conn 1, was 1): DISCONN 00000100:00080000:0.0:1783965150.203600:0:3324:0:(import.c:65:import_set_state_nolock()) ffff94740be4b000 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1783965150.203612:0:3324:0:(import.c:510:import_select_connection()) MGC192.168.204.112@tcp: connect to NID 0@lo last attempt 152 00000100:00080000:0.0:1783965150.203625:0:3324:0:(import.c:624:import_select_connection()) MGC192.168.204.112@tcp: import ffff94740be4b000 using connection 192.168.204.112@tcp/0@lo 00000100:00100000:3.0:1783965150.203707:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9474368d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ae0997f7-3a15-4fc6-865a-35b2f101956e:3322:1870622732929408:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783965150.203749:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9474368d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:ae0997f7-3a15-4fc6-865a-35b2f101956e:3322:1870622732929536:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783965150.204389:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743fb9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:ae0997f7-3a15-4fc6-865a-35b2f101956e:3325:1870622732928896:0@lo:400:kworker.0 00000100:00100000:0.0:1783965150.204467:0:3324:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94743fb9ea00 x1870622732929664/t0(0) o250->MGC192.168.204.112@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783965150.204503:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743706ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:ae0997f7-3a15-4fc6-865a-35b2f101956e:3324:1870622732929280:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783965150.205073:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743fb9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ae0997f7-3a15-4fc6-865a-35b2f101956e:3321:1870622732929664:0@lo:250:ptlrpcd_00_02.0 00000400:00000100:3.0:1783965150.205138:0:3321:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1870622732929664 offset 0 length 520: 4 00000020:01000000:1.0:1783965150.205442:0:13003:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff94743e42ad20 - data ffff947425f53a20/ffff947305c10c00 00000020:01000000:1.0:1783965150.205605:0:13003:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff947425814780 - data ffff947425e86360/ffff947304bca400 00100000:10000000:1.0:1783965150.224285:0:13003:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1783965150.256667:0:13003:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe782b916994fd253 00000020:00000080:2.0:1783965150.256685:0:13003:0:(genops.c:906:class_export_put()) final put ffff947304975800/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1783965150.256700:0:13003:0:(tgt_mount.c:187:server_put_mount()) put mount ffff94743e519000 from lustre-OST0000, refs=2 00000020:01000004:2.0:1783965150.256704:0:13003:0:(obd_mount.c:710:lustre_put_lsi()) put ffff94743e519000 2 00000020:01000004:2.0:1783965150.256722:0:13003:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff94743e519000 from lustre-OST0000 00000020:00000080:2.0:1783965150.256753:0:13003:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783965150.256767:0:13003:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1783965150.256771:0:13003:0:(genops.c:906:class_export_put()) final put ffff9474414a1000/lustre-OST0000_UUID 00000020:00000080:2.0:1783965150.256774:0:13003:0:(genops.c:865:class_export_destroy()) destroying export ffff9474414a1000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1783965150.256787:0:13003:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1783965150.256851:0:13003:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:2.0:1783965150.256857:0:13003:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1783965150.256862:0:13003:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783965150.256867:0:13003:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1783965150.256876:0:13003:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff947304bd2000 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1783965150.256882:0:13003:0:(genops.c:1574:class_disconnect_exports()) OBD device 12 (ffff9473050319c0) has exports, disconnecting them 00000020:00080000:2.0:1783965150.256887:0:13003:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff947304bd2000), last request at 1783964934 00000020:00000080:2.0:1783965150.256892:0:13003:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe782b916994fd299 00000020:00080000:2.0:1783965150.256902:0:13003:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff947304bd2000): rc 0 00000020:00000080:2.0:1783965150.256908:0:13003:0:(genops.c:906:class_export_put()) final put ffff947304bd2000/lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1783965150.258040:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff947304975800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1783965150.258118:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff947304bd2000/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:3.0:1783965150.258388:0:13003:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:3.0:1783965150.258394:0:13003:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1783965150.258399:0:13003:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1783965150.258524:0:13003:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1783965150.258562:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff947304bd5800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1783965150.259458:0:13003:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783965150.259469:0:13003:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:3.0:1783965150.259475:0:13003:0:(genops.c:906:class_export_put()) final put ffff947304bd7800/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1783965150.259482:0:13003:0:(genops.c:865:class_export_destroy()) destroying export ffff947304bd7800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1783965150.259487:0:13003:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:3.0:1783965150.259543:0:13003:0:(obd_mount.c:710:lustre_put_lsi()) put ffff94743e519000 1 00000020:00000080:3.0:1783965150.259548:0:13003:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe782b916994fd20d 00000020:00000080:3.0:1783965150.259554:0:13003:0:(genops.c:906:class_export_put()) final put ffff9474072b7000/lustre-OST0000-osd_UUID 00000020:01000000:3.0:1783965150.259575:0:13003:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:3.0:1783965150.259579:0:13003:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783965150.259583:0:13003:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1783965150.259587:0:13003:0:(genops.c:1579:class_disconnect_exports()) OBD device 9 (ffff947407220000) has no exports 00000020:00000080:1.0:1783965150.259594:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff9474072b7000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1783965150.277151:0:13003:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783965150.277176:0:13003:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:3.0:1783965150.277183:0:13003:0:(genops.c:906:class_export_put()) final put ffff94743e51b800/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1783965150.277189:0:13003:0:(genops.c:865:class_export_destroy()) destroying export ffff94743e51b800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:3.0:1783965150.277197:0:13003:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:3.0:1783965150.277433:0:13003:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff94743e519800 00000020:02000400:3.0:1783965150.277495:0:13003:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:1.0:1783965150.956707:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783965151.982180:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1783965152.811707:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) ae0997f7-3a15-4fc6-865a-35b2f101956e->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783965152.811718:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) ae0997f7-3a15-4fc6-865a-35b2f101956e->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1783965152.811721:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1783965152.811724:0:37:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:0.0:1783965153.003446:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1783965153.189858:0:13154:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1783965153.218055:0:13154:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:0.0:1783965153.218132:0:13154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.112@tcp lock: ffff947400030a00/0xe782b916994fd436 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fd43d expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965153.218161:0:13154:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.112@tcp lock: ffff947400030a00/0xe782b916994fd436 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe782b916994fd43d expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965153.218169:0:13154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.112@tcp lock: ffff947400030a00/0xe782b916994fd436 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xe782b916994fd43d expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965153.218177:0:13154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.112@tcp lock: ffff947400030a00/0xe782b916994fd436 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0xe782b916994fd43d expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965153.218225:0:13154:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1783965153.218231:0:13154:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1783965153.218253:0:13154:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1783965153.218265:0:13154:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff94743fb9dc00 x1870622732929152/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1783965162 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783965153.218283:0:13154:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:0.0:1783965153.218289:0:13154:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1783965153.218295:0:13154:0:(import.c:65:import_set_state_nolock()) ffff947304b99800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:0.0:1783965153.218299:0:13154:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1783965153.218303:0:13154:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff94743fb9dc00 x1870622732929152/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1783965162 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783965153.218310:0:13154:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:0.0:1783965153.218313:0:13154:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 12s for inflight to error out 00010000:00010000:2.0:1783965153.219016:0:5800:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783965153.219026:0:5800:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.112@tcp lock: ffff947400030a00/0xe782b916994fd436 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xe782b916994fd43d expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965153.219035:0:5800:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947400030a00 already unused, calling callback (ffffffffc1ca8c20) 10000000:00010000:2.0:1783965153.219039:0:5800:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.112@tcp lock: ffff947400030a00/0xe782b916994fd436 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0xe782b916994fd43d expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965153.219049:0:5800:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.112@tcp lock: ffff947400030a00/0xe782b916994fd436 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xe782b916994fd43d expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783965153.219056:0:5800:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.112@tcp lock: ffff947400030a00/0xe782b916994fd436 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xe782b916994fd43d expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783965153.219075:0:5800:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1783965153.219078:0:5800:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1783965153.219080:0:5800:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1783965153.219107:0:5800:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff94740be4b000 00010000:00010000:2.0:1783965153.219112:0:5800:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.112@tcp lock: ffff947400030a00/0xe782b916994fd436 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xe782b916994fd43d expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965153.219118:0:5800:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.112@tcp lock: ffff947400030a00/0xe782b916994fd436 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xe782b916994fd43d expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965153.219130:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783965153.219132:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783965153.219134:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783965153.220171:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743fb9dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3321:1870622732929152:0@lo:38:kworker.0 00010000:00010000:0.0:1783965153.224123:0:13154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.112@tcp lock: ffff947400030e00/0xe782b916994fd444 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fd44b expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965153.224143:0:13154:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.112@tcp lock: ffff947400030e00/0xe782b916994fd444 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe782b916994fd44b expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965153.224171:0:13154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.112@tcp lock: ffff947400030e00/0xe782b916994fd444 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xe782b916994fd44b expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965153.224178:0:13154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.112@tcp lock: ffff947400030e00/0xe782b916994fd444 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0xe782b916994fd44b expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965153.224197:0:13154:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783965153.224233:0:13154:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.112@tcp lock: ffff947436f26c00/0xe782b916994fd67b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fd682 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965153.224240:0:13154:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.112@tcp lock: ffff947436f26c00/0xe782b916994fd67b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe782b916994fd682 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965153.224246:0:13154:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.112@tcp lock: ffff947436f26c00/0xe782b916994fd67b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xe782b916994fd682 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965153.224251:0:13154:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.204.112@tcp lock: ffff947436f26c00/0xe782b916994fd67b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0xe782b916994fd682 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965153.224265:0:13154:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1783965153.224269:0:13154:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:0.0:1783965153.224290:0:13154:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:0.0:1783965153.224295:0:13154:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:0.0:1783965153.224299:0:13154:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783965153.224304:0:13154:0:(obd_config.c:955:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1783965153.224309:0:13154:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff9474259cb380) has no exports 00000020:00080000:0.0:1783965153.224334:0:13154:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff9474259cb380) has no exports 00010000:00010000:1.0:1783965153.229471:0:5801:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783965153.229487:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.112@tcp lock: ffff947400030e00/0xe782b916994fd444 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xe782b916994fd44b expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965153.229502:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947400030e00 already unused, calling callback (ffffffffc1ca8c20) 10000000:00010000:1.0:1783965153.229506:0:5801:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.112@tcp lock: ffff947400030e00/0xe782b916994fd444 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0xe782b916994fd44b expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965153.229516:0:5801:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.112@tcp lock: ffff947400030e00/0xe782b916994fd444 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0xe782b916994fd44b expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783965153.229524:0:5801:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.112@tcp lock: ffff947400030e00/0xe782b916994fd444 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0xe782b916994fd44b expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783965153.229530:0:5801:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1783965153.229533:0:5801:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:1.0:1783965153.229536:0:5801:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:1.0:1783965153.229556:0:5801:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff94740be4b000 00010000:00010000:1.0:1783965153.229563:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.112@tcp lock: ffff947400030e00/0xe782b916994fd444 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xe782b916994fd44b expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965153.229570:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.112@tcp lock: ffff947400030e00/0xe782b916994fd444 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0xe782b916994fd44b expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965153.229596:0:5801:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783965153.229600:0:5801:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.112@tcp lock: ffff947436f26c00/0xe782b916994fd67b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xe782b916994fd682 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965153.229606:0:5801:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947436f26c00 already unused, calling callback (ffffffffc1ca8c20) 10000000:00010000:1.0:1783965153.229609:0:5801:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.112@tcp lock: ffff947436f26c00/0xe782b916994fd67b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0xe782b916994fd682 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965153.229639:0:5801:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.112@tcp lock: ffff947436f26c00/0xe782b916994fd67b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0xe782b916994fd682 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783965153.229646:0:5801:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.112@tcp lock: ffff947436f26c00/0xe782b916994fd67b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0xe782b916994fd682 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783965153.229651:0:5801:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1783965153.229653:0:5801:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1783965153.229655:0:5801:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1783965153.229660:0:5801:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff94740be4b000 00010000:00010000:1.0:1783965153.229675:0:5801:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.112@tcp lock: ffff947436f26c00/0xe782b916994fd67b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xe782b916994fd682 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965153.229680:0:5801:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.112@tcp lock: ffff947436f26c00/0xe782b916994fd67b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0xe782b916994fd682 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965153.229692:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783965153.229694:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783965153.229695:0:5801:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1783965153.229752:0:13154:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff9474371123c0 - data ffff9474387741b0/ffff94743e2ec800 00000020:01000000:0.0:1783965153.229915:0:13154:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff947308132060 - data ffff947438775bd0/ffff947440063800 00010000:00010000:3.0:1783965153.230569:0:5800:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00100000:10000000:0.0:1783965153.252672:0:13154:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1783965153.279871:0:13154:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe782b916994fd32c 00000020:00000080:0.0:1783965153.279882:0:13154:0:(genops.c:906:class_export_put()) final put ffff94743fb6b800/lustre-OST0001-osd_UUID 00000020:01000004:0.0:1783965153.279904:0:13154:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9474369fb000 from lustre-OST0001, refs=2 00000020:01000004:0.0:1783965153.279908:0:13154:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9474369fb000 2 00000020:01000004:0.0:1783965153.279911:0:13154:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9474369fb000 from lustre-OST0001 00000020:00000080:0.0:1783965153.279935:0:13154:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783965153.279945:0:13154:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:0.0:1783965153.279948:0:13154:0:(genops.c:906:class_export_put()) final put ffff94740581a800/lustre-OST0001_UUID 00000020:00000080:0.0:1783965153.279951:0:13154:0:(genops.c:865:class_export_destroy()) destroying export ffff94740581a800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:0.0:1783965153.279959:0:13154:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:0.0:1783965153.280051:0:13154:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import ae0997f7-3a15-4fc6-865a-35b2f101956e->MGS 00010000:00010000:0.0:1783965153.280066:0:13154:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.112@tcp lock: ffff9474420ff400/0xe782b916994fd230 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xe782b916994fd237 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783965153.280077:0:13154:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.112@tcp lock: ffff9474420ff400/0xe782b916994fd230 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xe782b916994fd237 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783965153.280083:0:13154:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:0.0:1783965153.280086:0:13154:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:0.0:1783965153.280089:0:13154:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:0.0:1783965153.280103:0:13154:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff94740be4b000 00010000:00010000:0.0:1783965153.280172:0:13154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.112@tcp lock: ffff9474420ff400/0xe782b916994fd230 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xe782b916994fd237 expref: -99 pid: 6605 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965153.280276:0:13154:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.112@tcp lock: ffff947425975200/0xe782b916994fd48a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0xe782b916994fd491 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783965153.280285:0:13154:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.112@tcp lock: ffff947425975200/0xe782b916994fd48a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0xe782b916994fd491 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783965153.280305:0:13154:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1783965153.280307:0:13154:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:0.0:1783965153.280309:0:13154:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:0.0:1783965153.280320:0:13154:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff94740be4b000 00010000:00010000:0.0:1783965153.280323:0:13154:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.112@tcp lock: ffff947425975200/0xe782b916994fd48a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0xe782b916994fd491 expref: -99 pid: 5809 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1783965153.280342:0:13154:0:(import.c:65:import_set_state_nolock()) ffff94740be4b000 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:0.0:1783965153.280345:0:13154:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1783965153.280348:0:13154:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1783965153.280349:0:13154:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1783965153.280353:0:13154:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1783965153.280363:0:13154:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff94743fb9ea00 x1870622732929664/t0(0) o250->MGC192.168.204.112@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1783965160 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_02.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1783965153.280375:0:13154:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1783965153.280377:0:13154:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 9s for inflight to error out 00000020:00000080:2.0:1783965153.280444:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff94743fb6b800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00100000:3.0:1783965153.280552:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743fb9ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:ae0997f7-3a15-4fc6-865a-35b2f101956e:3321:1870622732929664:0@lo:250:ptlrpcd_00_02.0 10000000:01000000:0.0:1783965153.280825:0:13154:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1783965153.280832:0:13154:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe782b916994fd11f 00000020:00000080:0.0:1783965153.280837:0:13154:0:(genops.c:906:class_export_put()) final put ffff94740532e800/ae0997f7-3a15-4fc6-865a-35b2f101956e 00000020:01000000:0.0:1783965153.280850:0:13154:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.204.112@tcp (flags='') 00000020:00000080:0.0:1783965153.280855:0:13154:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783965153.280860:0:13154:0:(obd_config.c:955:class_cleanup()) MGC192.168.204.112@tcp: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1783965153.280864:0:13154:0:(genops.c:1579:class_disconnect_exports()) OBD device 2 (ffff947407224d40) has no exports 00000020:00000080:2.0:1783965153.280899:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff94740532e800/ae0997f7-3a15-4fc6-865a-35b2f101956e for MGC192.168.204.112@tcp 10000000:01000000:3.0:1783965153.280941:0:5809:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:0.0:1783965153.281024:0:13154:0:(obd_class.h:671:obd_cleanup_client_import()) MGC192.168.204.112@tcp: client import never connected 00000100:00080000:0.0:1783965153.281028:0:13154:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:0.0:1783965153.281030:0:13154:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1783965153.281032:0:13154:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:0.0:1783965153.281034:0:13154:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1783965153.281072:0:13154:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1783965153.281076:0:13154:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.204.112@tcp (uuid ae0997f7-3a15-4fc6-865a-35b2f101956e) 00000020:01000000:0.0:1783965153.281081:0:13154:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1783965153.281089:0:13154:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1783965153.281093:0:13154:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1783965153.281098:0:13154:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff94743fa72800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1783965153.281103:0:13154:0:(genops.c:1574:class_disconnect_exports()) OBD device 16 (ffff947304bf8000) has exports, disconnecting them 00000020:00000080:2.0:1783965153.281225:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff94740be4b000 for MGC192.168.204.112@tcp 00000020:00000080:2.0:1783965153.281231:0:38:0:(genops.c:906:class_export_put()) final put ffff94740be4c000/ae0997f7-3a15-4fc6-865a-35b2f101956e 00000020:00000080:2.0:1783965153.281233:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff94740be4c000/ae0997f7-3a15-4fc6-865a-35b2f101956e for MGC192.168.204.112@tcp 00000020:01000000:2.0:1783965153.281238:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.204.112@tcp (ae0997f7-3a15-4fc6-865a-35b2f101956e) 00000020:00080000:0.0:1783965153.281968:0:13154:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff94743fa72800), last request at 1783964949 00000020:00000080:0.0:1783965153.281976:0:13154:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe782b916994fd356 00000020:00080000:0.0:1783965153.281993:0:13154:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff94743fa72800): rc 0 00000020:00000080:0.0:1783965153.281997:0:13154:0:(genops.c:906:class_export_put()) final put ffff94743fa72800/lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1783965153.282800:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff94743fa72800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:2.0:1783965153.292263:0:13154:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:2.0:1783965153.292274:0:13154:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1783965153.292279:0:13154:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1783965153.292287:0:13154:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1783965153.292469:0:38:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff947304b99800 for lustre-MDT0000-lwp-OST0001 00010000:00010000:0.0:1783965153.314285:0:5801:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:3.0:1783965153.316889:0:5800:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00000100:00100000:3.0:1783965153.317081:0:8328:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_002: service thread [ffff947436f21a00:8328] 2 exiting: rc = 0 00000100:00100000:3.0:1783965153.317140:0:8329:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_003: service thread [ffff947404c22a00:8329] 3 exiting: rc = 0 00000100:00100000:0.0:1783965153.317534:0:5795:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff947425901a00:5795] 0 exiting: rc = 1 00000100:00100000:0.0:1783965153.318313:0:5796:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff947407a9f400:5796] 1 exiting: rc = 0 00000100:00100000:3.0:1783965153.318967:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.319234:0:8330:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff947429ea5000:8330] 3 exiting: rc = 0 00000100:00100000:0.0:1783965153.319279:0:5798:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff947405912c00:5798] 1 exiting: rc = 0 00000100:00100000:3.0:1783965153.319315:0:5797:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff947405912200:5797] 0 exiting: rc = 1 00000100:00100000:0.0:1783965153.319358:0:5799:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff947405913800:5799] 2 exiting: rc = 0 00000100:00100000:3.0:1783965153.319388:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.319398:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.319405:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.319411:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.319418:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.319434:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.319440:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.319447:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.319453:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.319460:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.319465:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.319471:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.319477:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.319483:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.319489:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.319495:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.319503:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.319508:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.319513:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.319517:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.319522:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.319528:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.319533:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.319539:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.319545:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.319576:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.319581:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.319587:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.319592:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.319597:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.319601:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.319608:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.319612:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.319617:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.319622:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.319628:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.319632:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.319636:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.319641:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.319646:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.319652:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.319657:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.319662:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.319667:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.319673:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.319680:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.319686:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.319692:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.319697:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.319703:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.319710:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.319715:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.319721:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.319726:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.319731:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.319736:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.319741:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.319747:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.319752:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.319757:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.319783:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.319789:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.319795:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.319801:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1783965153.322157:0:13154:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1783965153.322172:0:13154:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:3.0:1783965153.322179:0:13154:0:(genops.c:906:class_export_put()) final put ffff947304973000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:3.0:1783965153.322195:0:13154:0:(genops.c:865:class_export_destroy()) destroying export ffff947304973000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:3.0:1783965153.322217:0:13154:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:3.0:1783965153.322279:0:13154:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9474369fb000 1 00000020:00000080:3.0:1783965153.322286:0:13154:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0xe782b916994fd2fb 00000020:00000080:3.0:1783965153.322293:0:13154:0:(genops.c:906:class_export_put()) final put ffff94740532b800/lustre-OST0001-osd_UUID 00000020:01000000:3.0:1783965153.322316:0:13154:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:3.0:1783965153.322321:0:13154:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1783965153.322326:0:13154:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1783965153.322330:0:13154:0:(genops.c:1579:class_disconnect_exports()) OBD device 14 (ffff9474259ccd40) has no exports 00000020:00000080:0.0:1783965153.322848:0:38:0:(genops.c:865:class_export_destroy()) destroying export ffff94740532b800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:2.0:1783965153.356221:0:13154:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783965153.356238:0:13154:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:2.0:1783965153.356244:0:13154:0:(genops.c:906:class_export_put()) final put ffff94740581b000/lustre-OST0001-osd_UUID 00000020:00000080:2.0:1783965153.356259:0:13154:0:(genops.c:865:class_export_destroy()) destroying export ffff94740581b000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:2.0:1783965153.356267:0:13154:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:2.0:1783965153.357087:0:13154:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff94740581a000 00000020:01000000:2.0:1783965153.357118:0:13154:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:2.0:1783965153.357123:0:13154:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1783965153.357128:0:13154:0:(obd_config.c:955:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1783965153.357132:0:13154:0:(genops.c:1579:class_disconnect_exports()) OBD device 10 (ffff947437298000) has no exports 00000020:00000080:2.0:1783965153.357158:0:13154:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1783965153.357169:0:13154:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:2.0:1783965153.357173:0:13154:0:(genops.c:906:class_export_put()) final put ffff9474072b1800/OSS_uuid 00000020:00000080:2.0:1783965153.357176:0:13154:0:(genops.c:865:class_export_destroy()) destroying export ffff9474072b1800/OSS_uuid for OSS 00000020:01000000:2.0:1783965153.357185:0:13154:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:2.0:1783965153.357300:0:11945:0:(service.c:3183:ptlrpc_main()) ll_ost00_004: service thread [ffff947304964c00:11945] 4 exiting: rc = 0 00000100:00080000:3.0:1783965153.357715:0:5808:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:1.0:1783965153.357890:0:6606:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff9474258d4c00:6606] 0 exiting: rc = 1 00000100:00100000:2.0:1783965153.358362:0:6608:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff947436d7a800:6608] 1 exiting: rc = 0 00000100:00100000:2.0:1783965153.358728:0:6609:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff94741d4e3000:6609] 2 exiting: rc = 0 00000100:00100000:2.0:1783965153.358794:0:8738:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff947437148600:8738] 3 exiting: rc = 0 00000100:00100000:3.0:1783965153.360029:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.360040:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.360056:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.360063:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.360068:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.360072:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.360078:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.360082:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.360087:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.360091:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.360096:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.360101:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.360105:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.360110:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.360114:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.360119:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.360123:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.360142:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.360147:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.360152:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.360156:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.360161:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.360165:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.360170:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.360181:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.360187:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.360193:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.360219:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.360227:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.360234:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.360242:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.360466:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.360472:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.360478:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.360483:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.360488:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.360492:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.360497:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.360502:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.360856:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.360867:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.360872:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.360877:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.360883:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.360889:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.360894:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.360899:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.360905:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.360910:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.360914:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.360919:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.360924:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.360941:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.360946:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.360951:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.360957:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.360962:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.360967:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.360972:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.360978:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.361555:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.361561:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.361566:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.361577:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783965153.363602:0:6610:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff94741d4e2a00:6610] 0 exiting: rc = 1 00000100:00100000:3.0:1783965153.364527:0:6611:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff94741d4e3a00:6611] 1 exiting: rc = 0 00000100:00100000:3.0:1783965153.364862:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.364872:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.364878:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.364885:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.364890:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.364895:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.364900:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.364905:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.364911:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.364917:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.364922:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.364928:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.364934:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.365480:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.365494:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.365499:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.365505:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.365698:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.365704:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.365710:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.365715:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.365720:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.365738:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.365743:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.365748:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.365754:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.365759:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.365765:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.365780:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.365787:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.365792:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.365798:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.365803:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.365808:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.365816:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.365822:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.365827:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.365836:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.365842:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.365847:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.365852:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.365858:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.365864:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.365870:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.365875:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.365881:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.365885:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.365890:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.365895:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.365900:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.365905:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.365910:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.365916:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.365921:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.365926:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.365931:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.365936:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.365948:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.365953:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.365957:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.365962:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.365966:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.365971:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1783965153.365976:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1783965153.370858:0:6613:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff947409b14800:6613] 1 exiting: rc = 0 00000100:00100000:1.0:1783965153.371235:0:6614:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff94741d4e2800:6614] 2 exiting: rc = 0 00000100:00100000:0.0:1783965153.372223:0:6612:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff94741d4e3e00:6612] 0 exiting: rc = 1 00000100:00100000:1.0:1783965153.373437:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.373448:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.373454:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.373461:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.373466:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.373472:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.373478:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.373503:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.373510:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.373528:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.373534:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.373539:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.373544:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.373549:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.373554:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.373561:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.373567:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.373572:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.373578:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.373584:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.373589:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.373595:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.373613:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.373620:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.373626:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.373650:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.373670:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.373676:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.373681:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.373687:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.373692:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.373712:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.373718:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.373723:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.373728:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.373733:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.373738:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.373743:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.373748:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.373753:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.373758:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.373763:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.373768:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.373786:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.373799:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.373804:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.373810:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.373816:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.373823:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.373828:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.373834:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.373839:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.373844:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.373849:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.373854:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.373861:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.373866:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.373872:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.373878:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.373884:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.373889:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.373894:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.373899:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.373907:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965153.382578:0:6615:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff94741d4e0600:6615] 0 exiting: rc = 1 00000100:00100000:0.0:1783965153.384591:0:6616:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff94741d4e0000:6616] 1 exiting: rc = 0 00000100:00100000:1.0:1783965153.384731:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.384739:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.384745:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.384750:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.384755:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.384759:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.384783:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.384790:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.384795:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.384800:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.384805:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.384810:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.384815:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.384819:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.384824:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.384841:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.384846:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.384851:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.384863:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.384869:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.384875:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.384879:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.384884:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.384890:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.384894:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.384898:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.384903:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.384908:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.384912:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.384919:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.384935:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.384941:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.384946:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.384952:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.384957:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.384962:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.384967:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.384972:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.384977:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.384989:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.384994:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.385000:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.385005:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.385011:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.385015:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.385022:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.385029:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.385035:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.385041:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.385047:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.385061:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.385066:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.385072:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.385077:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.385082:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.385088:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.385093:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.385098:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.385103:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.385108:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.385112:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.385117:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.385123:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.385128:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1783965153.386169:0:6617:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff947436d7be00:6617] 0 exiting: rc = 1 00000100:00100000:2.0:1783965153.386717:0:6618:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff947436d7a000:6618] 1 exiting: rc = 0 00000100:00100000:1.0:1783965153.387552:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.387563:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.387570:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.387576:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.387582:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.387588:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.387594:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.387600:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.387607:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.387626:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.387635:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.387641:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.387647:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.387653:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.387658:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.387665:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.387672:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.387678:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.387684:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.387691:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.387697:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.387731:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.387738:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.387744:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.387751:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.387759:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.387765:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.387782:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.387789:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.387795:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.387801:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.387808:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.387815:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.387837:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.387844:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.387849:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.387856:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.387862:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.387868:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.387874:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.387880:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.387885:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.387891:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.387898:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.387904:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.388117:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.388124:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.388130:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.388136:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.388141:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.388147:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.388153:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.388160:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.388166:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.388171:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.388177:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.388259:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.388282:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.388290:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.388297:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.388303:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.388310:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.388316:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1783965153.388323:0:13154:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:0.0:1783965153.412010:0:13154:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:2.0:1783965169.636847:0:13768:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg412-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1783965177.313507:0:14181:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1783965177.313513:0:14181:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1783965177.313632:0:14181:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff94743fbe4800 00000020:01000004:3.0:1783965177.313650:0:14181:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1783965177.313658:0:14181:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1783965177.313672:0:14181:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9473050319c0) 00000020:00000080:3.0:1783965177.313684:0:14181:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1783965177.342104:0:14181:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1783965177.344575:0:14181:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:2.0:1783965177.345015:0:14181:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 649: rc = 0 00100000:10000000:2.0:1783965177.345107:0:14181:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 649: rc = 0 00100000:10000000:2.0:1783965177.345196:0:14181:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 649: rc = 0 00100000:10000000:2.0:1783965177.345471:0:14181:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 649: rc = 0 00100000:10000000:2.0:1783965177.345651:0:14181:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1783965177.345724:0:14181:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 649: rc = 0 00100000:10000000:2.0:1783965177.345819:0:14181:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 649: rc = 0 00100000:10000000:2.0:1783965177.346257:0:14181:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 5: rc = 0 00100000:10000000:2.0:1783965177.347716:0:14181:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 788: rc = 0 00100000:10000000:2.0:1783965177.347815:0:14181:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 788: rc = 0 00100000:10000000:2.0:1783965177.348492:0:14181:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 276: rc = 0 00100000:10000000:2.0:1783965177.348737:0:14181:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 276: rc = 0 00100000:10000000:2.0:1783965177.349073:0:14181:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 276: rc = 0 00100000:10000000:2.0:1783965177.349502:0:14181:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 276: rc = 0 00100000:10000000:2.0:1783965177.349733:0:14181:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 276: rc = 0 00100000:10000000:2.0:1783965177.350183:0:14181:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 276: rc = 0 00100000:10000000:2.0:1783965177.350540:0:14181:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 276: rc = 0 00100000:10000000:2.0:1783965177.350788:0:14181:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 276: rc = 0 00100000:10000000:2.0:1783965177.351410:0:14181:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 276: rc = 0 00100000:10000000:2.0:1783965177.351660:0:14181:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 276: rc = 0 00100000:10000000:2.0:1783965177.352443:0:14181:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 276: rc = 0 00100000:10000000:2.0:1783965177.352687:0:14181:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 276: rc = 0 00100000:10000000:2.0:1783965177.353062:0:14181:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 572: rc = 0 00100000:10000000:2.0:1783965177.353501:0:14181:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 572: rc = 0 00100000:10000000:2.0:1783965177.353755:0:14181:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 572: rc = 0 00100000:10000000:2.0:1783965177.353999:0:14181:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 572: rc = 0 00100000:10000000:2.0:1783965177.354245:0:14181:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 572: rc = 0 00100000:10000000:2.0:1783965177.354573:0:14181:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 572: rc = 0 00100000:10000000:2.0:1783965177.354811:0:14181:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 572: rc = 0 00100000:10000000:2.0:1783965177.355033:0:14181:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 572: rc = 0 00100000:10000000:2.0:1783965177.355446:0:14181:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 572: rc = 0 00100000:10000000:2.0:1783965177.355708:0:14181:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 572: rc = 0 00100000:10000000:2.0:1783965177.355952:0:14181:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 572: rc = 0 00100000:10000000:2.0:1783965177.356230:0:14181:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 572: rc = 0 00100000:10000000:2.0:1783965177.356575:0:14181:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 572: rc = 0 00100000:10000000:3.0:1783965177.367826:0:14181:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 572: rc = 0 00100000:10000000:3.0:1783965177.368120:0:14181:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 572: rc = 0 00100000:10000000:3.0:1783965177.368397:0:14181:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 572: rc = 0 00100000:10000000:3.0:1783965177.368635:0:14181:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 572: rc = 0 00100000:10000000:3.0:1783965177.368889:0:14181:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 572: rc = 0 00100000:10000000:3.0:1783965177.369132:0:14181:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 572: rc = 0 00100000:10000000:3.0:1783965177.369428:0:14181:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 572: rc = 0 00100000:10000000:3.0:1783965177.369666:0:14181:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 572: rc = 0 00100000:10000000:3.0:1783965177.369904:0:14181:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 572: rc = 0 00100000:10000000:3.0:1783965177.370148:0:14181:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 572: rc = 0 00100000:10000000:3.0:1783965177.370439:0:14181:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 572: rc = 0 00100000:10000000:3.0:1783965177.370694:0:14181:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 572: rc = 0 00100000:10000000:3.0:1783965177.370954:0:14181:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 572: rc = 0 00100000:10000000:3.0:1783965177.371174:0:14181:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 572: rc = 0 00100000:10000000:3.0:1783965177.372601:0:14181:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 572: rc = 0 00100000:10000000:3.0:1783965177.372844:0:14181:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 572: rc = 0 00100000:10000000:3.0:1783965177.373674:0:14181:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 572: rc = 0 00100000:10000000:3.0:1783965177.374252:0:14181:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 572: rc = 0 00100000:10000000:3.0:1783965177.374587:0:14181:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 572: rc = 0 00100000:10000000:3.0:1783965177.375197:0:14181:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 655: rc = 0 00100000:10000000:3.0:1783965177.375867:0:14181:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:3.0:1783965177.376384:0:14181:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 789: rc = 0 00100000:10000000:3.0:1783965177.376568:0:14181:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:3.0:1783965177.376626:0:14181:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 789: rc = 0 00100000:10000000:3.0:1783965177.376798:0:14181:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:3.0:1783965177.376860:0:14181:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 789: rc = 0 00100000:10000000:3.0:1783965177.377715:0:14181:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:3.0:1783965177.377785:0:14181:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 791: rc = 0 00100000:10000000:3.0:1783965177.378147:0:14181:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:3.0:1783965177.378243:0:14181:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 791: rc = 0 00100000:10000000:3.0:1783965177.378773:0:14181:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:3.0:1783965177.378844:0:14181:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 791: rc = 0 00000020:00000080:3.0:1783965177.379123:0:14181:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1783965177.379132:0:14181:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:3.0:1783965177.379143:0:14181:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe782b916994fe420 00000020:01000004:3.0:1783965177.379151:0:14181:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1783965177.379155:0:14181:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1783965177.379161:0:14181:0:(tgt_mount.c:101:server_register_mount()) register mount ffff94743fbe4800 from MGS 00000020:01000004:3.0:1783965177.379165:0:14181:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1783965177.379175:0:14181:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff947305033380) 00000020:00000080:3.0:1783965177.379184:0:14181:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1783965177.379278:0:14181:0:(tgt_mount.c:153:server_get_mount()) get mount ffff94743fbe4800 from MGS, refs=2 00080000:01000000:3.0:1783965177.379283:0:14181:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:3.0:1783965177.379288:0:14181:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe782b916994fe42e 00000100:00100000:3.0:1783965177.379397:0:14181:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1783965177.379521:0:14181:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1783965177.379527:0:14181:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1783965177.380153:0:14181:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1783965177.380160:0:14181:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1783965177.380989:0:14181:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783965177.381127:0:14181:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1783965177.381131:0:14181:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1783965177.381651:0:14181:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1783965177.381659:0:14181:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1783965177.382147:0:14181:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1783965177.382154:0:14181:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1783965177.383066:0:14187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783965177.383070:0:14187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783965177.383071:0:14187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783965177.383382:0:14188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783965177.383385:0:14188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783965177.383386:0:14188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783965177.383888:0:14181:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1783965177.392135:0:14187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:1.0:1783965177.395041:0:14181:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:1.0:1783965177.395063:0:14181:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1783965177.395067:0:14181:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:3.0:1783965177.405441:0:14190:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1783965177.408538:0:14181:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1783965177.408663:0:14181:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1783965177.410027:0:14181:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1783965177.410393:0:14181:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1783965177.410549:0:14181:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1783965177.410554:0:14181:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1783965177.411148:0:14181:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1783965177.411156:0:14181:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1783965177.411866:0:14181:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1783965177.411875:0:14181:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1783965177.412908:0:14181:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1783965177.412931:0:14181:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.204.112@tcp' 00000020:01000004:0.0:1783965177.412940:0:14181:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1783965177.412970:0:14181:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.204.112@tcp (typ=mgc) 00000020:00000080:0.0:1783965177.412983:0:14181:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.204.112@tcp (ffff9474259cb380) 00000020:00000080:0.0:1783965177.412998:0:14181:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1783965177.413079:0:14181:0:(ldlm_lib.c:102:import_set_conn()) imp ffff947408a85000@MGC192.168.204.112@tcp: add connection 192.168.204.112@tcp at head 00010000:00010000:0.0:1783965177.413253:0:14181:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.204.112@tcp-0 is initialized 00000040:01000000:0.0:1783965177.413259:0:14181:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.112@tcp ctxt 1 is initialized 00000100:00080000:1.0:1783965177.413629:0:14195:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:0.0:1783965177.420885:0:14196:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:2.0:1783965177.420988:0:14181:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.204.112@tcp (uuid 72a5858e-0958-4c77-91cf-d6507b930817) 00000020:00000080:2.0:1783965177.421015:0:14181:0:(genops.c:1406:class_connect()) connect: client 72a5858e-0958-4c77-91cf-d6507b930817, cookie 0xe782b916994fe43c 00000100:00080000:2.0:1783965177.421028:0:14181:0:(import.c:510:import_select_connection()) MGC192.168.204.112@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1783965177.421035:0:14181:0:(import.c:624:import_select_connection()) MGC192.168.204.112@tcp: import ffff947408a85000 using connection 192.168.204.112@tcp/0@lo 00000100:00100000:2.0:1783965177.421067:0:14181:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94743706c700 x1870622732929792/t0(0) o250->MGC192.168.204.112@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783965177.421097:0:14181:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 72a5858e-0958-4c77-91cf-d6507b930817->MGS 00000020:01000004:2.0:1783965177.421120:0:14181:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:2.0:1783965177.421125:0:14181:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:2.0:1783965177.421138:0:14181:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff947304bf99c0) 00000020:00000080:2.0:1783965177.421150:0:14181:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1783965177.424506:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743706c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:72a5858e-0958-4c77-91cf-d6507b930817:3321:1870622732929792:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1783965177.424587:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783965177.427442:0:14192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732929792 00000100:00100000:0.0:1783965177.427458:0:14192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732929792 00000100:00100000:0.0:1783965177.427535:0:14192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783965177.427543:0:14192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743f21dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3321:x1870622732929792:12345-0@lo:250:mount.lustre.0 00010000:00080000:0.0:1783965177.427572:0:14192:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from 72a5858e-0958-4c77-91cf-d6507b930817@0@lo t0 exp 0000000000000000 cur 411 last 0 00000020:00000080:0.0:1783965177.427602:0:14192:0:(genops.c:1406:class_connect()) connect: client 72a5858e-0958-4c77-91cf-d6507b930817, cookie 0xe782b916994fe44a 00000100:00080000:0.0:1783965177.427792:0:14192:0:(import.c:65:import_set_state_nolock()) ffff9474414a7000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783965177.427877:0:14192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743f21dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72a5858e-0958-4c77-91cf-d6507b930817+5:3321:x1870622732929792:12345-0@lo:250:mount.lustre.0 Request processed in 333us (3287us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965177.427885:0:14192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783965177.427990:0:3321:0:(client.c:3112:ptlrpc_free_committed()) MGC192.168.204.112@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1783965177.427999:0:3321:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.204.112@tcp: connect to target with instance 0 00000100:00080000:3.0:1783965177.428007:0:3321:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.204.112@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1783965177.428011:0:3321:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1783965177.428015:0:3321:0:(import.c:65:import_set_state_nolock()) ffff947408a85000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1783965177.428018:0:3321:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1783965177.428028:0:3321:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1783965177.428034:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743706c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:72a5858e-0958-4c77-91cf-d6507b930817:3321:1870622732929792:0@lo:250:mount.lustre.0 00000100:00100000:3.0:1783965177.437049:0:14181:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783965177.437954:0:14181:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1783965177.437963:0:14181:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1783965177.438717:0:14181:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1783965177.438724:0:14181:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1783965177.439107:0:14181:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1783965177.439114:0:14181:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:3.0:1783965177.439963:0:14181:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783965177.440118:0:14181:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:3.0:1783965177.440129:0:14181:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1783965177.441046:0:14181:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1783965177.441056:0:14181:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1783965177.495001:0:14181:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783965177.495372:0:14181:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1783965177.495379:0:14181:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:3.0:1783965177.496647:0:14181:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:3.0:1783965177.496659:0:14181:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1783965177.503028:0:14181:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783965177.503328:0:14181:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1783965177.503335:0:14181:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1783965177.504444:0:14181:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1783965177.504454:0:14181:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1783965177.508310:0:14181:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783965177.508485:0:14181:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1783965177.508492:0:14181:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1783965177.510814:0:14181:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1783965177.510825:0:14181:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1783965177.511421:0:14181:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1783965177.511572:0:14181:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1783965177.511577:0:14181:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1783965177.512303:0:14181:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1783965177.512319:0:14181:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1783965177.587336:0:14181:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783965177.587708:0:14181:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1783965177.587715:0:14181:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:0.0:1783965177.591862:0:14181:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1783965177.591881:0:14181:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1783965177.597339:0:14181:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1783965177.597361:0:14181:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1783965177.600664:0:14181:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1783965177.600692:0:14181:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:0.0:1783965177.600700:0:14181:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.112@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1783965177.600842:0:14181:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.112@tcp ctxt 0 is initialized 00000020:01000004:0.0:1783965177.600877:0:14181:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.204.112@tcp, index=0000, flags=0x20005 00000020:01000004:0.0:1783965177.600882:0:14181:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1783965177.600887:0:14181:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1783965177.600889:0:14181:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783965177.600890:0:14181:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783965177.600891:0:14181:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783965177.600892:0:14181:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783965177.600893:0:14181:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1783965177.600894:0:14181:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1783965177.600896:0:14181:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783965177.600897:0:14181:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1783965177.600899:0:14181:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:0.0:1783965177.600916:0:14181:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1783965177.600917:0:14181:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1783965177.600918:0:14181:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783965177.600918:0:14181:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783965177.600919:0:14181:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783965177.600920:0:14181:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783965177.600921:0:14181:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1783965177.600922:0:14181:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1783965177.600922:0:14181:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783965177.600923:0:14181:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1783965177.600950:0:14181:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1783965177.600970:0:14181:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743fb9ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72a5858e-0958-4c77-91cf-d6507b930817:14181:1870622732929920:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1783965177.601151:0:14181:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783965177.601251:0:14181:0:(client.c:2702:ptlrpc_set_wait()) set ffff9474259073c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783965177.601429:0:14194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732929920 00000100:00100000:3.0:1783965177.601437:0:14194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732929920 00000100:00100000:3.0:1783965177.601482:0:14194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783965177.601490:0:14194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743f21fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72a5858e-0958-4c77-91cf-d6507b930817+5:14181:x1870622732929920:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1783965177.601539:0:14194:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1783965177.601543:0:14194:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1783965177.601546:0:14194:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:3.0:1783965177.601863:0:14215:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1783965177.602480:0:14194:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:3.0:1783965177.607303:0:14216:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1783965177.607323:0:14216:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1783965177.607326:0:14216:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1783965177.607361:0:14216:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:0.0:1783965177.607846:0:14194:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1783965177.607857:0:14194:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:3.0:1783965177.627100:0:14194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743f21fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72a5858e-0958-4c77-91cf-d6507b930817+5:14181:x1870622732929920:12345-0@lo:253:mount.lustre.0 Request processed in 25600us (26048us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965177.627115:0:14194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783965177.627304:0:14181:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743fb9ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72a5858e-0958-4c77-91cf-d6507b930817:14181:1870622732929920:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1783965177.627330:0:14181:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1783965177.627335:0:14181:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1783965177.627337:0:14181:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1783965177.627338:0:14181:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783965177.627340:0:14181:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783965177.627341:0:14181:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783965177.627342:0:14181:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783965177.627343:0:14181:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1783965177.627345:0:14181:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1783965177.627363:0:14181:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783965177.627365:0:14181:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1783965177.627386:0:14181:0:(tgt_mount.c:101:server_register_mount()) register mount ffff94743fbe4800 from lustre-MDT0000 10000000:01000000:0.0:1783965177.627422:0:14181:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1783965177.627425:0:14181:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1783965177.627431:0:14181:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9474259cb380 10000000:01000000:0.0:1783965177.627435:0:14181:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1783965177.627443:0:14181:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-sptlrpc-ffff9474259cb380 from 1 10000000:01000000:0.0:1783965177.627447:0:14181:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1783965177.627487:0:14181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.112@tcp lock: ffff94743e2fc600/0xe782b916994fe451 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965177.627498:0:14181:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.112@tcp lock: ffff94743e2fc600/0xe782b916994fe451 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965177.627507:0:14181:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.112@tcp lock: ffff94743e2fc600/0xe782b916994fe451 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783965177.627527:0:14181:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743fb9ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72a5858e-0958-4c77-91cf-d6507b930817:14181:1870622732930048:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1783965177.627564:0:14181:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783965177.627608:0:14181:0:(client.c:2702:ptlrpc_set_wait()) set ffff9474259079c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783965177.627682:0:14192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732930048 00000100:00100000:1.0:1783965177.627688:0:14192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732930048 00000100:00100000:1.0:1783965177.627733:0:14192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1783965177.627742:0:14192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743f21d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72a5858e-0958-4c77-91cf-d6507b930817+5:14181:x1870622732930048:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783965177.627754:0:14192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783965177.627770:0:14192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94743d9efc00/0xe782b916994fe458 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe782b916994fe451 expref: -99 pid: 14192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965177.627807:0:14192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94743d9efc00/0xe782b916994fe458 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe782b916994fe451 expref: 6 pid: 14192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965177.627818:0:14192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94743d9efc00/0xe782b916994fe458 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe782b916994fe451 expref: 6 pid: 14192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965177.627827:0:14192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94743d9efc00, rc 0) 00000100:00100000:1.0:1783965177.627862:0:14192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743f21d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72a5858e-0958-4c77-91cf-d6507b930817+6:14181:x1870622732930048:12345-0@lo:101:mount.lustre.0 Request processed in 121us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965177.627868:0:14192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783965177.628086:0:14181:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743fb9ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72a5858e-0958-4c77-91cf-d6507b930817:14181:1870622732930048:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783965177.628099:0:14181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.112@tcp lock: ffff94743e2fc600/0xe782b916994fe451 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fe458 expref: -99 pid: 14181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965177.628108:0:14181:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.112@tcp lock: ffff94743e2fc600/0xe782b916994fe451 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe782b916994fe458 expref: -99 pid: 14181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783965177.628154:0:14181:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743fb9ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72a5858e-0958-4c77-91cf-d6507b930817:14181:1870622732930176:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783965177.628179:0:14181:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783965177.628227:0:14181:0:(client.c:2702:ptlrpc_set_wait()) set ffff9474259079c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783965177.628435:0:14194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732930176 00000100:00100000:3.0:1783965177.628441:0:14194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732930176 00000100:00100000:3.0:1783965177.628475:0:14194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783965177.628482:0:14194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743f21f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72a5858e-0958-4c77-91cf-d6507b930817+6:14181:x1870622732930176:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783965177.628736:0:14194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743f21f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72a5858e-0958-4c77-91cf-d6507b930817+6:14181:x1870622732930176:12345-0@lo:501:mount.lustre.0 Request processed in 254us (555us total) trans 0 rc -2/-2 00000100:00100000:3.0:1783965177.628743:0:14194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783965177.628894:0:14181:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743fb9ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72a5858e-0958-4c77-91cf-d6507b930817:14181:1870622732930176:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1783965177.628935:0:14181:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.112@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1783965177.628953:0:14181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.112@tcp lock: ffff94743e2fc600/0xe782b916994fe451 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fe458 expref: -99 pid: 14181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965177.628962:0:14181:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.112@tcp lock: ffff94743e2fc600/0xe782b916994fe451 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fe458 expref: -99 pid: 14181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783965177.628970:0:14181:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff94743fbe4800 10000000:01000000:0.0:1783965177.628975:0:14181:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1783965177.628979:0:14181:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff94743fbe4800 10000000:01000000:0.0:1783965177.628982:0:14181:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1783965177.628984:0:14181:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-barrier-ffff94743fbe4800 from 1 10000000:01000000:0.0:1783965177.628987:0:14181:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1783965177.629005:0:14181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.112@tcp lock: ffff94743e2fd600/0xe782b916994fe45f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965177.629012:0:14181:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.112@tcp lock: ffff94743e2fd600/0xe782b916994fe45f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965177.629021:0:14181:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.112@tcp lock: ffff94743e2fd600/0xe782b916994fe45f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783965177.629035:0:14181:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743fb9ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72a5858e-0958-4c77-91cf-d6507b930817:14181:1870622732930304:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1783965177.629247:0:14181:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783965177.629279:0:14181:0:(client.c:2702:ptlrpc_set_wait()) set ffff9474259079c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783965177.629342:0:14193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732930304 00000100:00100000:1.0:1783965177.629347:0:14193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732930304 00000100:00100000:1.0:1783965177.629375:0:14193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1783965177.629382:0:14193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743f21f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72a5858e-0958-4c77-91cf-d6507b930817+6:14181:x1870622732930304:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783965177.629401:0:14193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783965177.629414:0:14193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94743d9eea00/0xe782b916994fe466 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe782b916994fe45f expref: -99 pid: 14193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965177.629431:0:14193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94743d9eea00/0xe782b916994fe466 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe782b916994fe45f expref: 7 pid: 14193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965177.629440:0:14193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94743d9eea00/0xe782b916994fe466 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe782b916994fe45f expref: 7 pid: 14193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965177.629448:0:14193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94743d9eea00, rc 0) 00000100:00100000:1.0:1783965177.629490:0:14193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743f21f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72a5858e-0958-4c77-91cf-d6507b930817+7:14181:x1870622732930304:12345-0@lo:101:mount.lustre.0 Request processed in 108us (242us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965177.629495:0:14193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1783965177.629605:0:14181:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743fb9ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72a5858e-0958-4c77-91cf-d6507b930817:14181:1870622732930304:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783965177.629617:0:14181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.112@tcp lock: ffff94743e2fd600/0xe782b916994fe45f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fe466 expref: -99 pid: 14181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965177.629631:0:14181:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.112@tcp lock: ffff94743e2fd600/0xe782b916994fe45f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe782b916994fe466 expref: -99 pid: 14181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783965177.629647:0:14181:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.112@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1783965177.629665:0:14181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.112@tcp lock: ffff94743e2fd600/0xe782b916994fe45f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fe466 expref: -99 pid: 14181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965177.629672:0:14181:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.112@tcp lock: ffff94743e2fd600/0xe782b916994fe45f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fe466 expref: -99 pid: 14181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783965177.629678:0:14181:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1783965177.629682:0:14181:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1783965177.629686:0:14181:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff94743fbe4800 10000000:01000000:0.0:1783965177.629689:0:14181:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1783965177.629692:0:14181:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1783965177.629694:0:14181:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1783965177.629711:0:14181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.112@tcp lock: ffff94743e2fc400/0xe782b916994fe46d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965177.629718:0:14181:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.112@tcp lock: ffff94743e2fc400/0xe782b916994fe46d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965177.629726:0:14181:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.112@tcp lock: ffff94743e2fc400/0xe782b916994fe46d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783965177.629739:0:14181:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743fb9ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72a5858e-0958-4c77-91cf-d6507b930817:14181:1870622732930432:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1783965177.629765:0:14181:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783965177.629800:0:14181:0:(client.c:2702:ptlrpc_set_wait()) set ffff9474259079c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783965177.629918:0:14192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732930432 00000100:00100000:2.0:1783965177.629922:0:14192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732930432 00000100:00100000:2.0:1783965177.629955:0:14192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1783965177.629963:0:14192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743f21e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72a5858e-0958-4c77-91cf-d6507b930817+7:14181:x1870622732930432:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783965177.629970:0:14192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783965177.629980:0:14192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff947425974400/0xe782b916994fe474 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe782b916994fe46d expref: -99 pid: 14192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965177.629993:0:14192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff947425974400/0xe782b916994fe474 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe782b916994fe46d expref: 8 pid: 14192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965177.630002:0:14192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff947425974400/0xe782b916994fe474 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe782b916994fe46d expref: 8 pid: 14192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965177.630017:0:14192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff947425974400, rc 0) 00000100:00100000:2.0:1783965177.630231:0:14192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743f21e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72a5858e-0958-4c77-91cf-d6507b930817+8:14181:x1870622732930432:12345-0@lo:101:mount.lustre.0 Request processed in 268us (464us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965177.630237:0:14192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783965177.630326:0:14181:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743fb9ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72a5858e-0958-4c77-91cf-d6507b930817:14181:1870622732930432:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783965177.630339:0:14181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.112@tcp lock: ffff94743e2fc400/0xe782b916994fe46d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fe474 expref: -99 pid: 14181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965177.630346:0:14181:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.112@tcp lock: ffff94743e2fc400/0xe782b916994fe46d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe782b916994fe474 expref: -99 pid: 14181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783965177.630388:0:14181:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743fb9ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72a5858e-0958-4c77-91cf-d6507b930817:14181:1870622732930560:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783965177.630490:0:14181:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783965177.630560:0:14181:0:(client.c:2702:ptlrpc_set_wait()) set ffff9474259079c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783965177.632109:0:14193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732930560 00000100:00100000:1.0:1783965177.632124:0:14193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732930560 00000100:00100000:1.0:1783965177.632185:0:14193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783965177.632213:0:14193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743f21cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72a5858e-0958-4c77-91cf-d6507b930817+8:14181:x1870622732930560:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783965177.632856:0:14193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743f21cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72a5858e-0958-4c77-91cf-d6507b930817+9:14181:x1870622732930560:12345-0@lo:501:mount.lustre.0 Request processed in 656us (2363us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965177.632961:0:14193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1783965177.633300:0:14181:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743fb9ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72a5858e-0958-4c77-91cf-d6507b930817:14181:1870622732930560:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783965177.633371:0:14181:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743fb9ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72a5858e-0958-4c77-91cf-d6507b930817:14181:1870622732930688:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783965177.633435:0:14181:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783965177.633522:0:14181:0:(client.c:2702:ptlrpc_set_wait()) set ffff9474259079c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783965177.635326:0:14194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732930688 00000100:00100000:3.0:1783965177.635340:0:14194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732930688 00000100:00100000:3.0:1783965177.635413:0:14194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1783965177.635424:0:14194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743f21d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72a5858e-0958-4c77-91cf-d6507b930817+9:14181:x1870622732930688:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783965177.635798:0:14194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743f21d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72a5858e-0958-4c77-91cf-d6507b930817+9:14181:x1870622732930688:12345-0@lo:503:mount.lustre.0 Request processed in 376us (2363us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965177.635807:0:14194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1783965177.636094:0:14181:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743fb9ed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72a5858e-0958-4c77-91cf-d6507b930817:14181:1870622732930688:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783965177.640535:0:14217:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743fb9ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:72a5858e-0958-4c77-91cf-d6507b930817:14217:1870622732930816:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1783965177.640623:0:14217:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783965177.640666:0:14217:0:(client.c:2702:ptlrpc_set_wait()) set ffff947425907300 going to sleep for 11 seconds 00000100:00100000:3.0:1783965177.641597:0:14194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732930816 00000100:00100000:3.0:1783965177.641607:0:14194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732930816 00000100:00100000:3.0:1783965177.641663:0:14194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1783965177.641673:0:14194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743f21e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72a5858e-0958-4c77-91cf-d6507b930817+9:14217:x1870622732930816:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783965177.642029:0:14194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743f21e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72a5858e-0958-4c77-91cf-d6507b930817+9:14217:x1870622732930816:12345-0@lo:502:llog_process_th.0 Request processed in 356us (1406us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965177.642037:0:14194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783965177.642156:0:14217:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743fb9ed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:72a5858e-0958-4c77-91cf-d6507b930817:14217:1870622732930816:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1783965177.642193:0:14217:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783965177.642221:0:14217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783965177.642224:0:14217:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1783965177.642229:0:14217:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:1.0:1783965177.642232:0:14217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1783965177.642247:0:14217:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff947437298000) 00000020:00000080:1.0:1783965177.642265:0:14217:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:1.0:1783965177.642271:0:14217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:1.0:1783965177.642355:0:14217:0:(osd_handler.c:1569:osd_obd_connect()) connect #2 00000020:00000080:1.0:1783965177.642362:0:14217:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe782b916994fe482 00000020:00000080:1.0:1783965177.642673:0:14217:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:1.0:1783965177.642678:0:14217:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783965177.642681:0:14217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783965177.642683:0:14217:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:1.0:1783965177.642685:0:14217:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783965177.642689:0:14217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783965177.642691:0:14217:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:1.0:1783965177.642693:0:14217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1783965177.642700:0:14217:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9474372999c0) 00000020:00000080:1.0:1783965177.642710:0:14217:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:1.0:1783965177.642713:0:14217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:1.0:1783965177.642715:0:14217:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:1.0:1783965177.642717:0:14217:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:1.0:1783965177.642729:0:14217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1783965177.642767:0:14217:0:(tgt_mount.c:153:server_get_mount()) get mount ffff94743fbe4800 from lustre-MDT0000, refs=3 00000020:00000080:1.0:1783965177.642779:0:14217:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff94743729b380) 00000020:00000080:1.0:1783965177.642787:0:14217:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:1.0:1783965177.642839:0:14217:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:1.0:1783965177.642845:0:14217:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe782b916994fe497 00000020:00000080:1.0:1783965177.642936:0:14217:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1783965177.642942:0:14217:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1783965177.642947:0:14217:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0xe782b916994fe49e 00080000:01000000:1.0:1783965177.642952:0:14217:0:(osd_handler.c:1569:osd_obd_connect()) connect #3 00000020:00000080:1.0:1783965177.642955:0:14217:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe782b916994fe4a5 00010000:00010000:3.0:1783965177.716780:0:14217:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:3.0:1783965177.717361:0:14217:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:3.0:1783965177.717556:0:14217:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1783965177.718122:0:14217:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff947305030000) 00000020:00000080:3.0:1783965177.718140:0:14217:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1783965177.718232:0:14217:0:(osd_handler.c:1569:osd_obd_connect()) connect #4 00000020:00000080:3.0:1783965177.718241:0:14217:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe782b916994fe4b3 00000020:00000080:3.0:1783965177.718779:0:14217:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1783965177.722093:0:14217:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0xe782b916994fe4ba 00000020:00000080:3.0:1783965177.726168:0:14217:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1783965177.726189:0:14217:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783965177.726196:0:14217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783965177.726198:0:14217:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1783965177.726219:0:14217:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783965177.726226:0:14217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783965177.726228:0:14217:0:(obd_config.c:1561:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1783965177.726233:0:14217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1783965177.726279:0:14217:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1783965177.726299:0:14217:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783965177.726302:0:14217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783965177.726304:0:14217:0:(obd_config.c:1561:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1783965177.726306:0:14217:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1783965177.726318:0:14217:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #9 00000020:01000000:3.0:1783965177.726320:0:14217:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1783965177.726322:0:14217:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1783965177.726323:0:14217:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1783965177.726326:0:14217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783965177.726327:0:14217:0:(obd_config.c:1561:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:3.0:1783965177.726329:0:14217:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1783965177.726333:0:14217:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1783965177.726336:0:14217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783965177.726337:0:14217:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:3.0:1783965177.726340:0:14217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1783965177.726345:0:14217:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.112@tcp to nid 0x20000c0a8cc70 (192.168.204.112@tcp) 00000020:01000000:3.0:1783965177.726387:0:14217:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1783965177.726391:0:14217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1783965177.726406:0:14217:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff947305034d40) 00000020:00000080:3.0:1783965177.726425:0:14217:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:3.0:1783965177.726430:0:14217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1783965177.726487:0:14217:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:3.0:1783965177.726493:0:14217:0:(osd_handler.c:1569:osd_obd_connect()) connect #5 00000020:00000080:3.0:1783965177.726499:0:14217:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe782b916994fe4c8 00010000:00080000:3.0:1783965177.726532:0:14217:0:(ldlm_lib.c:102:import_set_conn()) imp ffff94741cdbf000@lustre-OST0000-osc-MDT0000: add connection 192.168.204.112@tcp at head 00010000:00010000:3.0:1783965177.726762:0:14217:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:3.0:1783965177.727167:0:14217:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1783965177.727253:0:14217:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1783965177.728244:0:14217:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783965177.728373:0:14217:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:3.0:1783965177.728466:0:14217:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:2.0:1783965177.729990:0:14221:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1783965177.729996:0:14221:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1783965177.730814:0:14217:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1783965177.730825:0:14217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1783965177.730858:0:14217:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1783965177.730880:0:14217:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe782b916994fe4cf 00000100:00080000:2.0:1783965177.730890:0:14217:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1783965177.730896:0:14217:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff94741cdbf000 using connection 192.168.204.112@tcp/0@lo 00000100:00100000:2.0:1783965177.730932:0:14217:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94743706fb80 x1870622732930944/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783965177.730961:0:14217:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:2.0:1783965177.731016:0:14217:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783965177.731020:0:14217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783965177.731021:0:14217:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1783965177.731025:0:14217:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1783965177.731028:0:14217:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #15 00000020:01000000:2.0:1783965177.731029:0:14217:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1783965177.731031:0:14217:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1783965177.731032:0:14217:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1783965177.731035:0:14217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783965177.731037:0:14217:0:(obd_config.c:1561:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:2.0:1783965177.731039:0:14217:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1783965177.731043:0:14217:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1783965177.731046:0:14217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783965177.731053:0:14217:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1783965177.731057:0:14217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1783965177.731061:0:14217:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.204.112@tcp to nid 0x20000c0a8cc70 (192.168.204.112@tcp) 00000020:01000000:2.0:1783965177.731085:0:14217:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1783965177.731088:0:14217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1783965177.731099:0:14217:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff947304bfcd40) 00000020:00000080:2.0:1783965177.731112:0:14217:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:2.0:1783965177.731116:0:14217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1783965177.731174:0:14217:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1783965177.731180:0:14217:0:(osd_handler.c:1569:osd_obd_connect()) connect #6 00000020:00000080:2.0:1783965177.731186:0:14217:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0xe782b916994fe4dd 00010000:00080000:2.0:1783965177.731244:0:14217:0:(ldlm_lib.c:102:import_set_conn()) imp ffff947405904000@lustre-OST0001-osc-MDT0000: add connection 192.168.204.112@tcp at head 00000100:00100000:3.0:1783965177.731452:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743706fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3321:1870622732930944:0@lo:8:llog_process_th.0 00010000:00010000:2.0:1783965177.731457:0:14217:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000400:00000100:3.0:1783965177.731510:0:3321:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1870622732930944 offset 0 length 520: 4 00000040:01000000:2.0:1783965177.731643:0:14217:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:2.0:1783965177.731666:0:14217:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1783965177.732476:0:14217:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783965177.732556:0:14217:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:3.0:1783965177.732647:0:14217:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:1.0:1783965177.733122:0:14223:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1783965177.733127:0:14223:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:3.0:1783965177.736568:0:14217:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1783965177.736582:0:14217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1783965177.736630:0:14217:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:3.0:1783965177.736650:0:14217:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe782b916994fe4e4 00000100:00080000:3.0:1783965177.736661:0:14217:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1783965177.736666:0:14217:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff947405904000 using connection 192.168.204.112@tcp/0@lo 00000100:00100000:3.0:1783965177.736700:0:14217:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9474368d7480 x1870622732931072/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783965177.736760:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9474368d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3321:1870622732931072:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1783965177.736819:0:3321:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1870622732931072 offset 0 length 520: 4 00000100:00080000:3.0:1783965177.736872:0:14217:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:3.0:1783965177.736932:0:14217:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783965177.736937:0:14217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783965177.736939:0:14217:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:3.0:1783965177.736942:0:14217:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783965177.736945:0:14217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783965177.736946:0:14217:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:3.0:1783965177.736949:0:14217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1783965177.736951:0:14217:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1783965177.736953:0:14217:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783965177.736955:0:14217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783965177.736962:0:14217:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:3.0:1783965177.736966:0:14217:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783965177.736968:0:14217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783965177.736970:0:14217:0:(obd_config.c:1561:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1783965177.736973:0:14217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1783965177.737004:0:14217:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9474368d5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:72a5858e-0958-4c77-91cf-d6507b930817:14217:1870622732931200:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783965177.737056:0:14217:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783965177.737075:0:14217:0:(client.c:2702:ptlrpc_set_wait()) set ffff9474130ddcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1783965177.737144:0:14192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732931200 00000100:00100000:2.0:1783965177.737151:0:14192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732931200 00000100:00100000:2.0:1783965177.737188:0:14192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1783965177.737196:0:14192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743f21d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72a5858e-0958-4c77-91cf-d6507b930817+9:14217:x1870622732931200:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783965177.737498:0:14192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743f21d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72a5858e-0958-4c77-91cf-d6507b930817+9:14217:x1870622732931200:12345-0@lo:502:llog_process_th.0 Request processed in 301us (441us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965177.737505:0:14192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1783965177.737629:0:14217:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9474368d5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:72a5858e-0958-4c77-91cf-d6507b930817:14217:1870622732931200:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783965177.737659:0:14217:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783965177.737663:0:14217:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783965177.737665:0:14217:0:(obd_config.c:1561:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1783965177.737669:0:14217:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:2.0:1783965177.737823:0:14181:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:2.0:1783965177.737841:0:14181:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.112@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1783965177.737854:0:14181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.112@tcp lock: ffff94743e2fc400/0xe782b916994fe46d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fe474 expref: -99 pid: 14181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965177.737865:0:14181:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.112@tcp lock: ffff94743e2fc400/0xe782b916994fe46d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fe474 expref: -99 pid: 14181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783965177.737884:0:14181:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff94743fbe4800 from 1 10000000:01000000:2.0:1783965177.737886:0:14181:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1783965177.737913:0:14181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.112@tcp lock: ffff947425975c00/0xe782b916994fe4eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965177.737921:0:14181:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.112@tcp lock: ffff947425975c00/0xe782b916994fe4eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965177.737929:0:14181:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.112@tcp lock: ffff947425975c00/0xe782b916994fe4eb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783965177.737942:0:14181:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743706f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72a5858e-0958-4c77-91cf-d6507b930817:14181:1870622732931328:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1783965177.737969:0:14181:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783965177.737998:0:14181:0:(client.c:2702:ptlrpc_set_wait()) set ffff94741ce2c480 going to sleep for 11 seconds 00000100:00100000:3.0:1783965177.738052:0:14194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732931328 00000100:00100000:3.0:1783965177.738057:0:14194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732931328 00000100:00100000:3.0:1783965177.738089:0:14194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1783965177.738095:0:14194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947408aca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72a5858e-0958-4c77-91cf-d6507b930817+9:14181:x1870622732931328:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783965177.738104:0:14194:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783965177.738118:0:14194:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff947436f26200/0xe782b916994fe4f2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe782b916994fe4eb expref: -99 pid: 14194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965177.738138:0:14194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff947436f26200/0xe782b916994fe4f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe782b916994fe4eb expref: 10 pid: 14194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965177.738149:0:14194:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff947436f26200/0xe782b916994fe4f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe782b916994fe4eb expref: 10 pid: 14194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965177.738156:0:14194:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff947436f26200, rc 0) 00000100:00100000:3.0:1783965177.738183:0:14194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947408aca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72a5858e-0958-4c77-91cf-d6507b930817+10:14181:x1870622732931328:12345-0@lo:101:mount.lustre.0 Request processed in 89us (213us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965177.738197:0:14194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1783965177.738283:0:14181:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743706f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72a5858e-0958-4c77-91cf-d6507b930817:14181:1870622732931328:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783965177.738294:0:14181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.112@tcp lock: ffff947425975c00/0xe782b916994fe4eb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fe4f2 expref: -99 pid: 14181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965177.738302:0:14181:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.112@tcp lock: ffff947425975c00/0xe782b916994fe4eb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe782b916994fe4f2 expref: -99 pid: 14181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783965177.738847:0:14181:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743706f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72a5858e-0958-4c77-91cf-d6507b930817:14181:1870622732931456:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1783965177.738883:0:14181:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783965177.738907:0:14181:0:(client.c:2702:ptlrpc_set_wait()) set ffff94741ce2c480 going to sleep for 11 seconds 00000100:00100000:2.0:1783965177.738924:0:14192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732931456 00000100:00100000:2.0:1783965177.738928:0:14192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732931456 00000100:00100000:2.0:1783965177.738948:0:14192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1783965177.738962:0:14192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947408ac8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72a5858e-0958-4c77-91cf-d6507b930817+10:14181:x1870622732931456:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1783965177.738975:0:14192:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1783965177.738981:0:14192:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1783965177.739048:0:14192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947408ac8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72a5858e-0958-4c77-91cf-d6507b930817+10:14181:x1870622732931456:12345-0@lo:256:mount.lustre.0 Request processed in 88us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965177.739055:0:14192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1783965177.739088:0:14181:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743706f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72a5858e-0958-4c77-91cf-d6507b930817:14181:1870622732931456:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1783965177.739671:0:14181:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.112@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1783965177.739680:0:14181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.112@tcp lock: ffff947425975c00/0xe782b916994fe4eb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fe4f2 expref: -99 pid: 14181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965177.739689:0:14181:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.112@tcp lock: ffff947425975c00/0xe782b916994fe4eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fe4f2 expref: -99 pid: 14181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783965177.739697:0:14181:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff94743fbe4800 from 1 10000000:01000000:2.0:1783965177.739699:0:14181:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783965177.739722:0:14181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.112@tcp lock: ffff947425975200/0xe782b916994fe4f9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965177.739729:0:14181:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.112@tcp lock: ffff947425975200/0xe782b916994fe4f9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965177.739737:0:14181:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.112@tcp lock: ffff947425975200/0xe782b916994fe4f9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783965177.739751:0:14181:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743706f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72a5858e-0958-4c77-91cf-d6507b930817:14181:1870622732931584:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1783965177.739780:0:14181:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783965177.739799:0:14181:0:(client.c:2702:ptlrpc_set_wait()) set ffff94741ce2c480 going to sleep for 11 seconds 00000100:00100000:2.0:1783965177.739824:0:14192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732931584 00000100:00100000:2.0:1783965177.739828:0:14192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732931584 00000100:00100000:2.0:1783965177.739848:0:14192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1783965177.739855:0:14192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947408ac9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72a5858e-0958-4c77-91cf-d6507b930817+10:14181:x1870622732931584:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783965177.739868:0:14192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783965177.739880:0:14192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff947425975400/0xe782b916994fe500 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe782b916994fe4f9 expref: -99 pid: 14192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965177.739898:0:14192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff947425975400/0xe782b916994fe500 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe782b916994fe4f9 expref: 11 pid: 14192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965177.739906:0:14192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff947425975400/0xe782b916994fe500 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe782b916994fe4f9 expref: 11 pid: 14192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965177.739913:0:14192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff947425975400, rc 0) 00000100:00100000:2.0:1783965177.739943:0:14192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947408ac9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72a5858e-0958-4c77-91cf-d6507b930817+11:14181:x1870622732931584:12345-0@lo:101:mount.lustre.0 Request processed in 89us (162us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965177.739950:0:14192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1783965177.739983:0:14181:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743706f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72a5858e-0958-4c77-91cf-d6507b930817:14181:1870622732931584:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783965177.739995:0:14181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.112@tcp lock: ffff947425975200/0xe782b916994fe4f9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fe500 expref: -99 pid: 14181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965177.740002:0:14181:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.112@tcp lock: ffff947425975200/0xe782b916994fe4f9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe782b916994fe500 expref: -99 pid: 14181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783965177.740045:0:14181:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743706f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72a5858e-0958-4c77-91cf-d6507b930817:14181:1870622732931712:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783965177.740065:0:14181:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783965177.740075:0:14181:0:(client.c:2702:ptlrpc_set_wait()) set ffff94741ce2c480 going to sleep for 11 seconds 00000100:00100000:2.0:1783965177.740091:0:14192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732931712 00000100:00100000:2.0:1783965177.740094:0:14192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732931712 00000100:00100000:2.0:1783965177.740109:0:14192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1783965177.740113:0:14192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947408acb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72a5858e-0958-4c77-91cf-d6507b930817+11:14181:x1870622732931712:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783965177.740504:0:14192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947408acb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72a5858e-0958-4c77-91cf-d6507b930817+11:14181:x1870622732931712:12345-0@lo:501:mount.lustre.0 Request processed in 389us (437us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965177.740511:0:14192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1783965177.740547:0:14181:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743706f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72a5858e-0958-4c77-91cf-d6507b930817:14181:1870622732931712:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783965177.740571:0:14181:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743706f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72a5858e-0958-4c77-91cf-d6507b930817:14181:1870622732931840:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783965177.740605:0:14181:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783965177.740619:0:14181:0:(client.c:2702:ptlrpc_set_wait()) set ffff94741ce2c480 going to sleep for 11 seconds 00000100:00100000:2.0:1783965177.740631:0:14192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732931840 00000100:00100000:2.0:1783965177.740635:0:14192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732931840 00000100:00100000:2.0:1783965177.740654:0:14192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1783965177.740659:0:14192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947408ac8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72a5858e-0958-4c77-91cf-d6507b930817+11:14181:x1870622732931840:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783965177.740792:0:14192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947408ac8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72a5858e-0958-4c77-91cf-d6507b930817+11:14181:x1870622732931840:12345-0@lo:503:mount.lustre.0 Request processed in 132us (185us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965177.740799:0:14192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1783965177.740841:0:14181:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743706f800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72a5858e-0958-4c77-91cf-d6507b930817:14181:1870622732931840:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783965177.741296:0:14225:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9474368d5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:72a5858e-0958-4c77-91cf-d6507b930817:14225:1870622732931968:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783965177.741349:0:14225:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783965177.741373:0:14192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732931968 00000100:00100000:3.0:1783965177.741377:0:14192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732931968 00000100:00100000:3.0:1783965177.741407:0:14192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1783965177.741414:0:14192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947408acb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72a5858e-0958-4c77-91cf-d6507b930817+11:14225:x1870622732931968:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783965177.741587:0:14192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947408acb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72a5858e-0958-4c77-91cf-d6507b930817+11:14225:x1870622732931968:12345-0@lo:502:llog_process_th.0 Request processed in 173us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965177.741594:0:14192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1783965177.741624:0:14225:0:(client.c:2702:ptlrpc_set_wait()) set ffff947411b30540 going to sleep for 11 seconds 00000100:00100000:3.0:1783965177.741638:0:14225:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9474368d5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:72a5858e-0958-4c77-91cf-d6507b930817:14225:1870622732931968:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783965177.741682:0:14225:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783965177.741691:0:14225:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783965177.741693:0:14225:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1783965177.741700:0:14225:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff94743fbe4800 00000020:00000080:3.0:1783965177.741702:0:14225:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1783965177.741709:0:14225:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783965177.741711:0:14225:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783965177.741712:0:14225:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1783965177.741714:0:14225:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783965177.741716:0:14225:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783965177.741717:0:14225:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1783965177.741720:0:14225:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff94743fbe4800 00000020:00000080:3.0:1783965177.741721:0:14225:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1783965177.741771:0:14225:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783965177.741774:0:14225:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783965177.741776:0:14225:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1783965177.741784:0:14225:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1783965177.741788:0:14225:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783965177.741789:0:14225:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1783965177.741792:0:14225:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff94743fbe4800 00000020:00000080:3.0:1783965177.741794:0:14225:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1783965177.741826:0:14225:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9474368d5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:72a5858e-0958-4c77-91cf-d6507b930817:14225:1870622732932096:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783965177.741859:0:14225:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783965177.741895:0:14194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732932096 00000100:00100000:3.0:1783965177.741898:0:14194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732932096 00000100:00100000:3.0:1783965177.741918:0:14194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1783965177.741923:0:14194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947408acbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72a5858e-0958-4c77-91cf-d6507b930817+11:14225:x1870622732932096:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783965177.742020:0:14194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947408acbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72a5858e-0958-4c77-91cf-d6507b930817+11:14225:x1870622732932096:12345-0@lo:502:llog_process_th.0 Request processed in 96us (161us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965177.742027:0:14194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1783965177.742059:0:14225:0:(client.c:2702:ptlrpc_set_wait()) set ffff947411b30540 going to sleep for 11 seconds 00000100:00100000:3.0:1783965177.742071:0:14225:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9474368d5500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:72a5858e-0958-4c77-91cf-d6507b930817:14225:1870622732932096:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1783965177.742090:0:14225:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1783965177.742095:0:14225:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1783965177.742096:0:14225:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1783965177.742099:0:14225:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1783965177.742144:0:14181:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1783965177.742162:0:14181:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1783965177.742172:0:14181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.112@tcp lock: ffff947425975200/0xe782b916994fe4f9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fe500 expref: -99 pid: 14181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965177.742182:0:14181:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.112@tcp lock: ffff947425975200/0xe782b916994fe4f9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fe500 expref: -99 pid: 14181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783965177.742232:0:14181:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1783965177.742240:0:14181:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff94743fbe4800 10000000:01000000:3.0:1783965177.742243:0:14181:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff94743fbe4800 10000000:01000000:3.0:1783965177.742246:0:14181:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1783965177.742250:0:14181:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff94743fbe4800 from 1 10000000:01000000:3.0:1783965177.742253:0:14181:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1783965177.742274:0:14181:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.112@tcp lock: ffff947436f27c00/0xe782b916994fe507 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965177.742281:0:14181:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.112@tcp lock: ffff947436f27c00/0xe782b916994fe507 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965177.742289:0:14181:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.112@tcp lock: ffff947436f27c00/0xe782b916994fe507 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783965177.742299:0:14181:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9474368d5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72a5858e-0958-4c77-91cf-d6507b930817:14181:1870622732932224:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783965177.742334:0:14181:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783965177.742347:0:14181:0:(client.c:2702:ptlrpc_set_wait()) set ffff947411b30f00 going to sleep for 11 seconds 00000100:00100000:3.0:1783965177.742359:0:14194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732932224 00000100:00100000:3.0:1783965177.742362:0:14194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732932224 00000100:00100000:3.0:1783965177.742379:0:14194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1783965177.742383:0:14194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947408ac9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72a5858e-0958-4c77-91cf-d6507b930817+11:14181:x1870622732932224:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783965177.742390:0:14194:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783965177.742400:0:14194:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff947436f26c00/0xe782b916994fe50e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe782b916994fe507 expref: -99 pid: 14194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965177.742416:0:14194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff947436f26c00/0xe782b916994fe50e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe782b916994fe507 expref: 12 pid: 14194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965177.742425:0:14194:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff947436f26c00/0xe782b916994fe50e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe782b916994fe507 expref: 12 pid: 14194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965177.742443:0:14194:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff947436f26c00, rc 0) 00000100:00100000:3.0:1783965177.742474:0:14194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947408ac9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72a5858e-0958-4c77-91cf-d6507b930817+12:14181:x1870622732932224:12345-0@lo:101:mount.lustre.0 Request processed in 89us (138us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965177.742480:0:14194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1783965177.742512:0:14181:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9474368d5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72a5858e-0958-4c77-91cf-d6507b930817:14181:1870622732932224:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783965177.742523:0:14181:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.112@tcp lock: ffff947436f27c00/0xe782b916994fe507 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fe50e expref: -99 pid: 14181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965177.742530:0:14181:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.112@tcp lock: ffff947436f27c00/0xe782b916994fe507 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe782b916994fe50e expref: -99 pid: 14181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783965177.742565:0:14181:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9474368d5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72a5858e-0958-4c77-91cf-d6507b930817:14181:1870622732932352:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783965177.742588:0:14181:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783965177.742601:0:14181:0:(client.c:2702:ptlrpc_set_wait()) set ffff947411b30f00 going to sleep for 11 seconds 00000100:00100000:3.0:1783965177.742613:0:14194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732932352 00000100:00100000:3.0:1783965177.742617:0:14194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732932352 00000100:00100000:3.0:1783965177.742637:0:14194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1783965177.742643:0:14194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947408ac8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72a5858e-0958-4c77-91cf-d6507b930817+12:14181:x1870622732932352:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783965177.742828:0:14194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947408ac8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72a5858e-0958-4c77-91cf-d6507b930817+12:14181:x1870622732932352:12345-0@lo:501:mount.lustre.0 Request processed in 185us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965177.742835:0:14194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1783965177.742868:0:14181:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9474368d5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72a5858e-0958-4c77-91cf-d6507b930817:14181:1870622732932352:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783965177.742892:0:14181:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9474368d5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72a5858e-0958-4c77-91cf-d6507b930817:14181:1870622732932480:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783965177.742945:0:14181:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783965177.742969:0:14181:0:(client.c:2702:ptlrpc_set_wait()) set ffff947411b30f00 going to sleep for 11 seconds 00000100:00100000:3.0:1783965177.742981:0:14194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732932480 00000100:00100000:3.0:1783965177.742984:0:14194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732932480 00000100:00100000:3.0:1783965177.743003:0:14194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1783965177.743009:0:14194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947408ac8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72a5858e-0958-4c77-91cf-d6507b930817+12:14181:x1870622732932480:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783965177.743128:0:14194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947408ac8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72a5858e-0958-4c77-91cf-d6507b930817+12:14181:x1870622732932480:12345-0@lo:503:mount.lustre.0 Request processed in 119us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965177.743135:0:14194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1783965177.743171:0:14181:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9474368d5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72a5858e-0958-4c77-91cf-d6507b930817:14181:1870622732932480:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1783965177.748105:0:14226:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e29bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:72a5858e-0958-4c77-91cf-d6507b930817:14226:1870622732932608:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783965177.748184:0:14226:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783965177.748243:0:14226:0:(client.c:2702:ptlrpc_set_wait()) set ffff947403777cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1783965177.751365:0:14194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732932608 00000100:00100000:3.0:1783965177.751378:0:14194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732932608 00000100:00100000:3.0:1783965177.751430:0:14194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1783965177.751441:0:14194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947408acac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72a5858e-0958-4c77-91cf-d6507b930817+12:14226:x1870622732932608:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1783965177.751732:0:14194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947408acac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72a5858e-0958-4c77-91cf-d6507b930817+12:14226:x1870622732932608:12345-0@lo:502:llog_process_th.0 Request processed in 293us (3547us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965177.751741:0:14194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1783965177.754417:0:14226:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e29bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:72a5858e-0958-4c77-91cf-d6507b930817:14226:1870622732932608:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1783965177.754498:0:14226:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1783965177.754513:0:14226:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff94743729cd40) 00000020:00000080:1.0:1783965177.754534:0:14226:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:1.0:1783965177.756052:0:14226:0:(tgt_mount.c:153:server_get_mount()) get mount ffff94743fbe4800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1783965177.756060:0:14226:0:(tgt_mount.c:187:server_put_mount()) put mount ffff94743fbe4800 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1783965177.756064:0:14226:0:(obd_mount.c:710:lustre_put_lsi()) put ffff94743fbe4800 4 00010000:00080000:1.0:1783965177.756101:0:14226:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9474072b3800@lustre-MDT0000-lwp-MDT0000: add connection 192.168.204.112@tcp at head 00010000:00010000:1.0:1783965177.760498:0:14226:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:1.0:1783965177.760609:0:14226:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1783965177.760647:0:14226:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1783965177.760659:0:14226:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0xe782b916994fe51c 00000100:00080000:1.0:1783965177.760670:0:14226:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1783965177.760676:0:14226:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9474072b3800 using connection 192.168.204.112@tcp/0@lo 00000100:00100000:1.0:1783965177.760717:0:14226:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94743e29bb80 x1870622732932736/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783965177.760738:0:14226:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1783965177.762397:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e29bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3321:1870622732932736:0@lo:38:llog_process_th.0 00000100:00100000:0.0:1783965177.762481:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783965177.763591:0:14226:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743706f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:72a5858e-0958-4c77-91cf-d6507b930817:14226:1870622732932864:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1783965177.763652:0:14226:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783965177.763683:0:14226:0:(client.c:2702:ptlrpc_set_wait()) set ffff947410c76240 going to sleep for 11 seconds 00000100:00100000:2.0:1783965177.766475:0:14199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732932736 00000100:00100000:2.0:1783965177.766493:0:14199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732932736 00000100:00100000:2.0:1783965177.766540:0:14199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783965177.766549:0:14199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743fb9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3321:x1870622732932736:12345-0@lo:38:llog_process_th.0 00000100:00100000:2.0:1783965177.766665:0:14199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743fb9c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3321:x1870622732932736:12345-0@lo:38:llog_process_th.0 Request processed in 115us (4182us total) trans 0 rc -11/-11 00000100:00100000:2.0:1783965177.766672:0:14199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783965177.766932:0:3321:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1783965177.766942:0:3321:0:(import.c:65:import_set_state_nolock()) ffff9474072b3800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1783965177.766952:0:3321:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1783965177.766956:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e29bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3321:1870622732932736:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1783965177.767171:0:14193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732932864 00000100:00100000:1.0:1783965177.767177:0:14193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732932864 00000100:00100000:1.0:1783965177.770399:0:14193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1783965177.770421:0:14193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e437050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72a5858e-0958-4c77-91cf-d6507b930817+12:14226:x1870622732932864:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1783965177.770732:0:14193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e437050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72a5858e-0958-4c77-91cf-d6507b930817+12:14226:x1870622732932864:12345-0@lo:502:llog_process_th.0 Request processed in 318us (7078us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965177.770741:0:14193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1783965177.771196:0:14226:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743706f800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:72a5858e-0958-4c77-91cf-d6507b930817:14226:1870622732932864:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1783965177.771258:0:14226:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1783965177.771348:0:14181:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1783965177.771367:0:14181:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.112@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1783965177.771382:0:14181:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.112@tcp lock: ffff947436f27c00/0xe782b916994fe507 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fe50e expref: -99 pid: 14181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965177.771394:0:14181:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.112@tcp lock: ffff947436f27c00/0xe782b916994fe507 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fe50e expref: -99 pid: 14181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1783965177.771436:0:14181:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1783965177.771438:0:14181:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1783965177.771439:0:14181:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783965177.771441:0:14181:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783965177.771446:0:14181:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783965177.771447:0:14181:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783965177.771448:0:14181:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1783965177.771450:0:14181:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1783965177.771451:0:14181:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783965177.771453:0:14181:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1783965177.771456:0:14181:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:3.0:1783965177.771458:0:14181:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1783965177.771459:0:14181:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1783965177.771460:0:14181:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783965177.771461:0:14181:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783965177.771462:0:14181:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783965177.771463:0:14181:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783965177.771464:0:14181:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1783965177.771464:0:14181:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1783965177.771465:0:14181:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783965177.771466:0:14181:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1783965177.771485:0:14181:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1783965177.771502:0:14181:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9474368d5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72a5858e-0958-4c77-91cf-d6507b930817:14181:1870622732932992:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1783965177.771544:0:14181:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783965177.771584:0:14181:0:(client.c:2702:ptlrpc_set_wait()) set ffff947411b30540 going to sleep for 11 seconds 00000100:00100000:2.0:1783965177.771785:0:14192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732932992 00000100:00100000:2.0:1783965177.771792:0:14192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732932992 00000100:00100000:2.0:1783965177.771828:0:14192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1783965177.771835:0:14192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e436450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72a5858e-0958-4c77-91cf-d6507b930817+12:14181:x1870622732932992:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1783965177.771858:0:14192:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1783965177.771871:0:14192:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1783965177.806903:0:14192:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1783965177.806922:0:14192:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1783965177.809164:0:14215:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1783965177.809175:0:14215:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1783965177.809231:0:14215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff947436f27e00/0xe782b916994fe523 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965177.809253:0:14215:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff947436f26200/0xe782b916994fe4f2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe782b916994fe4eb expref: 12 pid: 14194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965177.809262:0:14215:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff947436f27e00/0xe782b916994fe523 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965177.809315:0:14215:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff947436f26200/0xe782b916994fe4f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe782b916994fe4eb expref: 12 pid: 14194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965177.809331:0:14215:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff947436f26200/0xe782b916994fe4f2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe782b916994fe4eb expref: 12 pid: 14194 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783965177.809360:0:14215:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9474368d6300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14215:1870622732933120:0@lo:104: 00000100:00100000:3.0:1783965177.809432:0:14215:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783965177.809470:0:14215:0:(client.c:2702:ptlrpc_set_wait()) set ffff94741cca0840 going to sleep for 11 seconds 00000100:00100000:0.0:1783965177.809557:0:14182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732933120 00000100:00100000:0.0:1783965177.809565:0:14182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732933120 00000100:00100000:0.0:1783965177.809612:0:14182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783965177.809623:0:14182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9474368d5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:72a5858e-0958-4c77-91cf-d6507b930817+3:14215:x1870622732933120:12345-0@lo:104: 00010000:00010000:0.0:1783965177.809636:0:14182:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.112@tcp lock: ffff947425975c00/0xe782b916994fe4eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe782b916994fe4f2 expref: -99 pid: 14181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965177.809690:0:14182:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1783965177.809697:0:14182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9474368d5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:72a5858e-0958-4c77-91cf-d6507b930817+3:14215:x1870622732933120:12345-0@lo:104: Request processed in 76us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965177.809704:0:14182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1783965177.809735:0:14188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783965177.809742:0:14188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.112@tcp lock: ffff947425975c00/0xe782b916994fe4eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe782b916994fe4f2 expref: -99 pid: 14181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965177.809749:0:14188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947425975c00 already unused, calling callback (ffffffffc1ca8c20) 10000000:00010000:0.0:1783965177.809754:0:14188:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.112@tcp lock: ffff947425975c00/0xe782b916994fe4eb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe782b916994fe4f2 expref: -99 pid: 14181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965177.809762:0:14188:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.112@tcp lock: ffff947425975c00/0xe782b916994fe4eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe782b916994fe4f2 expref: -99 pid: 14181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783965177.809769:0:14188:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.112@tcp lock: ffff947425975c00/0xe782b916994fe4eb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe782b916994fe4f2 expref: -99 pid: 14181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783965177.809787:0:14188:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1783965177.809821:0:14188:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.112@tcp lock: ffff947425975c00/0xe782b916994fe4eb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe782b916994fe4f2 expref: -99 pid: 14181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965177.809828:0:14188:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783965177.809847:0:14188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.112@tcp lock: ffff947425975c00/0xe782b916994fe4eb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe782b916994fe4f2 expref: -99 pid: 14181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965177.809854:0:14188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.112@tcp lock: ffff947425975c00/0xe782b916994fe4eb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe782b916994fe4f2 expref: -99 pid: 14181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965177.809870:0:14188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783965177.809872:0:14188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783965177.809873:0:14188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783965177.809895:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743fb9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:72a5858e-0958-4c77-91cf-d6507b930817:3324:1870622732933248:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783965177.809925:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783965177.810029:0:14215:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9474368d6300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14215:1870622732933120:0@lo:104: 00010000:00010000:3.0:1783965177.810048:0:14215:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff947436f27e00/0xe782b916994fe523 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783965177.810364:0:14184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732933248 00000100:00100000:0.0:1783965177.810369:0:14184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732933248 00010000:00010000:0.0:1783965177.810386:0:14184:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff947436f26200/0xe782b916994fe4f2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe782b916994fe4eb expref: 13 pid: 14194 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783965177.810428:0:14184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783965177.810435:0:14184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743fb9f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:72a5858e-0958-4c77-91cf-d6507b930817+13:3324:x1870622732933248:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783965177.810446:0:14184:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783965177.810451:0:14184:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff947436f26200/0xe782b916994fe4f2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe782b916994fe4eb expref: 13 pid: 14194 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965177.810462:0:14184:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff947436f26200/0xe782b916994fe4f2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe782b916994fe4eb expref: 13 pid: 14194 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965177.810483:0:14184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff947436f26200/0xe782b916994fe4f2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe782b916994fe4eb expref: 13 pid: 14194 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965177.810497:0:14184:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff947436f27e00/0xe782b916994fe523 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965177.810504:0:14184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff947436f27e00/0xe782b916994fe523 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1783965177.810515:0:14184:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001342130s 00010000:00010000:0.0:1783965177.810520:0:14184:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff947436f27e00/0xe782b916994fe523 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965177.810526:0:14184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff947436f27e00/0xe782b916994fe523 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965177.810533:0:14184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff947436f27e00/0xe782b916994fe523 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965177.810539:0:14184:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff947436f27e00/0xe782b916994fe523 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965177.810545:0:14184:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947436f27e00 already unused, calling callback (ffffffffc168d230) 00010000:00010000:0.0:1783965177.810549:0:14184:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff947436f27e00/0xe782b916994fe523 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965177.810555:0:14184:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff947436f27e00/0xe782b916994fe523 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965177.810566:0:14184:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff947436f27e00/0xe782b916994fe523 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965177.810581:0:14184:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783965177.810615:0:14184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743fb9f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:72a5858e-0958-4c77-91cf-d6507b930817+12:3324:x1870622732933248:12345-0@lo:103:ldlm_bl.0 Request processed in 181us (689us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965177.810623:0:14184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783965177.810654:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743fb9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:72a5858e-0958-4c77-91cf-d6507b930817:3324:1870622732933248:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783965177.810764:0:14215:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff947436f27e00/0xe782b916994fe523 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965177.810772:0:14215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff947436f27e00/0xe782b916994fe523 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965177.810778:0:14215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff947436f27e00/0xe782b916994fe523 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783965177.816033:0:14192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e436450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72a5858e-0958-4c77-91cf-d6507b930817+11:14181:x1870622732932992:12345-0@lo:253:mount.lustre.0 Request processed in 44188us (44478us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965177.816048:0:14192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1783965177.816159:0:14181:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9474368d5500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72a5858e-0958-4c77-91cf-d6507b930817:14181:1870622732932992:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1783965177.816177:0:14181:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1783965177.816181:0:14181:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1783965177.816183:0:14181:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1783965177.816184:0:14181:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783965177.816185:0:14181:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783965177.816187:0:14181:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783965177.816188:0:14181:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783965177.816189:0:14181:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1783965177.816190:0:14181:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1783965177.816192:0:14181:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783965177.816194:0:14181:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1783965177.816302:0:14181:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1783965177.821542:0:14181:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:3.0:1783965177.821798:0:14181:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1783965177.822090:0:14181:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:3.0:1783965177.822443:0:14181:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1783965177.822842:0:14181:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:3.0:1783965177.823011:0:14181:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:3.0:1783965177.824117:0:14181:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:3.0:1783965177.824467:0:14181:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:3.0:1783965177.824834:0:14181:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:3.0:1783965177.825070:0:14181:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1783965177.825487:0:14181:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:3.0:1783965177.825661:0:14181:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:3.0:1783965177.844187:0:14181:0:(update_trans.c:1495:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:1.0:1783965177.846185:0:14181:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:3.0:1783965177.846365:0:14237:0:(update_trans.c:1538:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:3.0:1783965177.846370:0:14237:0:(update_trans.c:1589:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:3.0:1783965177.846827:0:14239:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:3.0:1783965177.846926:0:14239:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:01000000:1.0:1783965177.851892:0:14181:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1783965177.852008:0:14181:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1783965177.853002:0:14239:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1783965177.853068:0:14239:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1783965177.853072:0:14239:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000004:00000080:1.0:1783965177.853866:0:14181:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1783965177.853878:0:14181:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1783965177.854233:0:14181:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783965177.855407:0:14181:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:1.0:1783965177.856028:0:14181:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:1.0:1783965177.856062:0:14181:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:1.0:1783965177.857906:0:14181:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:1.0:1783965177.863497:0:14181:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:0.0:1783965177.889011:0:14181:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1783965177.889052:0:14181:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb07300d17988 00100000:10000000:0.0:1783965177.889060:0:14181:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1783965177.889949:0:14181:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1783965177.889966:0:14181:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.112@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1783965177.889983:0:14181:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1783965177.890010:0:14181:0:(super25.c:181:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:3.0:1783965178.411751:0:14187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1783965178.797399:0:14233:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:1.0:1783965178.995091:0:14196:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1783965178.995115:0:14196:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff94743fbe4800 from 6 10000000:01000000:1.0:1783965178.995120:0:14196:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1783965178.995177:0:14196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.112@tcp lock: ffff94743d9ee400/0xe782b916994fe52a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965178.995189:0:14196:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.112@tcp lock: ffff94743d9ee400/0xe782b916994fe52a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965178.995248:0:14196:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.112@tcp lock: ffff94743d9ee400/0xe782b916994fe52a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783965178.995276:0:14196:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e298000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72a5858e-0958-4c77-91cf-d6507b930817:14196:1870622732933376:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783965178.995494:0:14196:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783965178.995552:0:14196:0:(client.c:2702:ptlrpc_set_wait()) set ffff9474259073c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783965178.995555:0:14193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732933376 00000100:00100000:2.0:1783965178.995564:0:14193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732933376 00000100:00100000:2.0:1783965178.995638:0:14193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1783965178.995648:0:14193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e436850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72a5858e-0958-4c77-91cf-d6507b930817+11:14196:x1870622732933376:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783965178.995661:0:14193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783965178.995675:0:14193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff947425974200/0xe782b916994fe531 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe782b916994fe52a expref: -99 pid: 14193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965178.995699:0:14193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff947425974200/0xe782b916994fe531 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe782b916994fe52a expref: 12 pid: 14193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965178.995708:0:14193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff947425974200/0xe782b916994fe531 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe782b916994fe52a expref: 12 pid: 14193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965178.995716:0:14193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff947425974200, rc 0) 00000100:00100000:2.0:1783965178.995761:0:14193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e436850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72a5858e-0958-4c77-91cf-d6507b930817+12:14196:x1870622732933376:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965178.995767:0:14193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1783965178.995964:0:14196:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e298000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72a5858e-0958-4c77-91cf-d6507b930817:14196:1870622732933376:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783965178.995982:0:14196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.112@tcp lock: ffff94743d9ee400/0xe782b916994fe52a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fe531 expref: -99 pid: 14196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965178.995990:0:14196:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.112@tcp lock: ffff94743d9ee400/0xe782b916994fe52a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe782b916994fe531 expref: -99 pid: 14196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783965178.996044:0:14196:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e298000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72a5858e-0958-4c77-91cf-d6507b930817:14196:1870622732933504:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1783965178.996077:0:14196:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783965178.996101:0:14196:0:(client.c:2702:ptlrpc_set_wait()) set ffff9474259073c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783965178.996538:0:14192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732933504 00000100:00100000:2.0:1783965178.996550:0:14192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732933504 00000100:00100000:2.0:1783965178.996588:0:14192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1783965178.996596:0:14192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e435050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72a5858e-0958-4c77-91cf-d6507b930817+12:14196:x1870622732933504:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1783965178.996621:0:14192:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1783965178.996636:0:14192:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1783965178.996640:0:14192:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:2.0:1783965178.996736:0:14192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e435050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72a5858e-0958-4c77-91cf-d6507b930817+12:14196:x1870622732933504:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 141us (657us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965178.996743:0:14192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1783965178.996884:0:14196:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e298000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72a5858e-0958-4c77-91cf-d6507b930817:14196:1870622732933504:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1783965178.996937:0:14196:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.112@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1783965178.996946:0:14196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.112@tcp lock: ffff94743d9ee400/0xe782b916994fe52a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fe531 expref: -99 pid: 14196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965178.996956:0:14196:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.112@tcp lock: ffff94743d9ee400/0xe782b916994fe52a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fe531 expref: -99 pid: 14196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965179.435558:0:14188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1783965179.820578:0:14233:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1783965180.465398:0:14187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783965181.483403:0:14188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1783965182.489900:0:14482:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg412-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1783965182.510510:0:14187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783965183.020870:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743706e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:72a5858e-0958-4c77-91cf-d6507b930817:3325:1870622732933632:0@lo:400:kworker.0 00000100:00100000:0.0:1783965183.020943:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1783965183.021022:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783965183.021027:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1783965183.021030:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783965183.021033:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1783965183.021036:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:2.0:1783965183.021039:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1783965183.021043:0:36:0:(import.c:65:import_set_state_nolock()) ffff9474072b3800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783965183.021053:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9474072b3800 using connection 192.168.204.112@tcp/0@lo 00000100:00100000:2.0:1783965183.021076:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94743706ca80 x1870622732933760/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783965183.021154:0:14194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732933632 00000100:00100000:1.0:1783965183.021163:0:14194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732933632 00000100:00100000:1.0:1783965183.021276:0:14194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1783965183.021286:0:14194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94741cd50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72a5858e-0958-4c77-91cf-d6507b930817+12:3325:x1870622732933632:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783965183.024778:0:14194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94741cd50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72a5858e-0958-4c77-91cf-d6507b930817+12:3325:x1870622732933632:12345-0@lo:400:kworker.0 Request processed in 3482us (3823us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965183.024795:0:14194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1783965183.024868:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743706ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3321:1870622732933760:0@lo:38:kworker.0 00000100:00100000:1.0:1783965183.024926:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783965183.025318:0:14201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732933760 00000100:00100000:2.0:1783965183.025326:0:14201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732933760 00000100:00100000:2.0:1783965183.025361:0:14201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783965183.025368:0:14201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e298000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3321:x1870622732933760:12345-0@lo:38:kworker.0 00010000:00080000:2.0:1783965183.025396:0:14201:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 417 last 0 00000020:00000080:2.0:1783965183.025434:0:14201:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0xe782b916994fe538 00000004:00100000:2.0:1783965183.025470:0:14201:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1783965183.025593:0:14201:0:(import.c:65:import_set_state_nolock()) ffff947405905000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783965183.025662:0:14201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e298000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3321:x1870622732933760:12345-0@lo:38:kworker.0 Request processed in 293us (734us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965183.025669:0:14201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1783965183.026331:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff94743706ca80 x1870622732933760/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783965193 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1783965183.026350:0:3321:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1783965183.026358:0:3321:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1783965183.026363:0:3321:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1783965183.026366:0:3321:0:(import.c:65:import_set_state_nolock()) ffff9474072b3800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1783965183.026373:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743706ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3321:1870622732933760:0@lo:38:kworker.0 00000100:00100000:0.0:1783965183.028246:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743706e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:72a5858e-0958-4c77-91cf-d6507b930817:3325:1870622732933632:0@lo:400:kworker.0 00010000:00010000:1.0:1783965183.533029:0:14188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783965184.556430:0:14187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1783965185.558648:0:14632:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff82d60120 20000000:00000080:1.0:1783965185.558667:0:14632:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff94743cf64800 uarg=0000000000000000 20000000:01000000:1.0:1783965185.558777:0:14632:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1783965185.558785:0:14632:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1783965185.558790:0:14632:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:2.0:1783965185.560061:0:14633:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:1.0:1783965185.560570:0:14632:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:1.0:1783965185.581447:0:14632:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1783965185.581614:0:14632:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff94743d9ee200/0xe782b916994fe53f lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965185.581634:0:14632:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff947425975400/0xe782b916994fe500 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe782b916994fe4f9 expref: 11 pid: 14192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965185.581657:0:14632:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff94743d9ee200/0xe782b916994fe53f lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965185.581709:0:14632:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff947425975400/0xe782b916994fe500 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe782b916994fe4f9 expref: 11 pid: 14192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965185.581723:0:14632:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff947425975400/0xe782b916994fe500 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe782b916994fe4f9 expref: 11 pid: 14192 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783965185.581739:0:14632:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e29bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14632:1870622732933888:0@lo:104: 00000100:00100000:1.0:1783965185.581816:0:14632:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783965185.581874:0:14632:0:(client.c:2702:ptlrpc_set_wait()) set ffff947409525c00 going to sleep for 11 seconds 00000100:00100000:2.0:1783965185.581970:0:14183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732933888 00000100:00100000:2.0:1783965185.581978:0:14183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732933888 00000100:00100000:2.0:1783965185.582034:0:14183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783965185.582044:0:14183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e298380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:72a5858e-0958-4c77-91cf-d6507b930817+3:14632:x1870622732933888:12345-0@lo:104: 00010000:00010000:2.0:1783965185.582057:0:14183:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.112@tcp lock: ffff947425975200/0xe782b916994fe4f9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe782b916994fe500 expref: -99 pid: 14181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965185.584263:0:14188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783965185.584276:0:14188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.112@tcp lock: ffff947425975200/0xe782b916994fe4f9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe782b916994fe500 expref: -99 pid: 14181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965185.584288:0:14188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947425975200 already unused, calling callback (ffffffffc1ca8c20) 10000000:00010000:0.0:1783965185.584293:0:14188:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.112@tcp lock: ffff947425975200/0xe782b916994fe4f9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe782b916994fe500 expref: -99 pid: 14181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965185.584303:0:14188:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.112@tcp lock: ffff947425975200/0xe782b916994fe4f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe782b916994fe500 expref: -99 pid: 14181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1783965185.584327:0:14188:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.112@tcp lock: ffff947425975200/0xe782b916994fe4f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe782b916994fe500 expref: -99 pid: 14181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783965185.584333:0:14188:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1783965185.584432:0:14188:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.112@tcp lock: ffff947425975200/0xe782b916994fe4f9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe782b916994fe500 expref: -99 pid: 14181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965185.584439:0:14188:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1783965185.584470:0:14188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.112@tcp lock: ffff947425975200/0xe782b916994fe4f9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe782b916994fe500 expref: -99 pid: 14181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965185.584476:0:14188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.112@tcp lock: ffff947425975200/0xe782b916994fe4f9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe782b916994fe500 expref: -99 pid: 14181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965185.584495:0:14188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783965185.584497:0:14188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783965185.584499:0:14188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783965185.584524:0:3323:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783965185.584538:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743fb9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:72a5858e-0958-4c77-91cf-d6507b930817:3323:1870622732934016:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1783965185.584607:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783965185.584661:0:14184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732934016 00000100:00100000:0.0:1783965185.584668:0:14184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732934016 00010000:00010000:0.0:1783965185.584706:0:14184:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff947425975400/0xe782b916994fe500 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe782b916994fe4f9 expref: 12 pid: 14192 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783965185.584736:0:14184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783965185.584743:0:14184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743fb9c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:72a5858e-0958-4c77-91cf-d6507b930817+12:3323:x1870622732934016:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1783965185.584754:0:14184:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783965185.584767:0:14184:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff947425975400/0xe782b916994fe500 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe782b916994fe4f9 expref: 12 pid: 14192 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965185.584778:0:14184:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff947425975400/0xe782b916994fe500 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe782b916994fe4f9 expref: 12 pid: 14192 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965185.584796:0:14184:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff94743d9ee200/0xe782b916994fe53f lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965185.584804:0:14184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94743d9ee200/0xe782b916994fe53f lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965185.584819:0:14184:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff94743d9ee200/0xe782b916994fe53f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965185.584826:0:14184:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff94743d9ee200/0xe782b916994fe53f lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965185.584832:0:14184:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff94743d9ee200/0xe782b916994fe53f lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965185.584839:0:14184:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff94743d9ee200/0xe782b916994fe53f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965185.584845:0:14184:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743d9ee200 already unused, calling callback (ffffffffc168d230) 00010000:00010000:0.0:1783965185.584849:0:14184:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff94743d9ee200/0xe782b916994fe53f lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965185.584855:0:14184:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff94743d9ee200/0xe782b916994fe53f lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965185.584864:0:14184:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff94743d9ee200/0xe782b916994fe53f lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965185.584881:0:14184:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783965185.584915:0:14184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743fb9c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:72a5858e-0958-4c77-91cf-d6507b930817+12:3323:x1870622732934016:12345-0@lo:103:ldlm_bl.0 Request processed in 173us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965185.584922:0:14184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783965185.584964:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743fb9e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:72a5858e-0958-4c77-91cf-d6507b930817:3323:1870622732934016:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783965185.587117:0:14183:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to priority blp list, 0 blwis in pool 00000100:00100000:2.0:1783965185.587135:0:14183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e298380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:72a5858e-0958-4c77-91cf-d6507b930817+3:14632:x1870622732933888:12345-0@lo:104: Request processed in 5088us (5315us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965185.587148:0:14183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1783965185.587281:0:14632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff947425975400/0xe782b916994fe500 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe782b916994fe4f9 expref: 11 pid: 14192 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783965185.587301:0:14632:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e29bb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14632:1870622732933888:0@lo:104: 00010000:00010000:2.0:1783965185.587327:0:14632:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff94743d9ee200/0xe782b916994fe53f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965185.587337:0:14632:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff94743d9ee200/0xe782b916994fe53f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965185.587344:0:14632:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff94743d9ee200/0xe782b916994fe53f lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965185.587365:0:14632:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94743d9ee200/0xe782b916994fe53f lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14632 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965185.588557:0:14187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783965186.616818:0:14188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1783965186.860020:0:14196:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1783965186.860030:0:14196:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff94743fbe4800 from 10 10000000:01000000:1.0:1783965186.860037:0:14196:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783965186.862983:0:14196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.112@tcp lock: ffff94743d9ee600/0xe782b916994fe546 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965186.863014:0:14196:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.112@tcp lock: ffff94743d9ee600/0xe782b916994fe546 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965186.863034:0:14196:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.112@tcp lock: ffff94743d9ee600/0xe782b916994fe546 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783965186.863146:0:14196:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e298700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72a5858e-0958-4c77-91cf-d6507b930817:14196:1870622732934144:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783965186.863415:0:14196:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783965186.864695:0:14196:0:(client.c:2702:ptlrpc_set_wait()) set ffff947409525840 going to sleep for 11 seconds 00000100:00100000:3.0:1783965186.867939:0:14193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732934144 00000100:00100000:3.0:1783965186.867962:0:14193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732934144 00000100:00100000:3.0:1783965186.868125:0:14193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1783965186.868149:0:14193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94741cd52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72a5858e-0958-4c77-91cf-d6507b930817+11:14196:x1870622732934144:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783965186.868172:0:14193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783965186.868326:0:14193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff947436f27e00/0xe782b916994fe54d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe782b916994fe546 expref: -99 pid: 14193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965186.868380:0:14193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff947436f27e00/0xe782b916994fe54d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe782b916994fe546 expref: 12 pid: 14193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965186.868395:0:14193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff947436f27e00/0xe782b916994fe54d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe782b916994fe546 expref: 12 pid: 14193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965186.868407:0:14193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff947436f27e00, rc 0) 00000100:00100000:3.0:1783965186.869061:0:14193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94741cd52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72a5858e-0958-4c77-91cf-d6507b930817+12:14196:x1870622732934144:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 923us (5644us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965186.869071:0:14193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1783965186.872392:0:14196:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e298700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72a5858e-0958-4c77-91cf-d6507b930817:14196:1870622732934144:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783965186.872446:0:14196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.112@tcp lock: ffff94743d9ee600/0xe782b916994fe546 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fe54d expref: -99 pid: 14196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965186.872463:0:14196:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.112@tcp lock: ffff94743d9ee600/0xe782b916994fe546 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe782b916994fe54d expref: -99 pid: 14196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783965186.872571:0:14196:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e298700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72a5858e-0958-4c77-91cf-d6507b930817:14196:1870622732934272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783965186.872654:0:14196:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783965186.872700:0:14196:0:(client.c:2702:ptlrpc_set_wait()) set ffff947409525840 going to sleep for 11 seconds 00000100:00100000:3.0:1783965186.873227:0:14194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732934272 00000100:00100000:3.0:1783965186.873236:0:14194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732934272 00000100:00100000:3.0:1783965186.873290:0:14194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1783965186.873302:0:14194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94741cd51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72a5858e-0958-4c77-91cf-d6507b930817+12:14196:x1870622732934272:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783965186.873655:0:14194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94741cd51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72a5858e-0958-4c77-91cf-d6507b930817+12:14196:x1870622732934272:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 355us (1001us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965186.873664:0:14194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1783965186.874075:0:14196:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e298700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72a5858e-0958-4c77-91cf-d6507b930817:14196:1870622732934272:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1783965186.874144:0:14196:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9474368d5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72a5858e-0958-4c77-91cf-d6507b930817:14196:1870622732934400:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783965186.874613:0:14196:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783965186.874695:0:14196:0:(client.c:2702:ptlrpc_set_wait()) set ffff947415232b40 going to sleep for 11 seconds 00000100:00100000:2.0:1783965186.880262:0:14192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732934400 00000100:00100000:2.0:1783965186.880283:0:14192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732934400 00000100:00100000:2.0:1783965186.880391:0:14192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1783965186.880409:0:14192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94741cd50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72a5858e-0958-4c77-91cf-d6507b930817+12:14196:x1870622732934400:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783965186.880790:0:14192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94741cd50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72a5858e-0958-4c77-91cf-d6507b930817+12:14196:x1870622732934400:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 387us (6177us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965186.880799:0:14192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1783965186.881014:0:14196:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9474368d5500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72a5858e-0958-4c77-91cf-d6507b930817:14196:1870622732934400:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1783965186.885507:0:14680:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1783965186.886514:0:14196:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1783965186.886560:0:14196:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783965186.886572:0:14196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.112@tcp lock: ffff94743d9ee600/0xe782b916994fe546 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fe54d expref: -99 pid: 14196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965186.886584:0:14196:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.112@tcp lock: ffff94743d9ee600/0xe782b916994fe546 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fe54d expref: -99 pid: 14196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783965187.119234:0:3321:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783965177/real 1783965177] req@ffff9474368d7480 x1870622732931072/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783965187 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783965187.119268:0:3321:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9474368d7480 x1870622732931072/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783965187 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783965187.119278:0:3321:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783965177/real 1783965177] req@ffff94743706fb80 x1870622732930944/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783965187 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783965187.119292:0:3321:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff94743706fb80 x1870622732930944/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783965187 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1783965187.119310:0:3321:0:(import.c:65:import_set_state_nolock()) ffff947405904000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783965187.119323:0:3321:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1783965187.119327:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9474368d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3321:1870622732931072:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1783965187.119333:0:3321:0:(import.c:65:import_set_state_nolock()) ffff94741cdbf000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783965187.119337:0:3321:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1783965187.119340:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743706fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3321:1870622732930944:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1783965187.119714:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783965187.119719:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1783965187.119722:0:38:0:(import.c:65:import_set_state_nolock()) ffff94741cdbf000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783965187.119727:0:38:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 411 00000100:00080000:2.0:1783965187.119733:0:38:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1783965187.119740:0:38:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff94741cdbf000 using connection 192.168.204.112@tcp/0@lo 00000100:00100000:2.0:1783965187.119772:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94743706c380 x1870622732934528/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1783965187.119798:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783965187.119801:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1783965187.119802:0:38:0:(import.c:65:import_set_state_nolock()) ffff947405904000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783965187.119805:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 411 00000100:00080000:2.0:1783965187.119826:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1783965187.119830:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff947405904000 using connection 192.168.204.112@tcp/0@lo 00000100:00100000:2.0:1783965187.119843:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94743706d880 x1870622732934656/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1783965187.120332:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743706dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3323:1870622732934784:0@lo:400:kworker.0 00000100:00100000:0.0:1783965187.120401:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783965187.120926:0:14200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732934784 00000100:00100000:1.0:1783965187.120944:0:14200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732934784 00000100:00100000:1.0:1783965187.121009:0:14200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783965187.121019:0:14200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743fb9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3323:x1870622732934784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783965187.121091:0:14200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743fb9e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3323:x1870622732934784:12345-0@lo:400:kworker.0 Request processed in 73us (689us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965187.121099:0:14200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783965187.121122:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743706c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3321:1870622732934528:0@lo:8:kworker.0 00000400:00000100:1.0:1783965187.121156:0:3321:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1870622732934528 offset 0 length 520: 4 00000100:00100000:1.0:1783965187.121174:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743706d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3321:1870622732934656:0@lo:8:kworker.0 00000400:00000100:1.0:1783965187.121231:0:3321:0:(lib-move.c:4319:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1870622732934656 offset 0 length 520: 4 00010000:00080000:0.0:1783965187.121452:0:3323:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff94743706dc00 x1870622732934784/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783965203 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783965187.121466:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743706dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3323:1870622732934784:0@lo:400:kworker.0 00010000:00010000:0.0:1783965187.635494:0:14187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783965188.661290:0:14188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1783965189.035904:0:14233:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1783965189.680820:0:14187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783965190.701528:0:14188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1783965190.797400:0:14833:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1783965190.797405:0:14833:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:3.0:1783965190.797574:0:14833:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff947304973000 00000020:01000004:3.0:1783965190.797589:0:14833:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1783965190.797602:0:14833:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1783965190.797623:0:14833:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff947436e43380) 00000020:00000080:3.0:1783965190.797640:0:14833:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1783965190.818043:0:14833:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1783965190.818508:0:14833:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1783965190.819503:0:14833:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1783965190.819845:0:14833:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1783965190.820333:0:14833:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1783965190.820830:0:14833:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 435: rc = 0 00100000:10000000:2.0:1783965190.821017:0:14833:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 435: rc = 0 00100000:10000000:2.0:1783965190.821224:0:14833:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 435: rc = 0 00100000:10000000:2.0:1783965190.821765:0:14833:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 354: rc = 0 00100000:10000000:2.0:1783965190.822392:0:14833:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 354: rc = 0 00100000:10000000:2.0:1783965190.822729:0:14833:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 354: rc = 0 00100000:10000000:2.0:1783965190.823033:0:14833:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 354: rc = 0 00100000:10000000:2.0:1783965190.823383:0:14833:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 354: rc = 0 00100000:10000000:2.0:1783965190.823693:0:14833:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 354: rc = 0 00000020:00000080:2.0:1783965190.824517:0:14833:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1783965190.824529:0:14833:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:2.0:1783965190.824541:0:14833:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xe782b916994fe55b 00000020:01000004:2.0:1783965190.824626:0:14833:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1783965190.824649:0:14833:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.112@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1783965190.824653:0:14833:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.112@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1783965190.824659:0:14833:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1783965190.824664:0:14833:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1783965190.824674:0:14833:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff947304bfb380) 00000020:00000080:2.0:1783965190.824693:0:14833:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:2.0:1783965190.826738:0:14833:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783965190.827052:0:14833:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1783965190.827070:0:14833:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1783965190.827788:0:14833:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1783965190.827796:0:14833:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1783965190.831999:0:14833:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1783965190.832013:0:14833:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:3.0:1783965190.835476:0:14833:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783965190.835892:0:14833:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:3.0:1783965190.835975:0:14833:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:3.0:1783965190.836570:0:14833:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:3.0:1783965190.836577:0:14833:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1783965190.861387:0:14833:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1783965190.861717:0:14833:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1783965190.861725:0:14833:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1783965190.863440:0:14833:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1783965190.863452:0:14833:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1783965190.864527:0:14833:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1783965190.864536:0:14833:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1783965190.867746:0:14833:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1783965190.868018:0:14833:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1783965190.868025:0:14833:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1783965190.872990:0:14833:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1783965190.873007:0:14833:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1783965190.951992:0:14833:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1783965190.953836:0:14833:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1783965190.953846:0:14833:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1783965190.962358:0:14833:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1783965190.962373:0:14833:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:0.0:1783965190.963046:0:14833:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:0.0:1783965190.963084:0:14833:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:0.0:1783965190.963091:0:14833:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.112@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1783965190.975627:0:14833:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.112@tcp ctxt 0 is initialized 00000020:01000004:0.0:1783965190.975670:0:14833:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.204.112@tcp, index=0000, flags=0x20002 00000020:01000004:0.0:1783965190.975675:0:14833:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1783965190.975676:0:14833:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1783965190.975678:0:14833:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783965190.975679:0:14833:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783965190.975680:0:14833:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783965190.975681:0:14833:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783965190.975682:0:14833:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783965190.975684:0:14833:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783965190.975685:0:14833:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1783965190.975689:0:14833:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:0.0:1783965190.975691:0:14833:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1783965190.975693:0:14833:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1783965190.975694:0:14833:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783965190.975695:0:14833:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783965190.975696:0:14833:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783965190.975697:0:14833:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783965190.975698:0:14833:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783965190.975699:0:14833:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783965190.975700:0:14833:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1783965190.975729:0:14833:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1783965190.975752:0:14833:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743fb9d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72a5858e-0958-4c77-91cf-d6507b930817:14833:1870622732934912:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1783965190.975830:0:14833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783965190.976067:0:14833:0:(client.c:2702:ptlrpc_set_wait()) set ffff947410edf900 going to sleep for 11 seconds 00000100:00100000:2.0:1783965190.976473:0:14192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732934912 00000100:00100000:2.0:1783965190.976481:0:14192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732934912 00000100:00100000:2.0:1783965190.976664:0:14192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1783965190.976676:0:14192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94741cd52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72a5858e-0958-4c77-91cf-d6507b930817+12:14833:x1870622732934912:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1783965190.976709:0:14192:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1783965190.976712:0:14192:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:2.0:1783965190.976716:0:14192:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1783965190.985099:0:14192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94741cd52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72a5858e-0958-4c77-91cf-d6507b930817+12:14833:x1870622732934912:12345-0@lo:253:mount.lustre.0 Request processed in 8414us (9256us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965190.986459:0:14192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1783965190.986747:0:14833:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743fb9d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72a5858e-0958-4c77-91cf-d6507b930817:14833:1870622732934912:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1783965190.986763:0:14833:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1783965190.986766:0:14833:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1783965190.986768:0:14833:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1783965190.986769:0:14833:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783965190.986771:0:14833:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783965190.986772:0:14833:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783965190.986787:0:14833:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783965190.986788:0:14833:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783965190.986790:0:14833:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783965190.986791:0:14833:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1783965190.986814:0:14833:0:(tgt_mount.c:101:server_register_mount()) register mount ffff947304973000 from lustre-OST0000 10000000:01000000:0.0:1783965190.986848:0:14833:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1783965190.986851:0:14833:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1783965190.986857:0:14833:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9474259cb380 local copy 00010000:00010000:0.0:1783965190.986869:0:14833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.112@tcp lock: ffff94743e2fc600/0xe782b916994fe451 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fe458 expref: -99 pid: 14181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783965190.988260:0:14833:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743fb9d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72a5858e-0958-4c77-91cf-d6507b930817:14833:1870622732935040:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783965190.988323:0:14833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783965190.988415:0:14833:0:(client.c:2702:ptlrpc_set_wait()) set ffff947410edf240 going to sleep for 11 seconds 00000100:00100000:3.0:1783965190.988650:0:14193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732935040 00000100:00100000:3.0:1783965190.988658:0:14193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732935040 00000100:00100000:3.0:1783965190.988752:0:14193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1783965190.988761:0:14193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94741cd52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72a5858e-0958-4c77-91cf-d6507b930817+12:14833:x1870622732935040:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783965190.988964:0:14193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94741cd52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72a5858e-0958-4c77-91cf-d6507b930817+12:14833:x1870622732935040:12345-0@lo:501:mount.lustre.0 Request processed in 204us (639us total) trans 0 rc -2/-2 00000100:00100000:3.0:1783965190.988980:0:14193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1783965190.989052:0:14833:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743fb9d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72a5858e-0958-4c77-91cf-d6507b930817:14833:1870622732935040:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1783965190.989083:0:14833:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.112@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1783965190.989326:0:14833:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.112@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1783965190.989336:0:14833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.112@tcp lock: ffff94743e2fc600/0xe782b916994fe451 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fe458 expref: -99 pid: 14181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965190.989348:0:14833:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.112@tcp lock: ffff94743e2fc600/0xe782b916994fe451 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fe458 expref: -99 pid: 14181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783965190.989390:0:14833:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff947304973000 10000000:01000000:0.0:1783965190.989395:0:14833:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1783965190.989400:0:14833:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9474259cb380 10000000:01000000:0.0:1783965190.989403:0:14833:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1783965190.989406:0:14833:0:(mgc_request.c:1801:mgc_process_log()) Process log nodemap-ffff9474259cb380 from 1 10000000:01000000:0.0:1783965190.989409:0:14833:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1783965190.989437:0:14833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.112@tcp lock: ffff94743e2fd200/0xe782b916994fe569 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965190.989454:0:14833:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.112@tcp lock: ffff94743e2fd200/0xe782b916994fe569 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965190.989463:0:14833:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.112@tcp lock: ffff94743e2fd200/0xe782b916994fe569 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783965190.989491:0:14833:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743fb9d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72a5858e-0958-4c77-91cf-d6507b930817:14833:1870622732935168:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1783965190.989525:0:14833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783965190.992225:0:14833:0:(client.c:2702:ptlrpc_set_wait()) set ffff947410edfa80 going to sleep for 11 seconds 00000100:00100000:2.0:1783965190.992782:0:14194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732935168 00000100:00100000:2.0:1783965190.992794:0:14194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732935168 00000100:00100000:2.0:1783965190.992848:0:14194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1783965190.992859:0:14194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94741cd51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72a5858e-0958-4c77-91cf-d6507b930817+12:14833:x1870622732935168:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783965190.992877:0:14194:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783965190.993076:0:14194:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff947425974000/0xe782b916994fe570 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe782b916994fe569 expref: -99 pid: 14194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965190.993119:0:14194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff947425974000/0xe782b916994fe570 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe782b916994fe569 expref: 13 pid: 14194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965190.993131:0:14194:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff947425974000/0xe782b916994fe570 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe782b916994fe569 expref: 13 pid: 14194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965190.993158:0:14194:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff947425974000, rc 0) 00000100:00100000:2.0:1783965190.993253:0:14194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94741cd51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72a5858e-0958-4c77-91cf-d6507b930817+13:14833:x1870622732935168:12345-0@lo:101:mount.lustre.0 Request processed in 396us (3726us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965190.993259:0:14194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1783965190.993488:0:14833:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743fb9d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72a5858e-0958-4c77-91cf-d6507b930817:14833:1870622732935168:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783965190.993511:0:14833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.112@tcp lock: ffff94743e2fd200/0xe782b916994fe569 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fe570 expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965190.993521:0:14833:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.112@tcp lock: ffff94743e2fd200/0xe782b916994fe569 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe782b916994fe570 expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783965190.993543:0:14833:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.112@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:0.0:1783965190.993681:0:14833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.112@tcp lock: ffff94743e2fd200/0xe782b916994fe569 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fe570 expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965190.993689:0:14833:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.112@tcp lock: ffff94743e2fd200/0xe782b916994fe569 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fe570 expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783965190.993697:0:14833:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1783965190.993702:0:14833:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1783965190.993708:0:14833:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:0.0:1783965190.993711:0:14833:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:0.0:1783965190.993745:0:14833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.112@tcp lock: ffff94743e2fc800/0xe782b916994fe577 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965190.993753:0:14833:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.112@tcp lock: ffff94743e2fc800/0xe782b916994fe577 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965190.993760:0:14833:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.112@tcp lock: ffff94743e2fc800/0xe782b916994fe577 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783965190.993780:0:14833:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743fb9d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72a5858e-0958-4c77-91cf-d6507b930817:14833:1870622732935296:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1783965190.993817:0:14833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783965190.993842:0:14833:0:(client.c:2702:ptlrpc_set_wait()) set ffff947410edfa80 going to sleep for 11 seconds 00000100:00100000:1.0:1783965190.993914:0:14192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732935296 00000100:00100000:1.0:1783965190.993919:0:14192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732935296 00000100:00100000:1.0:1783965190.993962:0:14192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1783965190.993970:0:14192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94741cd50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72a5858e-0958-4c77-91cf-d6507b930817+13:14833:x1870622732935296:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783965190.993978:0:14192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783965190.993988:0:14192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94743d9ee200/0xe782b916994fe57e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xe782b916994fe577 expref: -99 pid: 14192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965190.994001:0:14192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94743d9ee200/0xe782b916994fe57e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe782b916994fe577 expref: 14 pid: 14192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965190.994018:0:14192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94743d9ee200/0xe782b916994fe57e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe782b916994fe577 expref: 14 pid: 14192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965190.994025:0:14192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94743d9ee200, rc 0) 00000100:00100000:1.0:1783965190.994068:0:14192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94741cd50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72a5858e-0958-4c77-91cf-d6507b930817+14:14833:x1870622732935296:12345-0@lo:101:mount.lustre.0 Request processed in 89us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965190.994074:0:14192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1783965190.994250:0:14833:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743fb9d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72a5858e-0958-4c77-91cf-d6507b930817:14833:1870622732935296:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783965190.994264:0:14833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.112@tcp lock: ffff94743e2fc800/0xe782b916994fe577 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fe57e expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965190.994271:0:14833:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.112@tcp lock: ffff94743e2fc800/0xe782b916994fe577 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0xe782b916994fe57e expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783965190.995270:0:14833:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1783965190.996888:0:14833:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783965190.997388:0:14833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1783965190.997450:0:14833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:0.0:1783965190.997755:0:14833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:0.0:1783965190.997813:0:14833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:0.0:1783965190.997852:0:14833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:0.0:1783965190.997884:0:14833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:0.0:1783965190.998051:0:14833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:0.0:1783965190.998074:0:14833:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:0.0:1783965190.998274:0:14833:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743fb9d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72a5858e-0958-4c77-91cf-d6507b930817:14833:1870622732935424:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783965190.998352:0:14833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783965190.998388:0:14833:0:(client.c:2702:ptlrpc_set_wait()) set ffff947410edf240 going to sleep for 11 seconds 00000100:00100000:1.0:1783965190.998520:0:14192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732935424 00000100:00100000:1.0:1783965190.998528:0:14192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732935424 00000100:00100000:1.0:1783965190.998709:0:14192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1783965190.998721:0:14192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94741cd53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72a5858e-0958-4c77-91cf-d6507b930817+14:14833:x1870622732935424:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783965190.999153:0:14192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94741cd53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72a5858e-0958-4c77-91cf-d6507b930817+14:14833:x1870622732935424:12345-0@lo:501:mount.lustre.0 Request processed in 435us (800us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965190.999162:0:14192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1783965190.999864:0:14833:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743fb9d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72a5858e-0958-4c77-91cf-d6507b930817:14833:1870622732935424:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783965190.999932:0:14833:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743706d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72a5858e-0958-4c77-91cf-d6507b930817:14833:1870622732935552:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783965190.999987:0:14833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783965191.000032:0:14833:0:(client.c:2702:ptlrpc_set_wait()) set ffff947403777c00 going to sleep for 11 seconds 00000100:00100000:3.0:1783965191.000248:0:14194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732935552 00000100:00100000:3.0:1783965191.000255:0:14194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732935552 00000100:00100000:3.0:1783965191.000296:0:14194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1783965191.000306:0:14194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94741cd53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72a5858e-0958-4c77-91cf-d6507b930817+14:14833:x1870622732935552:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783965191.016029:0:14194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94741cd53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72a5858e-0958-4c77-91cf-d6507b930817+14:14833:x1870622732935552:12345-0@lo:503:mount.lustre.0 Request processed in 15714us (16031us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965191.016043:0:14194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1783965191.016299:0:14833:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743706d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72a5858e-0958-4c77-91cf-d6507b930817:14833:1870622732935552:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1783965191.021025:0:14833:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1783965191.021156:0:14833:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e29ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72a5858e-0958-4c77-91cf-d6507b930817:14833:1870622732935680:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783965191.021626:0:14833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783965191.021718:0:14833:0:(client.c:2702:ptlrpc_set_wait()) set ffff947429e07540 going to sleep for 11 seconds 00000100:00100000:0.0:1783965191.027832:0:14193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732935680 00000100:00100000:0.0:1783965191.027849:0:14193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732935680 00000100:00100000:0.0:1783965191.030286:0:14193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1783965191.030312:0:14193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94741cd53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72a5858e-0958-4c77-91cf-d6507b930817+14:14833:x1870622732935680:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783965191.030682:0:14193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94741cd53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72a5858e-0958-4c77-91cf-d6507b930817+14:14833:x1870622732935680:12345-0@lo:502:mount.lustre.0 Request processed in 381us (9054us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965191.030689:0:14193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1783965191.030819:0:14833:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e29ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72a5858e-0958-4c77-91cf-d6507b930817:14833:1870622732935680:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1783965191.031112:0:14833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1783965191.031164:0:14833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1783965191.031191:0:14833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1783965191.031262:0:14833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1783965191.031293:0:14833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1783965191.031318:0:14833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1783965191.031353:0:14833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1783965191.031382:0:14833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1783965191.031411:0:14833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:2.0:1783965191.031467:0:14833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:2.0:1783965191.031501:0:14833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:2.0:1783965191.031544:0:14833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:2.0:1783965191.031582:0:14833:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743706d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72a5858e-0958-4c77-91cf-d6507b930817:14833:1870622732935808:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783965191.031627:0:14833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783965191.034303:0:14833:0:(client.c:2702:ptlrpc_set_wait()) set ffff94743e29f600 going to sleep for 11 seconds 00000100:00100000:1.0:1783965191.036005:0:14192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732935808 00000100:00100000:1.0:1783965191.036017:0:14192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732935808 00000100:00100000:1.0:1783965191.036094:0:14192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1783965191.036105:0:14192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94741cd51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72a5858e-0958-4c77-91cf-d6507b930817+14:14833:x1870622732935808:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783965191.036525:0:14192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94741cd51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72a5858e-0958-4c77-91cf-d6507b930817+14:14833:x1870622732935808:12345-0@lo:502:mount.lustre.0 Request processed in 421us (4896us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965191.036533:0:14192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1783965191.036673:0:14833:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743706d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72a5858e-0958-4c77-91cf-d6507b930817:14833:1870622732935808:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1783965191.036805:0:14833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:2.0:1783965191.036823:0:14833:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:0.0:1783965191.038043:0:14847:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1783965191.038067:0:14847:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:0.0:1783965191.038075:0:14847:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783965191.038077:0:14847:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:0.0:1783965191.038085:0:14847:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1783965191.038101:0:14847:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9474259c8000) 00000020:00000080:0.0:1783965191.038138:0:14847:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:0.0:1783965191.038145:0:14847:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1783965191.038250:0:14847:0:(tgt_mount.c:153:server_get_mount()) get mount ffff947304973000 from lustre-OST0000, refs=2 00080000:01000000:0.0:1783965191.038257:0:14847:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:0.0:1783965191.038274:0:14847:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0xe782b916994fe58c 00010000:00010000:1.0:1783965191.046105:0:14847:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:1.0:1783965191.046845:0:14847:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:1.0:1783965191.050821:0:14847:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:0.0:1783965191.075182:0:14847:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1783965191.075196:0:14847:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783965191.075227:0:14847:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783965191.075231:0:14847:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1783965191.075235:0:14847:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1783965191.075238:0:14847:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #14 00000020:01000000:0.0:1783965191.075240:0:14847:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1783965191.075242:0:14847:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1783965191.075244:0:14847:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1783965191.075261:0:14847:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783965191.075263:0:14847:0:(obd_config.c:1561:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:0.0:1783965191.075266:0:14847:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783965191.075270:0:14847:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783965191.075271:0:14847:0:(obd_config.c:1561:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:0.0:1783965191.075274:0:14847:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1783965191.075276:0:14847:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1783965191.075278:0:14847:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783965191.075280:0:14847:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783965191.075282:0:14847:0:(obd_config.c:1561:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:0.0:1783965191.075284:0:14847:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783965191.075287:0:14847:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783965191.075288:0:14847:0:(obd_config.c:1561:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1783965191.075291:0:14847:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1783965191.075355:0:14847:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783965191.075359:0:14847:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783965191.075360:0:14847:0:(obd_config.c:1561:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1783965191.075364:0:14847:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:2.0:1783965191.078768:0:14833:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:2.0:1783965191.078828:0:14833:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.112@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1783965191.078856:0:14833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.112@tcp lock: ffff94743e2fc800/0xe782b916994fe577 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fe57e expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965191.078868:0:14833:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.112@tcp lock: ffff94743e2fc800/0xe782b916994fe577 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fe57e expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783965191.078876:0:14833:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff947304973000 from 1 10000000:01000000:2.0:1783965191.078879:0:14833:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783965191.079014:0:14833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.112@tcp lock: ffff947425975800/0xe782b916994fe593 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965191.079024:0:14833:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.112@tcp lock: ffff947425975800/0xe782b916994fe593 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965191.079034:0:14833:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.112@tcp lock: ffff947425975800/0xe782b916994fe593 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783965191.079066:0:14833:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743706d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72a5858e-0958-4c77-91cf-d6507b930817:14833:1870622732935936:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1783965191.079131:0:14833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783965191.079173:0:14833:0:(client.c:2702:ptlrpc_set_wait()) set ffff94743e29fe40 going to sleep for 11 seconds 00000100:00100000:0.0:1783965191.079259:0:14193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732935936 00000100:00100000:0.0:1783965191.079265:0:14193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732935936 00000100:00100000:0.0:1783965191.079303:0:14193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1783965191.079310:0:14193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94741cd53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72a5858e-0958-4c77-91cf-d6507b930817+14:14833:x1870622732935936:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783965191.079322:0:14193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783965191.079333:0:14193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94743e2fce00/0xe782b916994fe59a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe782b916994fe593 expref: -99 pid: 14193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965191.079353:0:14193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94743e2fce00/0xe782b916994fe59a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe782b916994fe593 expref: 15 pid: 14193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965191.079362:0:14193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94743e2fce00/0xe782b916994fe59a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe782b916994fe593 expref: 15 pid: 14193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965191.079369:0:14193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94743e2fce00, rc 0) 00000100:00100000:0.0:1783965191.079468:0:14193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94741cd53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72a5858e-0958-4c77-91cf-d6507b930817+15:14833:x1870622732935936:12345-0@lo:101:mount.lustre.0 Request processed in 158us (336us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965191.079483:0:14193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1783965191.087776:0:14833:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743706d180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72a5858e-0958-4c77-91cf-d6507b930817:14833:1870622732935936:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783965191.087807:0:14833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.112@tcp lock: ffff947425975800/0xe782b916994fe593 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fe59a expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965191.087820:0:14833:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.112@tcp lock: ffff947425975800/0xe782b916994fe593 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe782b916994fe59a expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783965191.089998:0:14833:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1783965191.092310:0:14833:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783965191.095141:0:14833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1783965191.096036:0:14833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1783965191.096157:0:14833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1783965191.096166:0:14833:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1783965191.096317:0:14833:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743706ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72a5858e-0958-4c77-91cf-d6507b930817:14833:1870622732936064:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783965191.096385:0:14833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783965191.096436:0:14833:0:(client.c:2702:ptlrpc_set_wait()) set ffff94743e29fcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1783965191.096854:0:14194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732936064 00000100:00100000:3.0:1783965191.096862:0:14194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732936064 00000100:00100000:2.0:1783965191.098556:0:14194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1783965191.098575:0:14194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94741cd51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72a5858e-0958-4c77-91cf-d6507b930817+15:14833:x1870622732936064:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783965191.098880:0:14194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94741cd51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72a5858e-0958-4c77-91cf-d6507b930817+15:14833:x1870622732936064:12345-0@lo:501:mount.lustre.0 Request processed in 310us (2495us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965191.098900:0:14194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1783965191.099016:0:14833:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743706ce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72a5858e-0958-4c77-91cf-d6507b930817:14833:1870622732936064:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783965191.099080:0:14833:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9474368d6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72a5858e-0958-4c77-91cf-d6507b930817:14833:1870622732936192:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783965191.099128:0:14833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783965191.099168:0:14833:0:(client.c:2702:ptlrpc_set_wait()) set ffff947436d0f840 going to sleep for 11 seconds 00000100:00100000:0.0:1783965191.099463:0:14193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732936192 00000100:00100000:0.0:1783965191.099470:0:14193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732936192 00000100:00100000:0.0:1783965191.099514:0:14193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1783965191.099521:0:14193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94741cd52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72a5858e-0958-4c77-91cf-d6507b930817+15:14833:x1870622732936192:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783965191.099696:0:14193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94741cd52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72a5858e-0958-4c77-91cf-d6507b930817+15:14833:x1870622732936192:12345-0@lo:503:mount.lustre.0 Request processed in 174us (567us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965191.099703:0:14193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1783965191.099782:0:14833:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9474368d6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72a5858e-0958-4c77-91cf-d6507b930817:14833:1870622732936192:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1783965191.100336:0:14833:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1783965191.100403:0:14833:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e29a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72a5858e-0958-4c77-91cf-d6507b930817:14833:1870622732936320:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783965191.100449:0:14833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783965191.100476:0:14833:0:(client.c:2702:ptlrpc_set_wait()) set ffff94741ccf1c00 going to sleep for 11 seconds 00000100:00100000:3.0:1783965191.100682:0:14194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732936320 00000100:00100000:3.0:1783965191.100688:0:14194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732936320 00000100:00100000:3.0:1783965191.100718:0:14194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1783965191.100726:0:14194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94741cd50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72a5858e-0958-4c77-91cf-d6507b930817+15:14833:x1870622732936320:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783965191.100910:0:14194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94741cd50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72a5858e-0958-4c77-91cf-d6507b930817+15:14833:x1870622732936320:12345-0@lo:502:mount.lustre.0 Request processed in 185us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965191.100925:0:14194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1783965191.101325:0:14833:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e29a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72a5858e-0958-4c77-91cf-d6507b930817:14833:1870622732936320:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1783965191.101606:0:14833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1783965191.101661:0:14833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1783965191.101713:0:14833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1783965191.101749:0:14833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1783965191.101795:0:14833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1783965191.101847:0:14833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1783965191.101882:0:14833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1783965191.102124:0:14833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:1.0:1783965191.102161:0:14833:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e29a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72a5858e-0958-4c77-91cf-d6507b930817:14833:1870622732936448:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783965191.102247:0:14833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783965191.102279:0:14833:0:(client.c:2702:ptlrpc_set_wait()) set ffff947414aa0c00 going to sleep for 11 seconds 00000100:00100000:3.0:1783965191.102413:0:14194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732936448 00000100:00100000:3.0:1783965191.102418:0:14194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732936448 00000100:00100000:3.0:1783965191.102464:0:14194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1783965191.102482:0:14194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436b8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72a5858e-0958-4c77-91cf-d6507b930817+15:14833:x1870622732936448:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783965191.102670:0:14194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436b8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72a5858e-0958-4c77-91cf-d6507b930817+15:14833:x1870622732936448:12345-0@lo:502:mount.lustre.0 Request processed in 198us (422us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965191.102677:0:14194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1783965191.102906:0:14833:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e29a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72a5858e-0958-4c77-91cf-d6507b930817:14833:1870622732936448:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1783965191.103005:0:14833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1783965191.103020:0:14833:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:1.0:1783965191.111119:0:14851:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783965191.111132:0:14851:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783965191.111135:0:14851:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1783965191.111142:0:14851:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff947304973000 00000020:00000080:1.0:1783965191.111144:0:14851:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1783965191.111152:0:14851:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783965191.111155:0:14851:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783965191.111156:0:14851:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1783965191.111158:0:14851:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783965191.111176:0:14851:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783965191.111178:0:14851:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1783965191.111182:0:14851:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff947304973000 00000020:00000080:1.0:1783965191.111184:0:14851:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1783965191.112241:0:14851:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783965191.112248:0:14851:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783965191.112250:0:14851:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1783965191.112252:0:14851:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1783965191.112255:0:14851:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783965191.112256:0:14851:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1783965191.112260:0:14851:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff947304973000 00000020:00000080:1.0:1783965191.112262:0:14851:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1783965191.112324:0:14851:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1783965191.112328:0:14851:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1783965191.112329:0:14851:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1783965191.112332:0:14851:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:0.0:1783965191.115043:0:14833:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1783965191.115117:0:14833:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1783965191.115143:0:14833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.112@tcp lock: ffff947425975800/0xe782b916994fe593 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fe59a expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965191.115156:0:14833:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.112@tcp lock: ffff947425975800/0xe782b916994fe593 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fe59a expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783965191.115227:0:14833:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1783965191.115230:0:14833:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff947304973000 10000000:01000000:0.0:1783965191.115233:0:14833:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff947304973000 10000000:01000000:0.0:1783965191.115237:0:14833:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1783965191.115243:0:14833:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff947304973000 from 1 10000000:01000000:0.0:1783965191.115245:0:14833:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1783965191.115285:0:14833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.112@tcp lock: ffff94743e2fd800/0xe782b916994fe5a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965191.115302:0:14833:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.112@tcp lock: ffff94743e2fd800/0xe782b916994fe5a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965191.115313:0:14833:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.112@tcp lock: ffff94743e2fd800/0xe782b916994fe5a1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783965191.115339:0:14833:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743fb9e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72a5858e-0958-4c77-91cf-d6507b930817:14833:1870622732936576:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1783965191.115408:0:14833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783965191.115453:0:14193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732936576 00000100:00100000:0.0:1783965191.115460:0:14193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732936576 00000100:00100000:0.0:1783965191.115505:0:14193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1783965191.115515:0:14193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436b8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72a5858e-0958-4c77-91cf-d6507b930817+15:14833:x1870622732936576:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783965191.115527:0:14193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783965191.115538:0:14193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94743e2fda00/0xe782b916994fe5a8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xe782b916994fe5a1 expref: -99 pid: 14193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965191.115560:0:14193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94743e2fda00/0xe782b916994fe5a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe782b916994fe5a1 expref: 16 pid: 14193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965191.115570:0:14193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94743e2fda00/0xe782b916994fe5a8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe782b916994fe5a1 expref: 16 pid: 14193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965191.115579:0:14193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94743e2fda00, rc 0) 00000100:00100000:0.0:1783965191.115612:0:14193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436b8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72a5858e-0958-4c77-91cf-d6507b930817+16:14833:x1870622732936576:12345-0@lo:101:mount.lustre.0 Request processed in 99us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965191.115618:0:14193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1783965191.115664:0:14833:0:(client.c:2702:ptlrpc_set_wait()) set ffff947410edf240 going to sleep for 11 seconds 00000100:00100000:0.0:1783965191.115693:0:14833:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743fb9e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72a5858e-0958-4c77-91cf-d6507b930817:14833:1870622732936576:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783965191.115707:0:14833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.112@tcp lock: ffff94743e2fd800/0xe782b916994fe5a1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fe5a8 expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965191.115715:0:14833:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.112@tcp lock: ffff94743e2fd800/0xe782b916994fe5a1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0xe782b916994fe5a8 expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1783965191.116406:0:14833:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:0.0:1783965191.116954:0:14833:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1783965191.117312:0:14833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:0.0:1783965191.117362:0:14833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:0.0:1783965191.117402:0:14833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:0.0:1783965191.117454:0:14833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:0.0:1783965191.117496:0:14833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:0.0:1783965191.117549:0:14833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:0.0:1783965191.117588:0:14833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:0.0:1783965191.117623:0:14833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:0.0:1783965191.117675:0:14833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:0.0:1783965191.117710:0:14833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:0.0:1783965191.117746:0:14833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:0.0:1783965191.117793:0:14833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:0.0:1783965191.117848:0:14833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:0.0:1783965191.117886:0:14833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:0.0:1783965191.117936:0:14833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:0.0:1783965191.117974:0:14833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:0.0:1783965191.118007:0:14833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:0.0:1783965191.128069:0:14833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:0.0:1783965191.128229:0:14833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:0.0:1783965191.128266:0:14833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:0.0:1783965191.128343:0:14833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:0.0:1783965191.128384:0:14833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:0.0:1783965191.128419:0:14833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:0.0:1783965191.128625:0:14833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:0.0:1783965191.128669:0:14833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:0.0:1783965191.128704:0:14833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:0.0:1783965191.128757:0:14833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:0.0:1783965191.128791:0:14833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:0.0:1783965191.129094:0:14833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:0.0:1783965191.129105:0:14833:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:0.0:1783965191.130135:0:14833:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743fb9e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72a5858e-0958-4c77-91cf-d6507b930817:14833:1870622732936704:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783965191.130224:0:14833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783965191.130269:0:14833:0:(client.c:2702:ptlrpc_set_wait()) set ffff947410edf240 going to sleep for 11 seconds 00000100:00100000:0.0:1783965191.132158:0:14192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732936704 00000100:00100000:0.0:1783965191.132170:0:14192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732936704 00000100:00100000:0.0:1783965191.132305:0:14192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1783965191.132316:0:14192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436b8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72a5858e-0958-4c77-91cf-d6507b930817+16:14833:x1870622732936704:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783965191.133450:0:14192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436b8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72a5858e-0958-4c77-91cf-d6507b930817+16:14833:x1870622732936704:12345-0@lo:501:mount.lustre.0 Request processed in 1132us (3220us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965191.133462:0:14192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1783965191.134030:0:14833:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743fb9e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72a5858e-0958-4c77-91cf-d6507b930817:14833:1870622732936704:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783965191.134097:0:14833:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743fb9e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72a5858e-0958-4c77-91cf-d6507b930817:14833:1870622732936832:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783965191.134148:0:14833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783965191.134679:0:14833:0:(client.c:2702:ptlrpc_set_wait()) set ffff947410edf240 going to sleep for 11 seconds 00000100:00100000:3.0:1783965191.140995:0:14194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732936832 00000100:00100000:3.0:1783965191.141008:0:14194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732936832 00000100:00100000:3.0:1783965191.141079:0:14194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1783965191.141091:0:14194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436b8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72a5858e-0958-4c77-91cf-d6507b930817+16:14833:x1870622732936832:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783965191.141983:0:14194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436b8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72a5858e-0958-4c77-91cf-d6507b930817+16:14833:x1870622732936832:12345-0@lo:503:mount.lustre.0 Request processed in 891us (7831us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965191.141994:0:14194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1783965191.142292:0:14833:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743fb9e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72a5858e-0958-4c77-91cf-d6507b930817:14833:1870622732936832:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1783965191.145430:0:14833:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1783965191.145538:0:14833:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e29b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72a5858e-0958-4c77-91cf-d6507b930817:14833:1870622732936960:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783965191.145625:0:14833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783965191.145673:0:14833:0:(client.c:2702:ptlrpc_set_wait()) set ffff947414aa0240 going to sleep for 11 seconds 00000100:00100000:0.0:1783965191.146066:0:14193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732936960 00000100:00100000:0.0:1783965191.146074:0:14193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732936960 00000100:00100000:0.0:1783965191.146123:0:14193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1783965191.146133:0:14193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436b8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72a5858e-0958-4c77-91cf-d6507b930817+16:14833:x1870622732936960:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783965191.146398:0:14193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436b8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72a5858e-0958-4c77-91cf-d6507b930817+16:14833:x1870622732936960:12345-0@lo:502:mount.lustre.0 Request processed in 266us (772us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965191.146415:0:14193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1783965191.146526:0:14833:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e29b480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72a5858e-0958-4c77-91cf-d6507b930817:14833:1870622732936960:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1783965191.146795:0:14833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1783965191.146840:0:14833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1783965191.146866:0:14833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1783965191.147035:0:14833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1783965191.147084:0:14833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1783965191.147130:0:14833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1783965191.147168:0:14833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1783965191.147253:0:14833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1783965191.147296:0:14833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1783965191.147324:0:14833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1783965191.147349:0:14833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1783965191.147406:0:14833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1783965191.147437:0:14833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1783965191.147463:0:14833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1783965191.147499:0:14833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1783965191.147526:0:14833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1783965191.147746:0:14833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1783965191.147800:0:14833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1783965191.147835:0:14833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1783965191.147869:0:14833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1783965191.148103:0:14833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1783965191.148143:0:14833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1783965191.148180:0:14833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1783965191.148360:0:14833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1783965191.148397:0:14833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:3.0:1783965191.148430:0:14833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:3.0:1783965191.148618:0:14833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:3.0:1783965191.148660:0:14833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:3.0:1783965191.148689:0:14833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:3.0:1783965191.148729:0:14833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:3.0:1783965191.148757:0:14833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:3.0:1783965191.148782:0:14833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:3.0:1783965191.148807:0:14833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:3.0:1783965191.148856:0:14833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:3.0:1783965191.149332:0:14833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:3.0:1783965191.149402:0:14833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:3.0:1783965191.149438:0:14833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:3.0:1783965191.149964:0:14833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:3.0:1783965191.150033:0:14833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:3.0:1783965191.150719:0:14833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:3.0:1783965191.150775:0:14833:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9474368d6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72a5858e-0958-4c77-91cf-d6507b930817:14833:1870622732937088:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783965191.150855:0:14833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783965191.154269:0:14833:0:(client.c:2702:ptlrpc_set_wait()) set ffff947406020300 going to sleep for 11 seconds 00000100:00100000:0.0:1783965191.155779:0:14194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732937088 00000100:00100000:0.0:1783965191.155792:0:14194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732937088 00000100:00100000:0.0:1783965191.155967:0:14194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1783965191.155978:0:14194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436b8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72a5858e-0958-4c77-91cf-d6507b930817+16:14833:x1870622732937088:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783965191.156299:0:14194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436b8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72a5858e-0958-4c77-91cf-d6507b930817+16:14833:x1870622732937088:12345-0@lo:502:mount.lustre.0 Request processed in 322us (5443us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965191.156307:0:14194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1783965191.156407:0:14833:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9474368d6d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72a5858e-0958-4c77-91cf-d6507b930817:14833:1870622732937088:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1783965191.156534:0:14833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:3.0:1783965191.156744:0:14833:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:1.0:1783965191.160844:0:14856:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1783965191.160874:0:14856:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff947306a88000) 00000020:00000080:1.0:1783965191.160910:0:14856:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:1.0:1783965191.161046:0:14856:0:(tgt_mount.c:153:server_get_mount()) get mount ffff947304973000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1783965191.161050:0:14856:0:(tgt_mount.c:187:server_put_mount()) put mount ffff947304973000 from lustre-OST0000, refs=3 00000020:01000004:1.0:1783965191.161065:0:14856:0:(obd_mount.c:710:lustre_put_lsi()) put ffff947304973000 3 00010000:00080000:1.0:1783965191.161095:0:14856:0:(ldlm_lib.c:102:import_set_conn()) imp ffff94743e55e000@lustre-MDT0000-lwp-OST0000: add connection 192.168.204.112@tcp at head 00010000:00010000:3.0:1783965191.169986:0:14856:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:3.0:1783965191.170126:0:14856:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:3.0:1783965191.170170:0:14856:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1783965191.170183:0:14856:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0xe782b916994fe5b6 00000100:00080000:3.0:1783965191.170193:0:14856:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1783965191.170213:0:14856:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff94743e55e000 using connection 192.168.204.112@tcp/0@lo 00000100:00100000:3.0:1783965191.170253:0:14856:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9474368d6d80 x1870622732937216/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1783965191.170283:0:14856:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1783965191.170842:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9474368d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3321:1870622732937216:0@lo:38:llog_process_th.0 00000100:00080000:2.0:1783965191.171921:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783965191.171927:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1783965191.171930:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783965191.171934:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1783965191.171992:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743706ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3324:1870622732937344:0@lo:400:kworker.0 00000040:00080000:0.0:1783965191.172978:0:14856:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:3.0:1783965191.173342:0:14833:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1783965191.173396:0:14833:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.112@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1783965191.173422:0:14833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.112@tcp lock: ffff94743e2fd800/0xe782b916994fe5a1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fe5a8 expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965191.173433:0:14833:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.112@tcp lock: ffff94743e2fd800/0xe782b916994fe5a1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fe5a8 expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1783965191.173487:0:14833:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1783965191.173489:0:14833:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1783965191.173490:0:14833:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783965191.173491:0:14833:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783965191.173492:0:14833:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783965191.173494:0:14833:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783965191.173495:0:14833:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783965191.173497:0:14833:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783965191.173498:0:14833:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1783965191.173502:0:14833:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:3.0:1783965191.173504:0:14833:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1783965191.173511:0:14833:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1783965191.173511:0:14833:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783965191.173512:0:14833:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783965191.173513:0:14833:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783965191.173514:0:14833:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783965191.173515:0:14833:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783965191.173516:0:14833:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783965191.173517:0:14833:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1783965191.173807:0:14833:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1783965191.173827:0:14833:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9474368d4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72a5858e-0958-4c77-91cf-d6507b930817:14833:1870622732937472:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1783965191.178501:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783965191.178810:0:14199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732937344 00000100:00100000:0.0:1783965191.178820:0:14199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732937344 00000100:00100000:0.0:1783965191.178865:0:14199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783965191.178874:0:14199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743706d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3324:x1870622732937344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783965191.178946:0:14199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743706d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3324:x1870622732937344:12345-0@lo:400:kworker.0 Request processed in 73us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965191.178954:0:14199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1783965191.179188:0:3324:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff94743706ce00 x1870622732937344/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783965207 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783965191.179225:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743706ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3324:1870622732937344:0@lo:400:kworker.0 00000100:00100000:1.0:1783965191.180189:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783965191.180352:0:14201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732937216 00000100:00100000:2.0:1783965191.180359:0:14201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732937216 00000100:00100000:2.0:1783965191.180387:0:14201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783965191.180394:0:14201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e29a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3321:x1870622732937216:12345-0@lo:38:llog_process_th.0 00010000:00080000:2.0:1783965191.180420:0:14201:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 425 last 0 00000020:00000080:2.0:1783965191.180458:0:14201:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0xe782b916994fe5bd 00000004:00100000:2.0:1783965191.180473:0:14201:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1783965191.180505:0:14201:0:(import.c:65:import_set_state_nolock()) ffff947304b99800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783965191.180570:0:14201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e29a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3321:x1870622732937216:12345-0@lo:38:llog_process_th.0 Request processed in 175us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965191.180587:0:14201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1783965191.180782:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9474368d6d80 x1870622732937216/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783965201 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783965191.180792:0:3321:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1783965191.180798:0:3321:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:1.0:1783965191.180805:0:3321:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1783965191.180809:0:3321:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1783965191.180812:0:3321:0:(import.c:65:import_set_state_nolock()) ffff94743e55e000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1783965191.180817:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9474368d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3321:1870622732937216:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1783965191.184807:0:14833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783965191.185382:0:14833:0:(client.c:2702:ptlrpc_set_wait()) set ffff947406020cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1783965191.188174:0:14192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732937472 00000100:00100000:1.0:1783965191.188187:0:14192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732937472 00000100:00100000:1.0:1783965191.188414:0:14192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1783965191.188425:0:14192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436b8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72a5858e-0958-4c77-91cf-d6507b930817+16:14833:x1870622732937472:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1783965191.188461:0:14192:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1783965191.188475:0:14192:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1783965191.250957:0:14192:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1783965191.250981:0:14192:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1783965191.251039:0:14215:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1783965191.251044:0:14215:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1783965191.251075:0:14215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff94743d9eee00/0xe782b916994fe5c4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965191.251094:0:14215:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff947425974200/0xe782b916994fe531 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe782b916994fe52a expref: 16 pid: 14193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965191.251102:0:14215:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff94743d9eee00/0xe782b916994fe5c4 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965191.251144:0:14215:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff947425974200/0xe782b916994fe531 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe782b916994fe52a expref: 16 pid: 14193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965191.251158:0:14215:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff947425974200/0xe782b916994fe531 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe782b916994fe52a expref: 16 pid: 14193 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783965191.251187:0:14215:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e299c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14215:1870622732937600:0@lo:104: 00000100:00100000:1.0:1783965191.251290:0:14215:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783965191.251342:0:14215:0:(client.c:2702:ptlrpc_set_wait()) set ffff947414aa03c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783965191.251426:0:14182:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732937600 00000100:00100000:0.0:1783965191.251434:0:14182:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732937600 00000100:00100000:0.0:1783965191.251500:0:14182:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783965191.251511:0:14182:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e298a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:72a5858e-0958-4c77-91cf-d6507b930817+3:14215:x1870622732937600:12345-0@lo:104: 00010000:00010000:0.0:1783965191.251523:0:14182:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.112@tcp lock: ffff94743d9ee400/0xe782b916994fe52a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe782b916994fe531 expref: -99 pid: 14196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965191.251580:0:14182:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1783965191.251586:0:14182:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e298a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:72a5858e-0958-4c77-91cf-d6507b930817+3:14215:x1870622732937600:12345-0@lo:104: Request processed in 78us (297us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965191.251593:0:14182:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:1.0:1783965191.251712:0:14187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783965191.251719:0:14187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.112@tcp lock: ffff94743d9ee400/0xe782b916994fe52a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe782b916994fe531 expref: -99 pid: 14196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965191.251726:0:14187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743d9ee400 already unused, calling callback (ffffffffc1ca8c20) 10000000:00010000:1.0:1783965191.251729:0:14187:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.112@tcp lock: ffff94743d9ee400/0xe782b916994fe52a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe782b916994fe531 expref: -99 pid: 14196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965191.251737:0:14187:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.112@tcp lock: ffff94743d9ee400/0xe782b916994fe52a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe782b916994fe531 expref: -99 pid: 14196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1783965191.251743:0:14187:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.112@tcp lock: ffff94743d9ee400/0xe782b916994fe52a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe782b916994fe531 expref: -99 pid: 14196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783965191.251749:0:14187:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1783965191.251785:0:14187:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.112@tcp lock: ffff94743d9ee400/0xe782b916994fe52a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe782b916994fe531 expref: -99 pid: 14196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965191.251791:0:14187:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1783965191.251810:0:14187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.112@tcp lock: ffff94743d9ee400/0xe782b916994fe52a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe782b916994fe531 expref: -99 pid: 14196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965191.251817:0:14187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.112@tcp lock: ffff94743d9ee400/0xe782b916994fe52a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe782b916994fe531 expref: -99 pid: 14196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965191.251840:0:14187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783965191.251848:0:14187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783965191.251849:0:14187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783965191.251857:0:3324:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783965191.251868:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e299500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:72a5858e-0958-4c77-91cf-d6507b930817:3324:1870622732937728:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783965191.251898:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783965191.251944:0:14215:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e299c00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14215:1870622732937600:0@lo:104: 00010000:00010000:1.0:1783965191.251966:0:14215:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff94743d9eee00/0xe782b916994fe5c4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783965191.252112:0:14186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732937728 00000100:00100000:2.0:1783965191.252119:0:14186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732937728 00010000:00010000:2.0:1783965191.252141:0:14186:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff947425974200/0xe782b916994fe531 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe782b916994fe52a expref: 17 pid: 14193 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783965191.252164:0:14186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783965191.252171:0:14186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e299180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:72a5858e-0958-4c77-91cf-d6507b930817+17:3324:x1870622732937728:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783965191.252229:0:14186:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783965191.252236:0:14186:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff947425974200/0xe782b916994fe531 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe782b916994fe52a expref: 17 pid: 14193 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965191.252246:0:14186:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff947425974200/0xe782b916994fe531 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe782b916994fe52a expref: 17 pid: 14193 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965191.252259:0:14186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff947425974200/0xe782b916994fe531 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe782b916994fe52a expref: 17 pid: 14193 timeout: 525 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965191.252270:0:14186:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff94743d9eee00/0xe782b916994fe5c4 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965191.252278:0:14186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94743d9eee00/0xe782b916994fe5c4 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1783965191.252289:0:14186:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001342130s 00010000:00010000:2.0:1783965191.252294:0:14186:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff94743d9eee00/0xe782b916994fe5c4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965191.252300:0:14186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff94743d9eee00/0xe782b916994fe5c4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965191.252318:0:14186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff94743d9eee00/0xe782b916994fe5c4 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965191.252325:0:14186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff94743d9eee00/0xe782b916994fe5c4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965191.252329:0:14186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743d9eee00 already unused, calling callback (ffffffffc168d230) 00010000:00010000:2.0:1783965191.252333:0:14186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff94743d9eee00/0xe782b916994fe5c4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965191.252341:0:14186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff94743d9eee00/0xe782b916994fe5c4 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965191.252355:0:14186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff94743d9eee00/0xe782b916994fe5c4 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965191.252363:0:14186:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783965191.252399:0:14186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e299180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:72a5858e-0958-4c77-91cf-d6507b930817+16:3324:x1870622732937728:12345-0@lo:103:ldlm_bl.0 Request processed in 228us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965191.252405:0:14186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783965191.252436:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e299500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:72a5858e-0958-4c77-91cf-d6507b930817:3324:1870622732937728:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783965191.252452:0:14215:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff94743d9eee00/0xe782b916994fe5c4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965191.252459:0:14215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff94743d9eee00/0xe782b916994fe5c4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965191.252675:0:14215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94743d9eee00/0xe782b916994fe5c4 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783965191.262312:0:14192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436b8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72a5858e-0958-4c77-91cf-d6507b930817+15:14833:x1870622732937472:12345-0@lo:253:mount.lustre.0 Request processed in 73879us (77503us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965191.262327:0:14192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1783965191.262548:0:14833:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9474368d4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72a5858e-0958-4c77-91cf-d6507b930817:14833:1870622732937472:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1783965191.262564:0:14833:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1783965191.262567:0:14833:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1783965191.262569:0:14833:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1783965191.262570:0:14833:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783965191.262572:0:14833:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783965191.262573:0:14833:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783965191.262574:0:14833:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783965191.262575:0:14833:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783965191.262577:0:14833:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783965191.262578:0:14833:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1783965191.262598:0:14833:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1783965191.270083:0:14833:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1783965191.270715:0:14833:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1783965191.270899:0:14833:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1783965191.271076:0:14833:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1783965191.272705:0:14833:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1783965191.273002:0:14833:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1783965191.275014:0:14833:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1783965191.393832:0:14833:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1783965191.393841:0:14833:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1783965191.393898:0:14833:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1783965191.393982:0:14833:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.112@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1783965191.393999:0:14833:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1783965191.394034:0:14833:0:(super25.c:181:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:2.0:1783965191.723399:0:14188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783965192.747552:0:14187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1783965193.132324:0:14196:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1783965193.132337:0:14196:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff94743fbe4800 from 7 10000000:01000000:0.0:1783965193.132341:0:14196:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1783965193.132388:0:14196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.112@tcp lock: ffff94743e2fde00/0xe782b916994fe5cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965193.132400:0:14196:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.112@tcp lock: ffff94743e2fde00/0xe782b916994fe5cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965193.132409:0:14196:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.112@tcp lock: ffff94743e2fde00/0xe782b916994fe5cb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783965193.132446:0:14196:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743fb9f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72a5858e-0958-4c77-91cf-d6507b930817:14196:1870622732937856:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1783965193.132511:0:14196:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783965193.132555:0:14196:0:(client.c:2702:ptlrpc_set_wait()) set ffff947407e29cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1783965193.132586:0:14194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732937856 00000100:00100000:0.0:1783965193.132593:0:14194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732937856 00000100:00100000:0.0:1783965193.132639:0:14194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1783965193.132647:0:14194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436b8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72a5858e-0958-4c77-91cf-d6507b930817+15:14196:x1870622732937856:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783965193.132660:0:14194:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783965193.132672:0:14194:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94743e2fd400/0xe782b916994fe5d2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe782b916994fe5cb expref: -99 pid: 14194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965193.132695:0:14194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94743e2fd400/0xe782b916994fe5d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe782b916994fe5cb expref: 16 pid: 14194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965193.132705:0:14194:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94743e2fd400/0xe782b916994fe5d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe782b916994fe5cb expref: 16 pid: 14194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965193.132713:0:14194:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94743e2fd400, rc 0) 00000100:00100000:0.0:1783965193.132753:0:14194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436b8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72a5858e-0958-4c77-91cf-d6507b930817+16:14196:x1870622732937856:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 106us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965193.132765:0:14194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1783965193.132818:0:14196:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743fb9f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72a5858e-0958-4c77-91cf-d6507b930817:14196:1870622732937856:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783965193.132833:0:14196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.112@tcp lock: ffff94743e2fde00/0xe782b916994fe5cb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fe5d2 expref: -99 pid: 14196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965193.132842:0:14196:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.112@tcp lock: ffff94743e2fde00/0xe782b916994fe5cb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe782b916994fe5d2 expref: -99 pid: 14196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783965193.132890:0:14196:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743fb9f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72a5858e-0958-4c77-91cf-d6507b930817:14196:1870622732937984:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1783965193.132919:0:14196:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783965193.132934:0:14196:0:(client.c:2702:ptlrpc_set_wait()) set ffff947405224e40 going to sleep for 11 seconds 00000100:00100000:1.0:1783965193.133304:0:14192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732937984 00000100:00100000:1.0:1783965193.133310:0:14192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732937984 00000100:00100000:1.0:1783965193.133349:0:14192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1783965193.133356:0:14192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436b8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72a5858e-0958-4c77-91cf-d6507b930817+16:14196:x1870622732937984:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1783965193.133370:0:14192:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1783965193.133386:0:14192:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1783965193.133388:0:14192:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:1.0:1783965193.133653:0:14192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436b8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72a5858e-0958-4c77-91cf-d6507b930817+16:14196:x1870622732937984:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 297us (731us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965193.133660:0:14192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1783965193.133838:0:14196:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743fb9f480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72a5858e-0958-4c77-91cf-d6507b930817:14196:1870622732937984:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1783965193.133904:0:14196:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.112@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1783965193.133913:0:14196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.112@tcp lock: ffff94743e2fde00/0xe782b916994fe5cb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fe5d2 expref: -99 pid: 14196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965193.133923:0:14196:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.112@tcp lock: ffff94743e2fde00/0xe782b916994fe5cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fe5d2 expref: -99 pid: 14196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965193.771586:0:14188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783965194.802631:0:14187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783965195.819393:0:14188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1783965196.332340:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783965196.332349:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1783965196.332352:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783965196.332355:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1783965196.332428:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743fb9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:72a5858e-0958-4c77-91cf-d6507b930817:3322:1870622732938112:0@lo:400:kworker.0 00000100:00100000:0.0:1783965196.332537:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783965196.332606:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783965196.332613:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743fb9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3322:1870622732938240:0@lo:400:kworker.0 00000100:00100000:0.0:1783965196.332648:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783965196.332710:0:14200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732938240 00000100:00100000:2.0:1783965196.332724:0:14200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732938240 00000100:00100000:0.0:1783965196.332776:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743fb9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3324:1870622732938368:0@lo:400:kworker.0 00000100:00100000:2.0:1783965196.332778:0:14200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783965196.332803:0:14200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743fb9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3322:x1870622732938240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783965196.332828:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783965196.332874:0:14193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732938112 00000100:00100000:0.0:1783965196.332880:0:14193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732938112 00000100:00100000:2.0:1783965196.332913:0:14200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743fb9ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3322:x1870622732938240:12345-0@lo:400:kworker.0 Request processed in 115us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965196.332923:0:14200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1783965196.332934:0:14193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1783965196.332947:0:14193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436b8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72a5858e-0958-4c77-91cf-d6507b930817+16:3322:x1870622732938112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783965196.332949:0:14200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732938368 00000100:00100000:2.0:1783965196.332969:0:14200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732938368 00000100:00100000:0.0:1783965196.333023:0:14193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436b8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72a5858e-0958-4c77-91cf-d6507b930817+16:3322:x1870622732938112:12345-0@lo:400:kworker.0 Request processed in 73us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965196.333032:0:14200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783965196.333041:0:14193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1783965196.333048:0:14200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743fb9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3324:x1870622732938368:12345-0@lo:400:kworker.0 00010000:00080000:0.0:1783965196.333119:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94743fb9e300 x1870622732938240/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783965212 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783965196.333121:0:14200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743fb9fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3324:x1870622732938368:12345-0@lo:400:kworker.0 Request processed in 76us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965196.333157:0:14200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783965196.333167:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743fb9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3322:1870622732938240:0@lo:400:kworker.0 00000100:00100000:0.0:1783965196.333183:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743fb9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:72a5858e-0958-4c77-91cf-d6507b930817:3322:1870622732938112:0@lo:400:kworker.0 00010000:00080000:0.0:1783965196.333258:0:3324:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94743fb9d180 x1870622732938368/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783965212 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783965196.333268:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743fb9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3324:1870622732938368:0@lo:400:kworker.0 00000100:00080000:1.0:1783965196.333973:0:14195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1783965196.843614:0:14187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783965197.867385:0:14188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1783965198.431682:0:15201:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg412-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1783965198.891518:0:14187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1783965199.280193:0:14233:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1783965199.917507:0:14188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783965200.940311:0:14187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1783965201.453350:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783965201.453357:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1783965201.453360:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1783965201.453960:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1783965201.454062:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743fb9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:72a5858e-0958-4c77-91cf-d6507b930817:3325:1870622732938496:0@lo:400:kworker.0 00000100:00100000:0.0:1783965201.454124:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783965201.454173:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743fb9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3323:1870622732938752:0@lo:400:kworker.0 00000100:00100000:0.0:1783965201.454197:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783965201.454232:0:3323:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783965201.454237:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743fb9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3323:1870622732938624:0@lo:400:kworker.0 00000100:00100000:0.0:1783965201.454256:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783965201.454451:0:14194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732938496 00000100:00100000:0.0:1783965201.454457:0:14194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732938496 00000100:00100000:0.0:1783965201.454498:0:14194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1783965201.454506:0:14194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436b8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72a5858e-0958-4c77-91cf-d6507b930817+16:3325:x1870622732938496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783965201.454553:0:14194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436b8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72a5858e-0958-4c77-91cf-d6507b930817+16:3325:x1870622732938496:12345-0@lo:400:kworker.0 Request processed in 47us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965201.454560:0:14194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1783965201.454715:0:14199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732938752 00000100:00100000:0.0:1783965201.454719:0:14199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732938752 00000100:00100000:0.0:1783965201.454749:0:14199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732938624 00000100:00100000:0.0:1783965201.454751:0:14199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732938624 00000100:00100000:0.0:1783965201.454763:0:14199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1783965201.454769:0:14199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743fb9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3323:x1870622732938752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783965201.454801:0:14199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743fb9d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3323:x1870622732938752:12345-0@lo:400:kworker.0 Request processed in 33us (604us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965201.454808:0:14199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1783965201.454818:0:14199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783965201.454823:0:14199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743fb9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3323:x1870622732938624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783965201.454854:0:14199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743fb9ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3323:x1870622732938624:12345-0@lo:400:kworker.0 Request processed in 31us (596us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965201.454871:0:14199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783965201.454914:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743fb9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:72a5858e-0958-4c77-91cf-d6507b930817:3325:1870622732938496:0@lo:400:kworker.0 00010000:00080000:0.0:1783965201.454942:0:3323:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94743fb9f480 x1870622732938624/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783965217 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783965201.454953:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743fb9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3323:1870622732938624:0@lo:400:kworker.0 00010000:00080000:0.0:1783965201.454961:0:3323:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94743fb9e300 x1870622732938752/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783965217 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783965201.454969:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743fb9e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3323:1870622732938752:0@lo:400:kworker.0 00000100:00080000:1.0:1783965201.465075:0:14195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1783965201.965092:0:14188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783965202.478909:0:3321:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783965187/real 1783965187] req@ffff94743706c380 x1870622732934528/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783965202 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783965202.478946:0:3321:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff94743706c380 x1870622732934528/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783965202 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783965202.478956:0:3321:0:(client.c:2490:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1783965187/real 1783965187] req@ffff94743706d880 x1870622732934656/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783965202 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783965202.478967:0:3321:0:(client.c:2521:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff94743706d880 x1870622732934656/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1783965202 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1783965202.478985:0:3321:0:(import.c:65:import_set_state_nolock()) ffff94741cdbf000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783965202.479006:0:3321:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1783965202.479010:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743706c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3321:1870622732934528:0@lo:8:kworker.0 00000100:00080000:1.0:1783965202.479015:0:3321:0:(import.c:65:import_set_state_nolock()) ffff947405904000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1783965202.479020:0:3321:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1783965202.479023:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743706d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3321:1870622732934656:0@lo:8:kworker.0 00000100:00080000:1.0:1783965202.479084:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783965202.479088:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1783965202.479090:0:37:0:(import.c:65:import_set_state_nolock()) ffff94741cdbf000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783965202.479095:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 421 00000100:00080000:1.0:1783965202.479099:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1783965202.479106:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff94741cdbf000 using connection 192.168.204.112@tcp/0@lo 00000100:00100000:1.0:1783965202.479122:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94743e298e00 x1870622732939008/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1783965202.479134:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1783965202.479137:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1783965202.479143:0:37:0:(import.c:65:import_set_state_nolock()) ffff947405904000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1783965202.479146:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 421 00000100:00080000:1.0:1783965202.479148:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1783965202.479152:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff947405904000 using connection 192.168.204.112@tcp/0@lo 00000100:00100000:1.0:1783965202.479162:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94743e29b800 x1870622732939136/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1783965202.479217:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e299c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:72a5858e-0958-4c77-91cf-d6507b930817:3324:1870622732938880:0@lo:400:kworker.0 00000100:00100000:1.0:1783965202.479275:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783965202.479321:0:3324:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783965202.479327:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e29b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3324:1870622732939264:0@lo:400:kworker.0 00000100:00100000:1.0:1783965202.479353:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783965202.479382:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e299f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3322:1870622732939392:0@lo:400:kworker.0 00000100:00100000:1.0:1783965202.479403:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783965202.479440:0:14192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732938880 00000100:00100000:1.0:1783965202.479447:0:14192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732938880 00000100:00100000:1.0:1783965202.479495:0:14192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1783965202.479503:0:14192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436b8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72a5858e-0958-4c77-91cf-d6507b930817+16:3324:x1870622732938880:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783965202.479545:0:14192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436b8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72a5858e-0958-4c77-91cf-d6507b930817+16:3324:x1870622732938880:12345-0@lo:400:kworker.0 Request processed in 42us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965202.479552:0:14192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1783965202.479579:0:14199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732939264 00000100:00100000:1.0:1783965202.479582:0:14199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732939264 00000100:00100000:1.0:1783965202.479603:0:14199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732939392 00000100:00100000:1.0:1783965202.479605:0:14199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732939392 00000100:00100000:1.0:1783965202.479617:0:14199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783965202.479623:0:14199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e29aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3324:x1870622732939264:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783965202.479659:0:14199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e29aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3324:x1870622732939264:12345-0@lo:400:kworker.0 Request processed in 37us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965202.479666:0:14199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783965202.479676:0:14199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1783965202.479683:0:14199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e299880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3322:x1870622732939392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783965202.479706:0:14199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e299880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3322:x1870622732939392:12345-0@lo:400:kworker.0 Request processed in 25us (302us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965202.479711:0:14199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1783965202.479756:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94743e299f80 x1870622732939392/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783965218 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783965202.479767:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e299f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3322:1870622732939392:0@lo:400:kworker.0 00010000:00080000:1.0:1783965202.479786:0:3324:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94743e29b100 x1870622732939264/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783965218 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783965202.479794:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e29b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3324:1870622732939264:0@lo:400:kworker.0 00000100:00100000:1.0:1783965202.479802:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e299c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:72a5858e-0958-4c77-91cf-d6507b930817:3324:1870622732938880:0@lo:400:kworker.0 00000100:00100000:1.0:1783965202.479814:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e298e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3321:1870622732939008:0@lo:8:kworker.0 00000100:00100000:1.0:1783965202.479835:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783965202.479865:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e29b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3321:1870622732939136:0@lo:8:kworker.0 00000100:00100000:1.0:1783965202.479882:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783965202.480352:0:14834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732939008 00000100:00100000:2.0:1783965202.480358:0:14834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732939008 00000100:00100000:2.0:1783965202.480373:0:14834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732939136 00000100:00100000:2.0:1783965202.480375:0:14834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732939136 00000100:00100000:2.0:1783965202.480385:0:14834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783965202.480390:0:14834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e299c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3321:x1870622732939008:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1783965202.480415:0:14834:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 436 last 0 00000020:00000080:2.0:1783965202.480460:0:14834:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe782b916994fe5d9 00002000:00100000:2.0:1783965202.480473:0:14834:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff947304b9e000 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136a2 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1783965202.480477:0:14834:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1783965202.480486:0:14834:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1783965202.480790:0:14834:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1783965202.480812:0:14834:0:(import.c:65:import_set_state_nolock()) ffff947304b9f000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783965202.480876:0:14834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e299c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3321:x1870622732939008:12345-0@lo:8:kworker.0 Request processed in 485us (1040us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965202.480883:0:14834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783965202.480896:0:14834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783965202.480900:0:14834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e29b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3321:x1870622732939136:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1783965202.480911:0:14834:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1783965202.480932:0:14834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e29b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3321:x1870622732939136:12345-0@lo:8:kworker.0 Request processed in 31us (1049us total) trans 0 rc -19/-19 00000100:00100000:2.0:1783965202.480938:0:14834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1783965202.480983:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94743e298e00 x1870622732939008/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783965222 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783965202.480992:0:3321:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1783965202.480998:0:3321:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1783965202.481005:0:3321:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1783965202.481009:0:3321:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1783965202.481012:0:3321:0:(import.c:65:import_set_state_nolock()) ffff94741cdbf000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1783965202.481031:0:3321:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1783965202.481036:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e298e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3321:1870622732939008:0@lo:8:kworker.0 00000100:00080000:2.0:1783965202.481049:0:3321:0:(import.c:65:import_set_state_nolock()) ffff947405904000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1783965202.481052:0:3321:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1783965202.481056:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e29b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3321:1870622732939136:0@lo:8:kworker.0 00000004:00080000:2.0:1783965202.481077:0:14221:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1783965202.481515:0:14221:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 436710312308ns, next at 0ns, rc = 0 00000004:00080000:3.0:1783965202.482627:0:14222:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x5:0x0] 00000100:00100000:3.0:1783965202.482649:0:14222:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9474368d5180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14222:1870622732939648:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1783965202.482701:0:14222:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783965202.482724:0:14222:0:(client.c:2702:ptlrpc_set_wait()) set ffff947429fbc540 going to sleep for 11 seconds 00000100:00100000:3.0:1783965202.482741:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1783965202.482750:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9474368d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3322:1870622732939520:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783965202.482772:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783965202.483773:0:14834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732939648 00000100:00100000:2.0:1783965202.483783:0:14834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732939648 00000100:00100000:2.0:1783965202.483831:0:14834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783965202.483850:0:14834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9474368d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14222:x1870622732939648:12345-0@lo:5:osp-pre-0-0.0 00000100:00080000:0.0:1783965202.489697:0:14195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1783965202.489732:0:14838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732939520 00000100:00100000:0.0:1783965202.489743:0:14838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732939520 00000100:00100000:0.0:1783965202.489789:0:14838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1783965202.489798:0:14838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9474368d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3322:x1870622732939520:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1783965202.489833:0:14838:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1783965202.489923:0:14838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9474368d4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3322:x1870622732939520:12345-0@lo:13:osp-pre-0-0.0 Request processed in 126us (7149us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965202.489930:0:14838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1783965202.489978:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9474368d6a00 x1870622732939520/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783965218 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783965202.489999:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9474368d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3322:1870622732939520:0@lo:13:osp-pre-0-0.0 00002000:00080000:2.0:1783965202.490830:0:14834:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:2.0:1783965202.490849:0:14834:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:2.0:1783965202.490854:0:14834:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:6 to 0x240000400:33) 00002000:00010000:2.0:1783965202.506923:0:14834:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783965202.506939:0:14834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f7ff94ab/0xe782b916994fe5e0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965202.506959:0:14834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=436s v=(0 0) 00010000:00010000:2.0:1783965202.506964:0:14834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783965202.506970:0:14834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f7ff94ab/0xe782b916994fe5e0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965202.506986:0:14834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f7ff94ab/0xe782b916994fe5e0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965202.506997:0:14834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f7ff94ab/0xe782b916994fe5e0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965202.507006:0:14834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f7ff94ab/0xe782b916994fe5e0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965202.507026:0:14834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783965202.507044:0:14187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783965202.507055:0:14187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f7ff94ab/0xe782b916994fe5e0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965202.507063:0:14187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947425974200 already unused, calling callback (ffffffffc168d230) 00010000:00010000:2.0:1783965202.507068:0:14187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f7ff94ab/0xe782b916994fe5e0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965202.507078:0:14187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f7ff94ab/0xe782b916994fe5e0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965202.507094:0:14187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f7ff94ab/0xe782b916994fe5e0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965202.507101:0:14187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f7ff94ab/0xe782b916994fe5e0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965202.507118:0:14187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783965202.507119:0:14187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783965202.507121:0:14187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783965202.509856:0:14834:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1783965202.509868:0:14834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d022cc7/0xe782b916994fe5e7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965202.509885:0:14834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=436s v=(0 0) 00010000:00010000:2.0:1783965202.509889:0:14834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783965202.509896:0:14834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000d022cc7/0xe782b916994fe5e7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965202.509922:0:14834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000d022cc7/0xe782b916994fe5e7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965202.509934:0:14834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000d022cc7/0xe782b916994fe5e7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965202.509942:0:14834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000d022cc7/0xe782b916994fe5e7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965202.509967:0:14834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783965202.514506:0:14188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783965202.514521:0:14188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000d022cc7/0xe782b916994fe5e7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965202.514536:0:14188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947425974a00 already unused, calling callback (ffffffffc168d230) 00010000:00010000:1.0:1783965202.514556:0:14188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000d022cc7/0xe782b916994fe5e7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965202.514569:0:14188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000d022cc7/0xe782b916994fe5e7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965202.514600:0:14188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000d022cc7/0xe782b916994fe5e7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965202.514608:0:14188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000d022cc7/0xe782b916994fe5e7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965202.514636:0:14188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783965202.514638:0:14188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783965202.514640:0:14188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783965202.515632:0:14834:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783965202.515643:0:14834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4b43ed3/0xe782b916994fe5ee lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965202.515658:0:14834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=436s v=(0 0) 00010000:00010000:3.0:1783965202.515662:0:14834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783965202.515675:0:14834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f4b43ed3/0xe782b916994fe5ee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965202.515689:0:14834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f4b43ed3/0xe782b916994fe5ee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965202.515700:0:14834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f4b43ed3/0xe782b916994fe5ee lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965202.515708:0:14834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f4b43ed3/0xe782b916994fe5ee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965202.515725:0:14834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783965202.517393:0:14187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783965202.517405:0:14187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f4b43ed3/0xe782b916994fe5ee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965202.517417:0:14187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947436f26600 already unused, calling callback (ffffffffc168d230) 00010000:00010000:2.0:1783965202.517422:0:14187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4b43ed3/0xe782b916994fe5ee lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965202.517504:0:14187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f4b43ed3/0xe782b916994fe5ee lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965202.517528:0:14187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f4b43ed3/0xe782b916994fe5ee lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965202.517536:0:14187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f4b43ed3/0xe782b916994fe5ee lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965202.517564:0:14187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783965202.517565:0:14187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783965202.517567:0:14187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783965202.517690:0:14834:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783965202.517699:0:14834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bde10552/0xe782b916994fe5f5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965202.517711:0:14834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=436s v=(0 0) 00010000:00010000:3.0:1783965202.517716:0:14834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783965202.517722:0:14834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bde10552/0xe782b916994fe5f5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965202.517734:0:14834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bde10552/0xe782b916994fe5f5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965202.517743:0:14834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bde10552/0xe782b916994fe5f5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965202.517763:0:14834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bde10552/0xe782b916994fe5f5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965202.517783:0:14834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783965202.518357:0:14188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783965202.518365:0:14188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bde10552/0xe782b916994fe5f5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965202.518375:0:14188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947436f26a00 already unused, calling callback (ffffffffc168d230) 00010000:00010000:1.0:1783965202.518379:0:14188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bde10552/0xe782b916994fe5f5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965202.518388:0:14188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bde10552/0xe782b916994fe5f5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965202.518403:0:14188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bde10552/0xe782b916994fe5f5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965202.518418:0:14188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bde10552/0xe782b916994fe5f5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783965202.518699:0:14834:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783965202.518705:0:14834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c64a494/0xe782b916994fe5fc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965202.518715:0:14834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=436s v=(0 0) 00010000:00010000:3.0:1783965202.518719:0:14834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783965202.518723:0:14834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c64a494/0xe782b916994fe5fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965202.518733:0:14834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c64a494/0xe782b916994fe5fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965202.518741:0:14834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c64a494/0xe782b916994fe5fc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965202.518748:0:14834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001c64a494/0xe782b916994fe5fc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965202.518769:0:14834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1783965202.519286:0:14834:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783965202.519292:0:14834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cfe5866b/0xe782b916994fe603 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965202.519307:0:14834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=436s v=(0 0) 00010000:00010000:3.0:1783965202.519311:0:14834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783965202.519315:0:14834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cfe5866b/0xe782b916994fe603 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965202.519325:0:14834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cfe5866b/0xe782b916994fe603 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965202.519333:0:14834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cfe5866b/0xe782b916994fe603 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965202.519340:0:14834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cfe5866b/0xe782b916994fe603 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965202.519349:0:14834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1783965202.519538:0:14188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783965202.519543:0:14188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001c64a494/0xe782b916994fe5fc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965202.519550:0:14188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947436f27400 already unused, calling callback (ffffffffc168d230) 00010000:00010000:1.0:1783965202.519554:0:14188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001c64a494/0xe782b916994fe5fc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965202.519561:0:14188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001c64a494/0xe782b916994fe5fc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965202.519574:0:14188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001c64a494/0xe782b916994fe5fc lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965202.519582:0:14188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c64a494/0xe782b916994fe5fc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965202.519594:0:14188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783965202.519597:0:14188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cfe5866b/0xe782b916994fe603 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965202.519603:0:14188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947436f26000 already unused, calling callback (ffffffffc168d230) 00010000:00010000:1.0:1783965202.519613:0:14188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cfe5866b/0xe782b916994fe603 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965202.519620:0:14188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cfe5866b/0xe782b916994fe603 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965202.519630:0:14188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cfe5866b/0xe782b916994fe603 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965202.519636:0:14188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cfe5866b/0xe782b916994fe603 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965202.519649:0:14188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783965202.519650:0:14188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783965202.519652:0:14188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783965202.521108:0:14834:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783965202.521118:0:14834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004e235d61/0xe782b916994fe60a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965202.521132:0:14834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=436s v=(0 0) 00010000:00010000:3.0:1783965202.521137:0:14834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783965202.521142:0:14834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004e235d61/0xe782b916994fe60a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965202.521154:0:14834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004e235d61/0xe782b916994fe60a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965202.521187:0:14834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004e235d61/0xe782b916994fe60a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965202.521195:0:14834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004e235d61/0xe782b916994fe60a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965202.521235:0:14834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783965202.521297:0:14188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783965202.521303:0:14188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004e235d61/0xe782b916994fe60a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965202.521311:0:14188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947436f26800 already unused, calling callback (ffffffffc168d230) 00010000:00010000:1.0:1783965202.521315:0:14188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004e235d61/0xe782b916994fe60a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965202.521324:0:14188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004e235d61/0xe782b916994fe60a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965202.521339:0:14188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004e235d61/0xe782b916994fe60a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965202.521354:0:14188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004e235d61/0xe782b916994fe60a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965202.521371:0:14188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783965202.521373:0:14188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783965202.521375:0:14188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783965202.522154:0:14834:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783965202.522161:0:14834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a28d02c2/0xe782b916994fe611 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965202.522187:0:14834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=436s v=(0 0) 00010000:00010000:3.0:1783965202.522191:0:14834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783965202.522195:0:14834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a28d02c2/0xe782b916994fe611 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965202.522233:0:14834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a28d02c2/0xe782b916994fe611 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965202.522241:0:14834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a28d02c2/0xe782b916994fe611 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965202.522248:0:14834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a28d02c2/0xe782b916994fe611 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965202.522284:0:14834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1783965202.522862:0:14834:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783965202.522868:0:14834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b30b4759/0xe782b916994fe618 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965202.522877:0:14834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=436s v=(0 0) 00010000:00010000:3.0:1783965202.522880:0:14834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783965202.522884:0:14834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b30b4759/0xe782b916994fe618 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965202.522894:0:14834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b30b4759/0xe782b916994fe618 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965202.522901:0:14834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b30b4759/0xe782b916994fe618 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965202.522909:0:14834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b30b4759/0xe782b916994fe618 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965202.522918:0:14834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1783965202.523305:0:14188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783965202.523312:0:14188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a28d02c2/0xe782b916994fe611 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965202.523321:0:14188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947436f27a00 already unused, calling callback (ffffffffc168d230) 00010000:00010000:1.0:1783965202.523326:0:14188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a28d02c2/0xe782b916994fe611 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965202.523335:0:14188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a28d02c2/0xe782b916994fe611 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965202.523351:0:14188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a28d02c2/0xe782b916994fe611 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965202.523359:0:14188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a28d02c2/0xe782b916994fe611 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965202.523377:0:14188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783965202.523380:0:14188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b30b4759/0xe782b916994fe618 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965202.523393:0:14188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947436f27200 already unused, calling callback (ffffffffc168d230) 00010000:00010000:1.0:1783965202.523396:0:14188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b30b4759/0xe782b916994fe618 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965202.523403:0:14188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b30b4759/0xe782b916994fe618 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965202.523414:0:14188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b30b4759/0xe782b916994fe618 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965202.523421:0:14188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b30b4759/0xe782b916994fe618 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783965202.523825:0:14834:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783965202.523832:0:14834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e214443b/0xe782b916994fe61f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965202.523855:0:14834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=436s v=(0 0) 00010000:00010000:3.0:1783965202.523863:0:14834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783965202.523868:0:14834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e214443b/0xe782b916994fe61f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965202.523879:0:14834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e214443b/0xe782b916994fe61f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965202.523886:0:14834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e214443b/0xe782b916994fe61f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965202.523892:0:14834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e214443b/0xe782b916994fe61f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965202.523901:0:14834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783965202.524298:0:14188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783965202.524302:0:14188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e214443b/0xe782b916994fe61f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965202.524310:0:14188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947436f27800 already unused, calling callback (ffffffffc168d230) 00010000:00010000:1.0:1783965202.524314:0:14188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e214443b/0xe782b916994fe61f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965202.524321:0:14188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e214443b/0xe782b916994fe61f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965202.524333:0:14188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e214443b/0xe782b916994fe61f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965202.524345:0:14188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e214443b/0xe782b916994fe61f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965202.524357:0:14188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783965202.524359:0:14188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783965202.524360:0:14188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783965202.524751:0:14834:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783965202.524757:0:14834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006127a45f/0xe782b916994fe626 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965202.524766:0:14834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=436s v=(0 0) 00010000:00010000:3.0:1783965202.524769:0:14834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783965202.524774:0:14834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006127a45f/0xe782b916994fe626 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965202.524784:0:14834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006127a45f/0xe782b916994fe626 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965202.524792:0:14834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006127a45f/0xe782b916994fe626 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965202.524803:0:14834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006127a45f/0xe782b916994fe626 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965202.524869:0:14834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1783965202.525664:0:14834:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783965202.525670:0:14834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000453bd738/0xe782b916994fe62d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965202.525681:0:14834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=436s v=(0 0) 00010000:00010000:3.0:1783965202.525685:0:14834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783965202.525689:0:14834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000453bd738/0xe782b916994fe62d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965202.525701:0:14834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000453bd738/0xe782b916994fe62d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965202.525709:0:14834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000453bd738/0xe782b916994fe62d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965202.525716:0:14834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000453bd738/0xe782b916994fe62d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965202.526362:0:14188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783965202.526371:0:14188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006127a45f/0xe782b916994fe626 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965202.526380:0:14188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947436f26e00 already unused, calling callback (ffffffffc168d230) 00010000:00010000:1.0:1783965202.526385:0:14188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006127a45f/0xe782b916994fe626 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965202.526394:0:14188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006127a45f/0xe782b916994fe626 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965202.526410:0:14188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006127a45f/0xe782b916994fe626 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965202.526418:0:14188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006127a45f/0xe782b916994fe626 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965202.526443:0:14188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783965202.526447:0:14188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000453bd738/0xe782b916994fe62d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965202.526461:0:14188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947436f27000 already unused, calling callback (ffffffffc168d230) 00010000:00010000:1.0:1783965202.526464:0:14188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000453bd738/0xe782b916994fe62d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965202.526473:0:14188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000453bd738/0xe782b916994fe62d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965202.526483:0:14188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000453bd738/0xe782b916994fe62d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965202.526490:0:14188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783965202.526491:0:14188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783965202.526493:0:14188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783965202.526805:0:14834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1783965202.526811:0:14834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000453bd738/0xe782b916994fe62d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783965202.527394:0:14834:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783965202.527402:0:14834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003e4dc5f0/0xe782b916994fe634 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965202.527413:0:14834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=436s v=(0 0) 00010000:00010000:3.0:1783965202.527417:0:14834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783965202.527423:0:14834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003e4dc5f0/0xe782b916994fe634 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965202.527608:0:14834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003e4dc5f0/0xe782b916994fe634 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965202.527619:0:14834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000003e4dc5f0/0xe782b916994fe634 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965202.527627:0:14834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000003e4dc5f0/0xe782b916994fe634 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965202.527637:0:14834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1783965202.528033:0:14834:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783965202.528039:0:14834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c7213ac/0xe782b916994fe63b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965202.528047:0:14834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=436s v=(0 0) 00010000:00010000:3.0:1783965202.528051:0:14834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783965202.528062:0:14834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009c7213ac/0xe782b916994fe63b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965202.528072:0:14834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009c7213ac/0xe782b916994fe63b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965202.528080:0:14834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009c7213ac/0xe782b916994fe63b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965202.528088:0:14834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009c7213ac/0xe782b916994fe63b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965202.528095:0:14834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1783965202.528684:0:14834:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783965202.528691:0:14834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bc50c516/0xe782b916994fe642 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965202.528700:0:14834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=436s v=(0 0) 00010000:00010000:3.0:1783965202.528704:0:14834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783965202.528708:0:14834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bc50c516/0xe782b916994fe642 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965202.528717:0:14834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bc50c516/0xe782b916994fe642 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965202.528724:0:14834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bc50c516/0xe782b916994fe642 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965202.528742:0:14834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bc50c516/0xe782b916994fe642 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965202.528750:0:14834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1783965202.529627:0:14188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1783965202.529637:0:14188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000003e4dc5f0/0xe782b916994fe634 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965202.529647:0:14188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947436f26400 already unused, calling callback (ffffffffc168d230) 00010000:00010000:1.0:1783965202.529652:0:14188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000003e4dc5f0/0xe782b916994fe634 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965202.529662:0:14188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000003e4dc5f0/0xe782b916994fe634 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965202.529681:0:14188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000003e4dc5f0/0xe782b916994fe634 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965202.529697:0:14188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003e4dc5f0/0xe782b916994fe634 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965202.529720:0:14188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783965202.529724:0:14188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009c7213ac/0xe782b916994fe63b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965202.529730:0:14188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947436f26200 already unused, calling callback (ffffffffc168d230) 00010000:00010000:1.0:1783965202.529733:0:14188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009c7213ac/0xe782b916994fe63b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965202.529740:0:14188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009c7213ac/0xe782b916994fe63b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965202.529749:0:14188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009c7213ac/0xe782b916994fe63b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965202.529755:0:14188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009c7213ac/0xe782b916994fe63b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965202.529765:0:14188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783965202.529768:0:14188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bc50c516/0xe782b916994fe642 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965202.529773:0:14188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743fb8e600 already unused, calling callback (ffffffffc168d230) 00010000:00010000:1.0:1783965202.529781:0:14188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bc50c516/0xe782b916994fe642 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965202.529789:0:14188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bc50c516/0xe782b916994fe642 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965202.529798:0:14188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bc50c516/0xe782b916994fe642 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965202.529805:0:14188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bc50c516/0xe782b916994fe642 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965202.529816:0:14188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783965202.529817:0:14188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783965202.529819:0:14188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783965202.530068:0:14834:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783965202.530074:0:14834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000053a2d29f/0xe782b916994fe649 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965202.530085:0:14834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=436s v=(0 0) 00010000:00010000:3.0:1783965202.530089:0:14834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783965202.530094:0:14834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000053a2d29f/0xe782b916994fe649 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965202.530104:0:14834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000053a2d29f/0xe782b916994fe649 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965202.530112:0:14834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000053a2d29f/0xe782b916994fe649 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965202.530119:0:14834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000053a2d29f/0xe782b916994fe649 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965202.530135:0:14834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1783965202.530669:0:14834:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783965202.530677:0:14834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006e8fadae/0xe782b916994fe650 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965202.530690:0:14834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=436s v=(0 0) 00010000:00010000:3.0:1783965202.530694:0:14834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783965202.530699:0:14834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006e8fadae/0xe782b916994fe650 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965202.530711:0:14834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006e8fadae/0xe782b916994fe650 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965202.530720:0:14834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006e8fadae/0xe782b916994fe650 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965202.530728:0:14834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006e8fadae/0xe782b916994fe650 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965202.530736:0:14834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1783965202.531336:0:14834:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783965202.531342:0:14834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007059cad2/0xe782b916994fe657 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965202.531351:0:14834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=436s v=(0 0) 00010000:00010000:3.0:1783965202.531354:0:14834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783965202.531359:0:14834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007059cad2/0xe782b916994fe657 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965202.531368:0:14834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007059cad2/0xe782b916994fe657 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965202.531386:0:14834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007059cad2/0xe782b916994fe657 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965202.531394:0:14834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007059cad2/0xe782b916994fe657 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965202.531402:0:14834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1783965202.531953:0:14834:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783965202.531959:0:14834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2001aa9/0xe782b916994fe65e lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965202.531968:0:14834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=436s v=(0 0) 00010000:00010000:3.0:1783965202.531971:0:14834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783965202.531975:0:14834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c2001aa9/0xe782b916994fe65e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965202.531984:0:14834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c2001aa9/0xe782b916994fe65e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965202.531991:0:14834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c2001aa9/0xe782b916994fe65e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965202.531998:0:14834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c2001aa9/0xe782b916994fe65e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965202.532015:0:14834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:3.0:1783965202.532568:0:14834:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783965202.532575:0:14834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000be4742e3/0xe782b916994fe665 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965202.532584:0:14834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=436s v=(0 0) 00010000:00010000:3.0:1783965202.532587:0:14834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783965202.532591:0:14834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000be4742e3/0xe782b916994fe665 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965202.532600:0:14834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000be4742e3/0xe782b916994fe665 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965202.532608:0:14834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000be4742e3/0xe782b916994fe665 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965202.532614:0:14834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000be4742e3/0xe782b916994fe665 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965202.532622:0:14834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:3.0:1783965202.533002:0:14834:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783965202.533009:0:14834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006834d07f/0xe782b916994fe66c lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965202.533017:0:14834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=436s v=(0 0) 00010000:00010000:3.0:1783965202.533025:0:14834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783965202.533029:0:14834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006834d07f/0xe782b916994fe66c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965202.533039:0:14834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006834d07f/0xe782b916994fe66c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965202.533047:0:14834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006834d07f/0xe782b916994fe66c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965202.533055:0:14834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006834d07f/0xe782b916994fe66c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965202.533062:0:14834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00010000:00010000:1.0:1783965202.533414:0:14188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1783965202.533423:0:14188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000053a2d29f/0xe782b916994fe649 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965202.533923:0:14188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743fb8ee00 already unused, calling callback (ffffffffc168d230) 00010000:00010000:1.0:1783965202.533929:0:14188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000053a2d29f/0xe782b916994fe649 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965202.533940:0:14188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000053a2d29f/0xe782b916994fe649 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965202.533959:0:14188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000053a2d29f/0xe782b916994fe649 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965202.533977:0:14188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000053a2d29f/0xe782b916994fe649 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965202.534000:0:14188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1783965202.534004:0:14188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006e8fadae/0xe782b916994fe650 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965202.534011:0:14188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743fb8e200 already unused, calling callback (ffffffffc168d230) 00010000:00010000:1.0:1783965202.534015:0:14188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006e8fadae/0xe782b916994fe650 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965202.534023:0:14188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006e8fadae/0xe782b916994fe650 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965202.534034:0:14188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006e8fadae/0xe782b916994fe650 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965202.534042:0:14188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006e8fadae/0xe782b916994fe650 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965202.534054:0:14188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1783965202.534057:0:14188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007059cad2/0xe782b916994fe657 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965202.534063:0:14188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743fb8f200 already unused, calling callback (ffffffffc168d230) 00010000:00010000:1.0:1783965202.534074:0:14188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007059cad2/0xe782b916994fe657 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965202.534082:0:14188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007059cad2/0xe782b916994fe657 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965202.534094:0:14188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007059cad2/0xe782b916994fe657 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965202.534101:0:14188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007059cad2/0xe782b916994fe657 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965202.534116:0:14188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1783965202.534120:0:14188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c2001aa9/0xe782b916994fe65e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965202.534126:0:14188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743fb8f800 already unused, calling callback (ffffffffc168d230) 00010000:00010000:1.0:1783965202.534129:0:14188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2001aa9/0xe782b916994fe65e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965202.534136:0:14188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c2001aa9/0xe782b916994fe65e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965202.534146:0:14188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c2001aa9/0xe782b916994fe65e lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965202.534153:0:14188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c2001aa9/0xe782b916994fe65e lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965202.534324:0:14188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783965202.534328:0:14188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000be4742e3/0xe782b916994fe665 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965202.534335:0:14188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743fb8e000 already unused, calling callback (ffffffffc168d230) 00010000:00010000:1.0:1783965202.534338:0:14188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000be4742e3/0xe782b916994fe665 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965202.534345:0:14188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000be4742e3/0xe782b916994fe665 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965202.534356:0:14188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000be4742e3/0xe782b916994fe665 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965202.534363:0:14188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000be4742e3/0xe782b916994fe665 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965202.534376:0:14188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783965202.534379:0:14188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006834d07f/0xe782b916994fe66c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965202.534384:0:14188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743fb8f400 already unused, calling callback (ffffffffc168d230) 00010000:00010000:1.0:1783965202.534387:0:14188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006834d07f/0xe782b916994fe66c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965202.534406:0:14188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006834d07f/0xe782b916994fe66c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965202.534416:0:14188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006834d07f/0xe782b916994fe66c lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965202.534423:0:14188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006834d07f/0xe782b916994fe66c lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1783965202.534909:0:14834:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783965202.534917:0:14834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000049ef338b/0xe782b916994fe673 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965202.534928:0:14834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=436s v=(0 0) 00010000:00010000:3.0:1783965202.534933:0:14834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783965202.534939:0:14834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000049ef338b/0xe782b916994fe673 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965202.534951:0:14834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000049ef338b/0xe782b916994fe673 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965202.534960:0:14834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000049ef338b/0xe782b916994fe673 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965202.534974:0:14834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000049ef338b/0xe782b916994fe673 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965202.534984:0:14834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783965202.535356:0:14188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783965202.535361:0:14188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000049ef338b/0xe782b916994fe673 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965202.535368:0:14188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743fb8ea00 already unused, calling callback (ffffffffc168d230) 00010000:00010000:1.0:1783965202.535371:0:14188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000049ef338b/0xe782b916994fe673 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965202.535379:0:14188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000049ef338b/0xe782b916994fe673 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965202.535390:0:14188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000049ef338b/0xe782b916994fe673 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965202.535396:0:14188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000049ef338b/0xe782b916994fe673 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965202.535421:0:14188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783965202.535423:0:14188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783965202.535425:0:14188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783965202.535611:0:14187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783965202.535644:0:14187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783965202.539603:0:14834:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783965202.539617:0:14834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a64bcd0/0xe782b916994fe67a lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965202.539635:0:14834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=436s v=(0 0) 00010000:00010000:3.0:1783965202.539640:0:14834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783965202.539646:0:14834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006a64bcd0/0xe782b916994fe67a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965202.539661:0:14834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006a64bcd0/0xe782b916994fe67a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965202.539671:0:14834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006a64bcd0/0xe782b916994fe67a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965202.539680:0:14834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006a64bcd0/0xe782b916994fe67a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965202.544179:0:14834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1783965202.544809:0:14834:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783965202.544819:0:14834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005e11829e/0xe782b916994fe681 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965202.544854:0:14834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=436s v=(0 0) 00010000:00010000:3.0:1783965202.544859:0:14834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783965202.544866:0:14834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005e11829e/0xe782b916994fe681 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965202.544880:0:14834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005e11829e/0xe782b916994fe681 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965202.544891:0:14834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005e11829e/0xe782b916994fe681 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965202.544898:0:14834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005e11829e/0xe782b916994fe681 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965202.545311:0:14188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783965202.545320:0:14188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006a64bcd0/0xe782b916994fe67a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965202.545334:0:14188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743fb8fa00 already unused, calling callback (ffffffffc168d230) 00010000:00010000:0.0:1783965202.545338:0:14188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006a64bcd0/0xe782b916994fe67a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965202.545347:0:14188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006a64bcd0/0xe782b916994fe67a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965202.545367:0:14188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006a64bcd0/0xe782b916994fe67a lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965202.545375:0:14188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006a64bcd0/0xe782b916994fe67a lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965202.545393:0:14188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783965202.545396:0:14188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005e11829e/0xe782b916994fe681 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965202.545402:0:14188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743fb8ec00 already unused, calling callback (ffffffffc168d230) 00010000:00010000:0.0:1783965202.545406:0:14188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005e11829e/0xe782b916994fe681 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965202.545413:0:14188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005e11829e/0xe782b916994fe681 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965202.545422:0:14188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005e11829e/0xe782b916994fe681 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965202.545628:0:14188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783965202.545630:0:14188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783965202.545632:0:14188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783965202.551498:0:14834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1783965202.551513:0:14834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005e11829e/0xe782b916994fe681 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965202.552441:0:14187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783965202.552899:0:14834:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783965202.552912:0:14834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f42876e3/0xe782b916994fe688 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965202.552930:0:14834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=436s v=(0 0) 00010000:00010000:3.0:1783965202.552936:0:14834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783965202.552945:0:14834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f42876e3/0xe782b916994fe688 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965202.552978:0:14834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f42876e3/0xe782b916994fe688 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965202.552992:0:14834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f42876e3/0xe782b916994fe688 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965202.553000:0:14834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f42876e3/0xe782b916994fe688 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965202.553019:0:14834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1783965202.553030:0:14188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783965202.553035:0:14188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f42876e3/0xe782b916994fe688 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965202.553043:0:14188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743fb8f000 already unused, calling callback (ffffffffc168d230) 00010000:00010000:3.0:1783965202.553047:0:14188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f42876e3/0xe782b916994fe688 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965202.553056:0:14188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f42876e3/0xe782b916994fe688 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965202.553071:0:14188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f42876e3/0xe782b916994fe688 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965202.553078:0:14188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f42876e3/0xe782b916994fe688 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965202.553102:0:14188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783965202.553104:0:14188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783965202.553106:0:14188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783965202.555010:0:14834:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783965202.555020:0:14834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000536858ab/0xe782b916994fe68f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965202.555034:0:14834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=436s v=(0 0) 00010000:00010000:3.0:1783965202.555039:0:14834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783965202.555044:0:14834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000536858ab/0xe782b916994fe68f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965202.555057:0:14834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000536858ab/0xe782b916994fe68f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965202.555067:0:14834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000536858ab/0xe782b916994fe68f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965202.555075:0:14834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000536858ab/0xe782b916994fe68f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965202.555095:0:14834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1783965202.555931:0:14187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783965202.555942:0:14187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000536858ab/0xe782b916994fe68f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965202.555953:0:14187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743fb8e800 already unused, calling callback (ffffffffc168d230) 00010000:00010000:2.0:1783965202.555957:0:14187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000536858ab/0xe782b916994fe68f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965202.555968:0:14187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000536858ab/0xe782b916994fe68f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965202.555987:0:14187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000536858ab/0xe782b916994fe68f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965202.555994:0:14187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000536858ab/0xe782b916994fe68f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965202.556010:0:14187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783965202.556012:0:14187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783965202.556014:0:14187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783965202.559048:0:14834:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783965202.559059:0:14834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000007f90b2/0xe782b916994fe696 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965202.559088:0:14834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=436s v=(0 0) 00010000:00010000:3.0:1783965202.559093:0:14834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783965202.559099:0:14834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000007f90b2/0xe782b916994fe696 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965202.559114:0:14834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000007f90b2/0xe782b916994fe696 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965202.559124:0:14834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000007f90b2/0xe782b916994fe696 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965202.559133:0:14834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000007f90b2/0xe782b916994fe696 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965202.559160:0:14834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783965202.560333:0:14188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783965202.560344:0:14188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000007f90b2/0xe782b916994fe696 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965202.560356:0:14188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743fb8e400 already unused, calling callback (ffffffffc168d230) 00010000:00010000:1.0:1783965202.560361:0:14188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000007f90b2/0xe782b916994fe696 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965202.560372:0:14188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000007f90b2/0xe782b916994fe696 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965202.560391:0:14188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000007f90b2/0xe782b916994fe696 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965202.560398:0:14188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000007f90b2/0xe782b916994fe696 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965202.560417:0:14188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783965202.560419:0:14188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783965202.560421:0:14188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1783965202.562667:0:14834:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1783965202.562681:0:14834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bd475494/0xe782b916994fe69d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965202.562701:0:14834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=436s v=(0 0) 00010000:00010000:3.0:1783965202.562706:0:14834:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783965202.562714:0:14834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bd475494/0xe782b916994fe69d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965202.562731:0:14834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bd475494/0xe782b916994fe69d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965202.562754:0:14834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bd475494/0xe782b916994fe69d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965202.562762:0:14834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bd475494/0xe782b916994fe69d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965202.562779:0:14834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:3.0:1783965202.562966:0:14834:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:5 00000100:00100000:3.0:1783965202.563052:0:14834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9474368d5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14222:x1870622732939648:12345-0@lo:5:osp-pre-0-0.0 Request processed in 79211us (80347us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965202.563065:0:14834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1783965202.563124:0:14222:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9474368d5180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14222:1870622732939648:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1783965202.563140:0:14222:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x5:0x0] 00000100:00100000:3.0:1783965202.565179:0:14222:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9474368d5180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14222:1870622732939776:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1783965202.565250:0:14222:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783965202.565295:0:14222:0:(client.c:2702:ptlrpc_set_wait()) set ffff947429fbc540 going to sleep for 11 seconds 00000100:00100000:3.0:1783965202.565325:0:14837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732939776 00000100:00100000:3.0:1783965202.565331:0:14837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732939776 00000100:00100000:3.0:1783965202.565369:0:14837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783965202.565377:0:14837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9474368d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14222:x1870622732939776:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1783965202.565435:0:14837:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00010000:00010000:0.0:1783965202.571373:0:14187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783965202.571388:0:14187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bd475494/0xe782b916994fe69d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965202.571401:0:14187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743fb8f600 already unused, calling callback (ffffffffc168d230) 00010000:00010000:0.0:1783965202.571406:0:14187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd475494/0xe782b916994fe69d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965202.571418:0:14187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bd475494/0xe782b916994fe69d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965202.571983:0:14187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bd475494/0xe782b916994fe69d lrc: 1/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965202.571994:0:14187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bd475494/0xe782b916994fe69d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965202.572016:0:14187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783965202.572018:0:14187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783965202.572020:0:14187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783965202.578795:0:14837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9474368d7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:14222:x1870622732939776:12345-0@lo:5:osp-pre-0-0.0 Request processed in 13410us (13536us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1783965202.578808:0:14837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783965202.578945:0:14222:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9474368d5180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14222:1870622732939776:0@lo:5:osp-pre-0-0.0 00000004:00080000:3.0:1783965202.578959:0:14222:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00000004:00080000:3.0:1783965202.581715:0:5835:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00010000:1.0:1783965202.987377:0:14188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783965204.011838:0:14187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1783965204.447962:0:15504:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1783965204.447966:0:15504:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1783965204.448263:0:15504:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff947425afb000 00000020:01000004:3.0:1783965204.448280:0:15504:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:3.0:1783965204.448293:0:15504:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1783965204.448306:0:15504:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff947436e40000) 00000020:00000080:3.0:1783965204.448325:0:15504:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1783965204.470178:0:15504:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1783965204.470473:0:15504:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1783965204.471444:0:15504:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1783965204.471740:0:15504:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1783965204.472023:0:15504:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1783965204.472448:0:15504:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 551: rc = 0 00100000:10000000:3.0:1783965204.472559:0:15504:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 551: rc = 0 00100000:10000000:3.0:1783965204.472730:0:15504:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 551: rc = 0 00100000:10000000:3.0:1783965204.473446:0:15504:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 718: rc = 0 00100000:10000000:3.0:1783965204.473745:0:15504:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 718: rc = 0 00100000:10000000:3.0:1783965204.474126:0:15504:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 718: rc = 0 00100000:10000000:3.0:1783965204.474458:0:15504:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 718: rc = 0 00100000:10000000:3.0:1783965204.474846:0:15504:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 718: rc = 0 00100000:10000000:3.0:1783965204.475155:0:15504:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 718: rc = 0 00000020:00000080:3.0:1783965204.476017:0:15504:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1783965204.476028:0:15504:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:3.0:1783965204.476108:0:15504:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xe782b916994fe6ab 00000020:01000004:3.0:1783965204.476117:0:15504:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1783965204.476144:0:15504:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.204.112@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1783965204.476147:0:15504:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.204.112@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1783965204.476153:0:15504:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1783965204.476176:0:15504:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1783965204.476180:0:15504:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.204.112@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1783965204.490598:0:15504:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.204.112@tcp ctxt 0 is initialized 00000020:01000004:3.0:1783965204.490640:0:15504:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.204.112@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1783965204.490927:0:15504:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1783965204.490930:0:15504:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1783965204.490932:0:15504:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783965204.490933:0:15504:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783965204.490935:0:15504:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783965204.490936:0:15504:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783965204.490938:0:15504:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783965204.490940:0:15504:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783965204.490941:0:15504:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1783965204.490944:0:15504:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1783965204.490947:0:15504:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1783965204.490948:0:15504:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1783965204.490950:0:15504:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783965204.490951:0:15504:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783965204.490952:0:15504:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783965204.490954:0:15504:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783965204.490955:0:15504:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783965204.490956:0:15504:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783965204.490957:0:15504:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1783965204.490984:0:15504:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1783965204.491006:0:15504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9474368d7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72a5858e-0958-4c77-91cf-d6507b930817:15504:1870622732939904:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1783965204.491147:0:15504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783965204.491281:0:15504:0:(client.c:2702:ptlrpc_set_wait()) set ffff947425815900 going to sleep for 11 seconds 00000100:00100000:0.0:1783965204.491438:0:14193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732939904 00000100:00100000:0.0:1783965204.491453:0:14193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732939904 00000100:00100000:0.0:1783965204.491560:0:14193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1783965204.491570:0:14193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436b8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72a5858e-0958-4c77-91cf-d6507b930817+16:15504:x1870622732939904:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1783965204.491603:0:14193:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1783965204.491606:0:14193:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:0.0:1783965204.491610:0:14193:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:3.0:1783965204.500103:0:14193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436b8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72a5858e-0958-4c77-91cf-d6507b930817+16:15504:x1870622732939904:12345-0@lo:253:mount.lustre.0 Request processed in 8458us (8880us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965204.500118:0:14193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1783965204.500124:0:15504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9474368d7b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72a5858e-0958-4c77-91cf-d6507b930817:15504:1870622732939904:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1783965204.500144:0:15504:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1783965204.500148:0:15504:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1783965204.500151:0:15504:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1783965204.500153:0:15504:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1783965204.500154:0:15504:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1783965204.500916:0:15504:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1783965204.500922:0:15504:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1783965204.500923:0:15504:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1783965204.500925:0:15504:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1783965204.500926:0:15504:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1783965204.500952:0:15504:0:(tgt_mount.c:101:server_register_mount()) register mount ffff947425afb000 from lustre-OST0001 10000000:01000000:0.0:1783965204.500978:0:15504:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1783965204.500981:0:15504:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1783965204.500988:0:15504:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9474259cb380 local copy 00010000:00010000:0.0:1783965204.500997:0:15504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.112@tcp lock: ffff94743e2fc600/0xe782b916994fe451 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fe458 expref: -99 pid: 14181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783965204.501269:0:15504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743fb9e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72a5858e-0958-4c77-91cf-d6507b930817:15504:1870622732940032:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783965204.501316:0:15504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783965204.501517:0:15504:0:(client.c:2702:ptlrpc_set_wait()) set ffff9474037270c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783965204.503338:0:14194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732940032 00000100:00100000:1.0:1783965204.503886:0:14194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732940032 00000100:00100000:1.0:1783965204.503971:0:14194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1783965204.503980:0:14194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436b8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72a5858e-0958-4c77-91cf-d6507b930817+16:15504:x1870622732940032:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783965204.504704:0:14194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436b8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72a5858e-0958-4c77-91cf-d6507b930817+16:15504:x1870622732940032:12345-0@lo:501:mount.lustre.0 Request processed in 722us (3384us total) trans 0 rc -2/-2 00000100:00100000:1.0:1783965204.504714:0:14194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1783965204.505348:0:15504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743fb9e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72a5858e-0958-4c77-91cf-d6507b930817:15504:1870622732940032:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1783965204.505372:0:15504:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.204.112@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1783965204.505560:0:15504:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.204.112@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1783965204.505575:0:15504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.112@tcp lock: ffff94743e2fc600/0xe782b916994fe451 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fe458 expref: -99 pid: 14181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965204.505586:0:15504:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.112@tcp lock: ffff94743e2fc600/0xe782b916994fe451 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fe458 expref: -99 pid: 14181 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1783965204.505630:0:15504:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff947425afb000 10000000:01000000:0.0:1783965204.505636:0:15504:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1783965204.505641:0:15504:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1783965204.505643:0:15504:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1783965204.505647:0:15504:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1783965204.505649:0:15504:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1783965204.505682:0:15504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.112@tcp lock: ffff94743e2fcc00/0xe782b916994fe6b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965204.505690:0:15504:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.112@tcp lock: ffff94743e2fcc00/0xe782b916994fe6b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965204.505699:0:15504:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.112@tcp lock: ffff94743e2fcc00/0xe782b916994fe6b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783965204.505718:0:15504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743fb9e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72a5858e-0958-4c77-91cf-d6507b930817:15504:1870622732940160:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1783965204.505759:0:15504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783965204.505813:0:15504:0:(client.c:2702:ptlrpc_set_wait()) set ffff9474037270c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783965204.505830:0:14193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732940160 00000100:00100000:3.0:1783965204.505837:0:14193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732940160 00000100:00100000:3.0:1783965204.505886:0:14193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1783965204.505894:0:14193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94741cd56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72a5858e-0958-4c77-91cf-d6507b930817+16:15504:x1870622732940160:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1783965204.505906:0:14193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783965204.505919:0:14193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94743fb8fc00/0xe782b916994fe6b9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0xe782b916994fe6b2 expref: -99 pid: 14193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965204.505943:0:14193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94743fb8fc00/0xe782b916994fe6b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe782b916994fe6b2 expref: 17 pid: 14193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965204.505959:0:14193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94743fb8fc00/0xe782b916994fe6b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe782b916994fe6b2 expref: 17 pid: 14193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965204.505969:0:14193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94743fb8fc00, rc 0) 00000100:00100000:3.0:1783965204.506020:0:14193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94741cd56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72a5858e-0958-4c77-91cf-d6507b930817+17:15504:x1870622732940160:12345-0@lo:101:mount.lustre.0 Request processed in 127us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965204.506026:0:14193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1783965204.510089:0:15504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743fb9e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72a5858e-0958-4c77-91cf-d6507b930817:15504:1870622732940160:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783965204.510119:0:15504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.112@tcp lock: ffff94743e2fcc00/0xe782b916994fe6b2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fe6b9 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965204.510132:0:15504:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.112@tcp lock: ffff94743e2fcc00/0xe782b916994fe6b2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0xe782b916994fe6b9 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783965204.510861:0:15504:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:1.0:1783965204.511713:0:15504:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783965204.511940:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:1.0:1783965204.511980:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:1.0:1783965204.512012:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:1.0:1783965204.512936:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:1.0:1783965204.512996:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1783965204.513031:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1783965204.513924:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1783965204.513936:0:15504:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1783965204.514041:0:15504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e299f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72a5858e-0958-4c77-91cf-d6507b930817:15504:1870622732940288:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783965204.514107:0:15504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783965204.514147:0:15504:0:(client.c:2702:ptlrpc_set_wait()) set ffff94743fb236c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783965204.515278:0:14194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732940288 00000100:00100000:0.0:1783965204.515288:0:14194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732940288 00000100:00100000:0.0:1783965204.515345:0:14194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1783965204.515355:0:14194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94741cd57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72a5858e-0958-4c77-91cf-d6507b930817+17:15504:x1870622732940288:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783965204.515860:0:14194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94741cd57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72a5858e-0958-4c77-91cf-d6507b930817+17:15504:x1870622732940288:12345-0@lo:501:mount.lustre.0 Request processed in 505us (1750us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965204.515876:0:14194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1783965204.515928:0:15504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e299f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72a5858e-0958-4c77-91cf-d6507b930817:15504:1870622732940288:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783965204.515981:0:15504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743706d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72a5858e-0958-4c77-91cf-d6507b930817:15504:1870622732940416:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783965204.516024:0:15504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783965204.516065:0:15504:0:(client.c:2702:ptlrpc_set_wait()) set ffff9474370bb180 going to sleep for 11 seconds 00000100:00100000:3.0:1783965204.516178:0:14193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732940416 00000100:00100000:3.0:1783965204.516182:0:14193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732940416 00000100:00100000:3.0:1783965204.516245:0:14193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1783965204.516254:0:14193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94741cd56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72a5858e-0958-4c77-91cf-d6507b930817+17:15504:x1870622732940416:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783965204.516550:0:14193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94741cd56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72a5858e-0958-4c77-91cf-d6507b930817+17:15504:x1870622732940416:12345-0@lo:503:mount.lustre.0 Request processed in 297us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965204.516557:0:14193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1783965204.516677:0:15504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743706d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72a5858e-0958-4c77-91cf-d6507b930817:15504:1870622732940416:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1783965204.517510:0:15504:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1783965204.517586:0:15504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743706d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72a5858e-0958-4c77-91cf-d6507b930817:15504:1870622732940544:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783965204.517653:0:15504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783965204.517697:0:15504:0:(client.c:2702:ptlrpc_set_wait()) set ffff9474370bb180 going to sleep for 11 seconds 00000100:00100000:0.0:1783965204.517756:0:14194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732940544 00000100:00100000:0.0:1783965204.517762:0:14194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732940544 00000100:00100000:0.0:1783965204.517809:0:14194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1783965204.517819:0:14194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94741cd56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72a5858e-0958-4c77-91cf-d6507b930817+17:15504:x1870622732940544:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783965204.518005:0:14194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94741cd56050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72a5858e-0958-4c77-91cf-d6507b930817+17:15504:x1870622732940544:12345-0@lo:502:mount.lustre.0 Request processed in 189us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965204.518013:0:14194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1783965204.518152:0:15504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743706d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72a5858e-0958-4c77-91cf-d6507b930817:15504:1870622732940544:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1783965204.518374:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1783965204.518431:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1783965204.518468:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1783965204.518527:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1783965204.518559:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1783965204.518585:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1783965204.518622:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1783965204.518649:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1783965204.518884:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:2.0:1783965204.518911:0:15504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743706d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72a5858e-0958-4c77-91cf-d6507b930817:15504:1870622732940672:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783965204.519007:0:15504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783965204.519100:0:15504:0:(client.c:2702:ptlrpc_set_wait()) set ffff9474370bb180 going to sleep for 11 seconds 00000100:00100000:0.0:1783965204.519577:0:14194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732940672 00000100:00100000:0.0:1783965204.519583:0:14194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732940672 00000100:00100000:0.0:1783965204.519619:0:14194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1783965204.519626:0:14194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94741cd55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72a5858e-0958-4c77-91cf-d6507b930817+17:15504:x1870622732940672:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783965204.520915:0:14194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94741cd55450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72a5858e-0958-4c77-91cf-d6507b930817+17:15504:x1870622732940672:12345-0@lo:502:mount.lustre.0 Request processed in 1282us (1901us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965204.520927:0:14194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1783965204.521089:0:15504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743706d500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72a5858e-0958-4c77-91cf-d6507b930817:15504:1870622732940672:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1783965204.521192:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:3.0:1783965204.521241:0:15504:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:0.0:1783965204.525501:0:15505:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1783965204.525512:0:15505:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:0.0:1783965204.525519:0:15505:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783965204.525521:0:15505:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1783965204.525527:0:15505:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1783965204.525542:0:15505:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9474259ccd40) 00000020:00000080:0.0:1783965204.525572:0:15505:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:0.0:1783965204.525576:0:15505:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1783965204.525629:0:15505:0:(tgt_mount.c:153:server_get_mount()) get mount ffff947425afb000 from lustre-OST0001, refs=2 00080000:01000000:0.0:1783965204.525636:0:15505:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:0.0:1783965204.525642:0:15505:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0xe782b916994fe6c7 00010000:00010000:0.0:1783965204.533923:0:15505:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:0.0:1783965204.534526:0:15505:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:0.0:1783965204.536970:0:15505:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:2.0:1783965204.542948:0:15505:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1783965204.542961:0:15505:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783965204.542969:0:15505:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783965204.542971:0:15505:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1783965204.542975:0:15505:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783965204.542978:0:15505:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783965204.542985:0:15505:0:(obd_config.c:1561:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:2.0:1783965204.542989:0:15505:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1783965204.542991:0:15505:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1783965204.542993:0:15505:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783965204.542995:0:15505:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783965204.542997:0:15505:0:(obd_config.c:1561:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:2.0:1783965204.542998:0:15505:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1783965204.543000:0:15505:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783965204.543002:0:15505:0:(obd_config.c:1561:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1783965204.543004:0:15505:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1783965204.543075:0:15505:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1783965204.543079:0:15505:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1783965204.543081:0:15505:0:(obd_config.c:1561:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1783965204.543084:0:15505:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:3.0:1783965204.543364:0:15504:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:3.0:1783965204.543393:0:15504:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.112@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1783965204.543420:0:15504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.112@tcp lock: ffff94743e2fcc00/0xe782b916994fe6b2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fe6b9 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965204.543432:0:15504:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.112@tcp lock: ffff94743e2fcc00/0xe782b916994fe6b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fe6b9 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783965204.543439:0:15504:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff947425afb000 from 1 10000000:01000000:3.0:1783965204.543442:0:15504:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1783965204.543477:0:15504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.112@tcp lock: ffff94743fb8f000/0xe782b916994fe6ce lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965204.543484:0:15504:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.112@tcp lock: ffff94743fb8f000/0xe782b916994fe6ce lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965204.543494:0:15504:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.112@tcp lock: ffff94743fb8f000/0xe782b916994fe6ce lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783965204.543517:0:15504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9474368d4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72a5858e-0958-4c77-91cf-d6507b930817:15504:1870622732940800:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1783965204.543581:0:15504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783965204.543633:0:15504:0:(client.c:2702:ptlrpc_set_wait()) set ffff947425815d80 going to sleep for 11 seconds 00000100:00100000:2.0:1783965204.546552:0:14192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732940800 00000100:00100000:2.0:1783965204.546565:0:14192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732940800 00000100:00100000:2.0:1783965204.546635:0:14192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1783965204.546645:0:14192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94741cd56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72a5858e-0958-4c77-91cf-d6507b930817+17:15504:x1870622732940800:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1783965204.546670:0:14192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783965204.546896:0:14192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff947425974800/0xe782b916994fe6d5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe782b916994fe6ce expref: -99 pid: 14192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965204.546928:0:14192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff947425974800/0xe782b916994fe6d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe782b916994fe6ce expref: 18 pid: 14192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965204.546940:0:14192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff947425974800/0xe782b916994fe6d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe782b916994fe6ce expref: 18 pid: 14192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965204.546949:0:14192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff947425974800, rc 0) 00000100:00100000:2.0:1783965204.547039:0:14192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94741cd56c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72a5858e-0958-4c77-91cf-d6507b930817+18:15504:x1870622732940800:12345-0@lo:101:mount.lustre.0 Request processed in 388us (3449us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965204.547046:0:14192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1783965204.547233:0:15504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9474368d4e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72a5858e-0958-4c77-91cf-d6507b930817:15504:1870622732940800:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783965204.547254:0:15504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.112@tcp lock: ffff94743fb8f000/0xe782b916994fe6ce lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fe6d5 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965204.547275:0:15504:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.112@tcp lock: ffff94743fb8f000/0xe782b916994fe6ce lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe782b916994fe6d5 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783965204.547948:0:15504:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1783965204.548277:0:15504:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1783965204.548495:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1783965204.548541:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1783965204.548603:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1783965204.548611:0:15504:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1783965204.549942:0:15504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e299f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72a5858e-0958-4c77-91cf-d6507b930817:15504:1870622732940928:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1783965204.550000:0:15504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783965204.550108:0:15504:0:(client.c:2702:ptlrpc_set_wait()) set ffff94743fb239c0 going to sleep for 11 seconds 00000100:00100000:2.0:1783965204.550184:0:14193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732940928 00000100:00100000:2.0:1783965204.550191:0:14193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732940928 00000100:00100000:2.0:1783965204.550256:0:14193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1783965204.550264:0:14193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94741cd57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72a5858e-0958-4c77-91cf-d6507b930817+18:15504:x1870622732940928:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783965204.550491:0:14193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94741cd57c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72a5858e-0958-4c77-91cf-d6507b930817+18:15504:x1870622732940928:12345-0@lo:501:mount.lustre.0 Request processed in 227us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965204.550498:0:14193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1783965204.550588:0:15504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e299f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72a5858e-0958-4c77-91cf-d6507b930817:15504:1870622732940928:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1783965204.550621:0:15504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743fb9f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72a5858e-0958-4c77-91cf-d6507b930817:15504:1870622732941056:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1783965204.550668:0:15504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783965204.550690:0:15504:0:(client.c:2702:ptlrpc_set_wait()) set ffff94741cca0540 going to sleep for 11 seconds 00000100:00100000:2.0:1783965204.550785:0:14192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732941056 00000100:00100000:2.0:1783965204.550789:0:14192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732941056 00000100:00100000:2.0:1783965204.550826:0:14192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1783965204.550832:0:14192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94741cd57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72a5858e-0958-4c77-91cf-d6507b930817+18:15504:x1870622732941056:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783965204.551010:0:14192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94741cd57050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72a5858e-0958-4c77-91cf-d6507b930817+18:15504:x1870622732941056:12345-0@lo:503:mount.lustre.0 Request processed in 178us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965204.551017:0:14192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1783965204.551229:0:15504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743fb9f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72a5858e-0958-4c77-91cf-d6507b930817:15504:1870622732941056:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1783965204.551986:0:15504:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1783965204.552152:0:15504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743fb9f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72a5858e-0958-4c77-91cf-d6507b930817:15504:1870622732941184:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783965204.552238:0:15504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783965204.552267:0:15504:0:(client.c:2702:ptlrpc_set_wait()) set ffff947415232540 going to sleep for 11 seconds 00000100:00100000:1.0:1783965204.552493:0:14194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732941184 00000100:00100000:1.0:1783965204.552499:0:14194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732941184 00000100:00100000:1.0:1783965204.552551:0:14194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1783965204.552559:0:14194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94741cd54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72a5858e-0958-4c77-91cf-d6507b930817+18:15504:x1870622732941184:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783965204.553292:0:14194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94741cd54c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72a5858e-0958-4c77-91cf-d6507b930817+18:15504:x1870622732941184:12345-0@lo:502:mount.lustre.0 Request processed in 732us (1052us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965204.553301:0:14194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1783965204.553969:0:15504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743fb9f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72a5858e-0958-4c77-91cf-d6507b930817:15504:1870622732941184:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1783965204.554545:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1783965204.554599:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1783965204.554643:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1783965204.555694:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1783965204.555737:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1783965204.555823:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1783965204.555863:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1783965204.557221:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:0.0:1783965204.557283:0:15504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743fb9f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72a5858e-0958-4c77-91cf-d6507b930817:15504:1870622732941312:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1783965204.557364:0:15504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783965204.557402:0:15504:0:(client.c:2702:ptlrpc_set_wait()) set ffff947415232540 going to sleep for 11 seconds 00000100:00100000:1.0:1783965204.558162:0:14194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732941312 00000100:00100000:1.0:1783965204.558170:0:14194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732941312 00000100:00100000:1.0:1783965204.558244:0:14194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1783965204.558253:0:14194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743f21dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72a5858e-0958-4c77-91cf-d6507b930817+18:15504:x1870622732941312:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1783965204.558471:0:14194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743f21dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72a5858e-0958-4c77-91cf-d6507b930817+18:15504:x1870622732941312:12345-0@lo:502:mount.lustre.0 Request processed in 219us (1106us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965204.558480:0:14194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1783965204.558816:0:15504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743fb9f480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72a5858e-0958-4c77-91cf-d6507b930817:15504:1870622732941312:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1783965204.558951:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:0.0:1783965204.558963:0:15504:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:0.0:1783965204.560687:0:15509:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783965204.560704:0:15509:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783965204.560707:0:15509:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1783965204.560715:0:15509:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff947425afb000 00000020:00000080:0.0:1783965204.560717:0:15509:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1783965204.560724:0:15509:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783965204.560726:0:15509:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783965204.560727:0:15509:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1783965204.560730:0:15509:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783965204.560732:0:15509:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783965204.560733:0:15509:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1783965204.560736:0:15509:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff947425afb000 00000020:00000080:0.0:1783965204.560738:0:15509:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1783965204.560906:0:15509:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783965204.560911:0:15509:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783965204.560912:0:15509:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1783965204.560915:0:15509:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1783965204.560917:0:15509:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783965204.560918:0:15509:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1783965204.560921:0:15509:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff947425afb000 00000020:00000080:0.0:1783965204.560923:0:15509:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1783965204.560958:0:15509:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1783965204.560961:0:15509:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1783965204.560962:0:15509:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1783965204.560965:0:15509:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:1.0:1783965204.561141:0:15504:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1783965204.561164:0:15504:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783965204.561189:0:15504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.112@tcp lock: ffff94743fb8f000/0xe782b916994fe6ce lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fe6d5 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965204.561219:0:15504:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.112@tcp lock: ffff94743fb8f000/0xe782b916994fe6ce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fe6d5 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783965204.561280:0:15504:0:(mgc_request.c:1943:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1783965204.561283:0:15504:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff947425afb000 10000000:01000000:1.0:1783965204.561286:0:15504:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff947425afb000 10000000:01000000:1.0:1783965204.561294:0:15504:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1783965204.561300:0:15504:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-client-ffff947425afb000 from 1 10000000:01000000:1.0:1783965204.561303:0:15504:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1783965204.561337:0:15504:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.112@tcp lock: ffff94743d9ef200/0xe782b916994fe6dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965204.561349:0:15504:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.112@tcp lock: ffff94743d9ef200/0xe782b916994fe6dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965204.561360:0:15504:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.112@tcp lock: ffff94743d9ef200/0xe782b916994fe6dc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783965204.561388:0:15504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e29b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72a5858e-0958-4c77-91cf-d6507b930817:15504:1870622732941440:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1783965204.561446:0:15504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783965204.561482:0:15504:0:(client.c:2702:ptlrpc_set_wait()) set ffff94743fb23600 going to sleep for 11 seconds 00000100:00100000:0.0:1783965204.561555:0:14193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732941440 00000100:00100000:0.0:1783965204.561561:0:14193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732941440 00000100:00100000:0.0:1783965204.561606:0:14193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1783965204.561615:0:14193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743f21fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72a5858e-0958-4c77-91cf-d6507b930817+18:15504:x1870622732941440:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1783965204.561627:0:14193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783965204.561639:0:14193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94743e2fd000/0xe782b916994fe6e3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0xe782b916994fe6dc expref: -99 pid: 14193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965204.561734:0:14193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94743e2fd000/0xe782b916994fe6e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe782b916994fe6dc expref: 19 pid: 14193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965204.561753:0:14193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94743e2fd000/0xe782b916994fe6e3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe782b916994fe6dc expref: 19 pid: 14193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965204.561832:0:14193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94743e2fd000, rc 0) 00000100:00100000:0.0:1783965204.561871:0:14193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743f21fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72a5858e-0958-4c77-91cf-d6507b930817+19:15504:x1870622732941440:12345-0@lo:101:mount.lustre.0 Request processed in 257us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965204.561878:0:14193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1783965204.562025:0:15504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e29b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72a5858e-0958-4c77-91cf-d6507b930817:15504:1870622732941440:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1783965204.562047:0:15504:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.112@tcp lock: ffff94743d9ef200/0xe782b916994fe6dc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fe6e3 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965204.562067:0:15504:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.112@tcp lock: ffff94743d9ef200/0xe782b916994fe6dc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0xe782b916994fe6e3 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1783965204.562647:0:15504:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:2.0:1783965204.570129:0:15504:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783965204.570815:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1783965204.570863:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1783965204.570894:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1783965204.570940:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1783965204.570978:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1783965204.571125:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1783965204.571166:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1783965204.571522:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1783965204.571579:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1783965204.571617:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1783965204.571653:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1783965204.571699:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1783965204.571734:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1783965204.571763:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1783965204.571821:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1783965204.571869:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1783965204.571903:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1783965204.571951:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1783965204.571985:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1783965204.572268:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1783965204.572387:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1783965204.572419:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1783965204.572448:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1783965204.572505:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1783965204.572536:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:2.0:1783965204.572564:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:2.0:1783965204.572603:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:2.0:1783965204.572633:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:2.0:1783965204.572661:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:2.0:1783965204.572703:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:2.0:1783965204.572732:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:2.0:1783965204.572759:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:2.0:1783965204.572790:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:2.0:1783965204.572849:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:2.0:1783965204.572886:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:2.0:1783965204.572932:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:2.0:1783965204.572964:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:2.0:1783965204.573486:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:2.0:1783965204.573497:0:15504:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:2.0:1783965204.573604:0:15504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743706dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72a5858e-0958-4c77-91cf-d6507b930817:15504:1870622732941568:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783965204.573668:0:15504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783965204.573712:0:15504:0:(client.c:2702:ptlrpc_set_wait()) set ffff9474370bb900 going to sleep for 11 seconds 00000100:00100000:3.0:1783965204.574179:0:14192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732941568 00000100:00100000:3.0:1783965204.574187:0:14192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732941568 00000100:00100000:3.0:1783965204.574258:0:14192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1783965204.574268:0:14192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743f21d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72a5858e-0958-4c77-91cf-d6507b930817+19:15504:x1870622732941568:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1783965204.574500:0:14192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743f21d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72a5858e-0958-4c77-91cf-d6507b930817+19:15504:x1870622732941568:12345-0@lo:501:mount.lustre.0 Request processed in 232us (830us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965204.574508:0:14192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1783965204.574612:0:15504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743706dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72a5858e-0958-4c77-91cf-d6507b930817:15504:1870622732941568:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1783965204.574662:0:15504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743706dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72a5858e-0958-4c77-91cf-d6507b930817:15504:1870622732941696:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1783965204.574698:0:15504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783965204.574722:0:15504:0:(client.c:2702:ptlrpc_set_wait()) set ffff9474370bb900 going to sleep for 11 seconds 00000100:00100000:3.0:1783965204.575244:0:14194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732941696 00000100:00100000:3.0:1783965204.575249:0:14194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732941696 00000100:00100000:3.0:1783965204.575325:0:14194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1783965204.575333:0:14194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743f21f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72a5858e-0958-4c77-91cf-d6507b930817+19:15504:x1870622732941696:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1783965204.575554:0:14194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743f21f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72a5858e-0958-4c77-91cf-d6507b930817+19:15504:x1870622732941696:12345-0@lo:503:mount.lustre.0 Request processed in 222us (855us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965204.575562:0:14194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1783965204.579433:0:15504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743706dc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72a5858e-0958-4c77-91cf-d6507b930817:15504:1870622732941696:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1783965204.580191:0:15504:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1783965204.580386:0:15504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9474368d4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72a5858e-0958-4c77-91cf-d6507b930817:15504:1870622732941824:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783965204.580450:0:15504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783965204.580494:0:15504:0:(client.c:2702:ptlrpc_set_wait()) set ffff947408c42900 going to sleep for 11 seconds 00000100:00100000:2.0:1783965204.580544:0:14192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732941824 00000100:00100000:2.0:1783965204.580551:0:14192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732941824 00000100:00100000:2.0:1783965204.580596:0:14192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1783965204.580605:0:14192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743f21f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72a5858e-0958-4c77-91cf-d6507b930817+19:15504:x1870622732941824:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783965204.583107:0:14192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743f21f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72a5858e-0958-4c77-91cf-d6507b930817+19:15504:x1870622732941824:12345-0@lo:502:mount.lustre.0 Request processed in 2155us (2308us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965204.583122:0:14192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1783965204.583273:0:15504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9474368d4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72a5858e-0958-4c77-91cf-d6507b930817:15504:1870622732941824:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1783965204.583602:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1783965204.583663:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1783965204.583694:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1783965204.583754:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1783965204.583870:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1783965204.583907:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1783965204.583936:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1783965204.583962:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1783965204.583995:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1783965204.584020:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1783965204.584411:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1783965204.584452:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1783965204.584477:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1783965204.584499:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1783965204.584530:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1783965204.584554:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1783965204.584576:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1783965204.584607:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1783965204.584638:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1783965204.584679:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1783965204.584723:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1783965204.584928:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1783965204.584971:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1783965204.585020:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1783965204.585054:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:2.0:1783965204.585072:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:2.0:1783965204.585096:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:2.0:1783965204.585114:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:2.0:1783965204.585130:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:2.0:1783965204.585153:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:2.0:1783965204.585170:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:2.0:1783965204.585186:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:2.0:1783965204.585249:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:2.0:1783965204.585280:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:2.0:1783965204.585311:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:2.0:1783965204.585380:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:2.0:1783965204.585414:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:2.0:1783965204.585443:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:2.0:1783965204.585481:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:2.0:1783965204.585510:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:2.0:1783965204.585558:0:15504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743706fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72a5858e-0958-4c77-91cf-d6507b930817:15504:1870622732941952:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1783965204.585629:0:15504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783965204.585667:0:15504:0:(client.c:2702:ptlrpc_set_wait()) set ffff94740593a780 going to sleep for 11 seconds 00000100:00100000:3.0:1783965204.586084:0:14194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732941952 00000100:00100000:3.0:1783965204.586090:0:14194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732941952 00000100:00100000:3.0:1783965204.586132:0:14194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1783965204.586140:0:14194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743f21e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72a5858e-0958-4c77-91cf-d6507b930817+19:15504:x1870622732941952:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1783965204.586418:0:14194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743f21e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72a5858e-0958-4c77-91cf-d6507b930817+19:15504:x1870622732941952:12345-0@lo:502:mount.lustre.0 Request processed in 278us (789us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965204.586425:0:14194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1783965204.586444:0:15504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743706fb80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72a5858e-0958-4c77-91cf-d6507b930817:15504:1870622732941952:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1783965204.586520:0:15504:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:0.0:1783965204.586532:0:15504:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:0.0:1783965204.587398:0:15514:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1783965204.587415:0:15514:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9474259c99c0) 00000020:00000080:0.0:1783965204.587436:0:15514:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:0.0:1783965204.587574:0:15514:0:(tgt_mount.c:153:server_get_mount()) get mount ffff947425afb000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1783965204.587578:0:15514:0:(tgt_mount.c:187:server_put_mount()) put mount ffff947425afb000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1783965204.587580:0:15514:0:(obd_mount.c:710:lustre_put_lsi()) put ffff947425afb000 3 00010000:00080000:0.0:1783965204.587607:0:15514:0:(ldlm_lib.c:102:import_set_conn()) imp ffff947304835800@lustre-MDT0000-lwp-OST0001: add connection 192.168.204.112@tcp at head 00010000:00010000:0.0:1783965204.589311:0:15514:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:0.0:1783965204.589431:0:15514:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1783965204.589463:0:15514:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1783965204.589473:0:15514:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0xe782b916994fe6f1 00000100:00080000:0.0:1783965204.589483:0:15514:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1783965204.589488:0:15514:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff947304835800 using connection 192.168.204.112@tcp/0@lo 00000100:00100000:0.0:1783965204.589525:0:15514:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94743fb9f480 x1870622732942080/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1783965204.589547:0:15514:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1783965204.589850:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743fb9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3321:1870622732942080:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1783965204.589918:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783965204.590375:0:14199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732942080 00000100:00100000:0.0:1783965204.590382:0:14199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732942080 00000100:00100000:0.0:1783965204.590425:0:14199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1783965204.590433:0:14199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e29b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3321:x1870622732942080:12345-0@lo:38:llog_process_th.0 00010000:00080000:0.0:1783965204.590457:0:14199:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 438 last 0 00000020:00000080:0.0:1783965204.590497:0:14199:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0xe782b916994fe6f8 00000004:00100000:0.0:1783965204.590513:0:14199:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1783965204.590545:0:14199:0:(import.c:65:import_set_state_nolock()) ffff947429f72800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1783965204.590601:0:14199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e29b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3321:x1870622732942080:12345-0@lo:38:llog_process_th.0 Request processed in 168us (683us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965204.590608:0:14199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1783965204.590888:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff94743fb9f480 x1870622732942080/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1783965214 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783965204.590900:0:3321:0:(client.c:3112:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1783965204.590908:0:3321:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:1.0:1783965204.590914:0:3321:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1783965204.590919:0:3321:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1783965204.590922:0:3321:0:(import.c:65:import_set_state_nolock()) ffff947304835800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1783965204.590928:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743fb9f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3321:1870622732942080:0@lo:38:llog_process_th.0 00000100:00080000:3.0:1783965204.591786:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1783965204.591791:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1783965204.591794:0:38:0:(import.c:65:import_set_state_nolock()) ffff947405904000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1783965204.591809:0:38:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 436 00000100:00080000:3.0:1783965204.591813:0:38:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:3.0:1783965204.591818:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff947405904000 using connection 192.168.204.112@tcp/0@lo 00000100:00100000:3.0:1783965204.591835:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9474368d7100 x1870622732942336/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1783965204.591904:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9474368d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3322:1870622732942592:0@lo:400:kworker.0 00000100:00100000:3.0:1783965204.591951:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783965204.591993:0:14200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732942592 00000100:00100000:3.0:1783965204.591998:0:14200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732942592 00000100:00100000:1.0:1783965204.592131:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9474368d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3324:1870622732942208:0@lo:400:kworker.0 00000100:00100000:1.0:1783965204.592163:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783965204.592183:0:3324:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783965204.592188:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9474368d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3324:1870622732942464:0@lo:400:kworker.0 00000100:00100000:1.0:1783965204.592230:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783965204.592252:0:14201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732942464 00000100:00100000:1.0:1783965204.592255:0:14201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732942464 00000100:00100000:1.0:1783965204.592273:0:14201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783965204.592280:0:14201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9474368d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3322:x1870622732942592:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783965204.592321:0:14201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9474368d4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3322:x1870622732942592:12345-0@lo:400:kworker.0 Request processed in 41us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965204.592333:0:14201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783965204.592348:0:14201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1783965204.592354:0:14201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e299500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3324:x1870622732942464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783965204.592386:0:14201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e299500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3324:x1870622732942464:12345-0@lo:400:kworker.0 Request processed in 33us (156us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965204.592393:0:14201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:1.0:1783965204.592422:0:3324:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9474368d6680 x1870622732942464/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783965220 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783965204.592434:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9474368d6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3324:1870622732942464:0@lo:400:kworker.0 00000100:00080000:3.0:1783965204.592506:0:14195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783965204.592518:0:14837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732942208 00000100:00100000:3.0:1783965204.592522:0:14837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732942208 00000100:00100000:3.0:1783965204.592552:0:14837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1783965204.592559:0:14837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e298e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3324:x1870622732942208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783965204.592594:0:14837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e298e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3324:x1870622732942208:12345-0@lo:400:kworker.0 Request processed in 36us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965204.592601:0:14837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1783965204.592744:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9474368d4380 x1870622732942592/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783965220 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1783965204.592754:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9474368d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3322:1870622732942592:0@lo:400:kworker.0 00000100:00100000:3.0:1783965204.592777:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9474368d5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3324:1870622732942208:0@lo:400:kworker.0 00000100:00100000:3.0:1783965204.592792:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9474368d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3321:1870622732942336:0@lo:8:kworker.0 00000100:00100000:3.0:1783965204.592829:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783965204.592856:0:14834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732942336 00000100:00100000:3.0:1783965204.592859:0:14834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732942336 00000100:00100000:3.0:1783965204.592874:0:14834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783965204.592878:0:14834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9474368d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3321:x1870622732942336:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1783965204.592915:0:14834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9474368d5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3321:x1870622732942336:12345-0@lo:8:kworker.0 Request processed in 36us (86us total) trans 0 rc -11/-11 00000100:00100000:3.0:1783965204.592921:0:14834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783965204.592952:0:3321:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1783965204.592957:0:3321:0:(import.c:65:import_set_state_nolock()) ffff947405904000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1783965204.592960:0:3321:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1783965204.592963:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9474368d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3321:1870622732942336:0@lo:8:kworker.0 00000040:00080000:0.0:1783965204.592970:0:15514:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000100:00080000:1.0:1783965204.593015:0:14195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:01000000:3.0:1783965204.593525:0:15504:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1783965204.593554:0:15504:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.112@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1783965204.593566:0:15504:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.112@tcp lock: ffff94743d9ef200/0xe782b916994fe6dc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fe6e3 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965204.593577:0:15504:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.112@tcp lock: ffff94743d9ef200/0xe782b916994fe6dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fe6e3 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1783965204.593616:0:15504:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1783965204.593618:0:15504:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1783965204.593619:0:15504:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783965204.593620:0:15504:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783965204.593622:0:15504:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783965204.593623:0:15504:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783965204.593625:0:15504:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783965204.593626:0:15504:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783965204.593628:0:15504:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1783965204.593631:0:15504:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:3.0:1783965204.593634:0:15504:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1783965204.593635:0:15504:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1783965204.593636:0:15504:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783965204.593637:0:15504:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783965204.593639:0:15504:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783965204.593640:0:15504:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783965204.593641:0:15504:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783965204.593642:0:15504:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783965204.593643:0:15504:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1783965204.593659:0:15504:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1783965204.593671:0:15504:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9474368d7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72a5858e-0958-4c77-91cf-d6507b930817:15504:1870622732942720:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1783965204.593714:0:15504:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783965204.593742:0:15504:0:(client.c:2702:ptlrpc_set_wait()) set ffff947402875900 going to sleep for 11 seconds 00000100:00100000:0.0:1783965204.593851:0:14193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732942720 00000100:00100000:0.0:1783965204.593856:0:14193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732942720 00000100:00100000:0.0:1783965204.593893:0:14193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1783965204.593900:0:14193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743f21cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72a5858e-0958-4c77-91cf-d6507b930817+19:15504:x1870622732942720:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1783965204.593920:0:14193:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1783965204.593934:0:14193:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1783965204.631557:0:14193:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1783965204.631578:0:14193:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1783965204.631688:0:14215:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1783965204.631693:0:14215:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1783965204.631716:0:14215:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff947425975600/0xe782b916994fe6ff lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965204.631735:0:14215:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94743e2fd400/0xe782b916994fe5d2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe782b916994fe5cb expref: 19 pid: 14194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965204.631744:0:14215:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff947425975600/0xe782b916994fe6ff lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965204.631813:0:14215:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94743e2fd400/0xe782b916994fe5d2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe782b916994fe5cb expref: 19 pid: 14194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965204.631827:0:14215:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff94743e2fd400/0xe782b916994fe5d2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe782b916994fe5cb expref: 19 pid: 14194 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783965204.631841:0:14215:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743706e300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14215:1870622732942848:0@lo:104: 00000100:00100000:2.0:1783965204.631904:0:14215:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783965204.631954:0:14215:0:(client.c:2702:ptlrpc_set_wait()) set ffff947408c42900 going to sleep for 11 seconds 00000100:00100000:3.0:1783965204.632036:0:14183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732942848 00000100:00100000:3.0:1783965204.632043:0:14183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732942848 00000100:00100000:3.0:1783965204.632093:0:14183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783965204.632101:0:14183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743706ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:72a5858e-0958-4c77-91cf-d6507b930817+3:14215:x1870622732942848:12345-0@lo:104: 00010000:00010000:3.0:1783965204.632113:0:14183:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.112@tcp lock: ffff94743e2fde00/0xe782b916994fe5cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe782b916994fe5d2 expref: -99 pid: 14196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965204.632165:0:14183:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1783965204.632171:0:14183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743706ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:72a5858e-0958-4c77-91cf-d6507b930817+3:14215:x1870622732942848:12345-0@lo:104: Request processed in 71us (267us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965204.632178:0:14183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1783965204.632451:0:14188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783965204.632459:0:14188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.112@tcp lock: ffff94743e2fde00/0xe782b916994fe5cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe782b916994fe5d2 expref: -99 pid: 14196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965204.632467:0:14188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743e2fde00 already unused, calling callback (ffffffffc1ca8c20) 10000000:00010000:3.0:1783965204.632471:0:14188:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.112@tcp lock: ffff94743e2fde00/0xe782b916994fe5cb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe782b916994fe5d2 expref: -99 pid: 14196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965204.632479:0:14188:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.112@tcp lock: ffff94743e2fde00/0xe782b916994fe5cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe782b916994fe5d2 expref: -99 pid: 14196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783965204.632486:0:14188:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.112@tcp lock: ffff94743e2fde00/0xe782b916994fe5cb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe782b916994fe5d2 expref: -99 pid: 14196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783965204.632492:0:14188:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1783965204.632526:0:14188:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.112@tcp lock: ffff94743e2fde00/0xe782b916994fe5cb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe782b916994fe5d2 expref: -99 pid: 14196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965204.632533:0:14188:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783965204.632560:0:14188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.112@tcp lock: ffff94743e2fde00/0xe782b916994fe5cb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe782b916994fe5d2 expref: -99 pid: 14196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965204.632567:0:14188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.112@tcp lock: ffff94743e2fde00/0xe782b916994fe5cb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe782b916994fe5d2 expref: -99 pid: 14196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965204.632582:0:14188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783965204.632584:0:14188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783965204.632586:0:14188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783965204.632597:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9474368d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:72a5858e-0958-4c77-91cf-d6507b930817:3323:1870622732942976:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783965204.632626:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783965204.632667:0:14186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732942976 00000100:00100000:3.0:1783965204.632671:0:14186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732942976 00010000:00010000:3.0:1783965204.632688:0:14186:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94743e2fd400/0xe782b916994fe5d2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe782b916994fe5cb expref: 20 pid: 14194 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783965204.632710:0:14186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783965204.632717:0:14186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9474368d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:72a5858e-0958-4c77-91cf-d6507b930817+20:3323:x1870622732942976:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783965204.632726:0:14186:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783965204.632731:0:14186:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94743e2fd400/0xe782b916994fe5d2 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe782b916994fe5cb expref: 20 pid: 14194 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965204.632742:0:14186:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94743e2fd400/0xe782b916994fe5d2 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe782b916994fe5cb expref: 20 pid: 14194 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965204.632757:0:14186:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff947425975600/0xe782b916994fe6ff lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965204.632765:0:14186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff947425975600/0xe782b916994fe6ff lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1783965204.632787:0:14186:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001342130s 00010000:00010000:3.0:1783965204.632791:0:14186:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff947425975600/0xe782b916994fe6ff lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965204.632807:0:14186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff947425975600/0xe782b916994fe6ff lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965204.632813:0:14186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff947425975600/0xe782b916994fe6ff lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965204.632820:0:14186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff947425975600/0xe782b916994fe6ff lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965204.632825:0:14186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947425975600 already unused, calling callback (ffffffffc168d230) 00010000:00010000:3.0:1783965204.632829:0:14186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff947425975600/0xe782b916994fe6ff lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965204.632836:0:14186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff947425975600/0xe782b916994fe6ff lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965204.632846:0:14186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff947425975600/0xe782b916994fe6ff lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965204.632856:0:14186:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1783965204.632885:0:14186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9474368d7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:72a5858e-0958-4c77-91cf-d6507b930817+20:3323:x1870622732942976:12345-0@lo:103:ldlm_bl.0 Request processed in 168us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965204.632892:0:14186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1783965204.632929:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9474368d4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:72a5858e-0958-4c77-91cf-d6507b930817:3323:1870622732942976:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783965204.632954:0:14215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94743e2fd400/0xe782b916994fe5d2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe782b916994fe5cb expref: 19 pid: 14194 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783965204.632971:0:14215:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743706e300 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14215:1870622732942848:0@lo:104: 00010000:00010000:3.0:1783965204.632987:0:14215:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff947425975600/0xe782b916994fe6ff lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965204.632994:0:14215:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff947425975600/0xe782b916994fe6ff lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965204.633000:0:14215:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff947425975600/0xe782b916994fe6ff lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965204.633005:0:14215:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff947425975600/0xe782b916994fe6ff lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14215 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783965204.648347:0:14193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743f21cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72a5858e-0958-4c77-91cf-d6507b930817+18:15504:x1870622732942720:12345-0@lo:253:mount.lustre.0 Request processed in 54437us (54621us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965204.648363:0:14193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1783965204.648428:0:15504:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9474368d7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:72a5858e-0958-4c77-91cf-d6507b930817:15504:1870622732942720:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1783965204.648443:0:15504:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1783965204.648446:0:15504:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1783965204.648447:0:15504:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1783965204.648449:0:15504:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1783965204.648450:0:15504:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1783965204.648451:0:15504:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1783965204.648452:0:15504:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1783965204.648453:0:15504:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1783965204.648455:0:15504:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1783965204.648456:0:15504:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1783965204.648471:0:15504:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1783965204.658900:0:15504:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1783965204.659613:0:15504:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1783965204.659812:0:15504:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1783965204.659963:0:15504:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1783965204.660131:0:15504:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1783965204.660363:0:15504:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1783965204.661360:0:15504:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1783965204.708134:0:15504:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1783965204.708143:0:15504:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1783965204.708173:0:15504:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1783965204.708262:0:15504:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.204.112@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1783965204.708277:0:15504:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1783965204.708301:0:15504:0:(super25.c:181:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:0.0:1783965205.036489:0:14187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783965206.062883:0:14188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1783965206.315320:0:14196:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1783965206.315328:0:14196:0:(mgc_request.c:1801:mgc_process_log()) Process log lustre-mdtir-ffff94743fbe4800 from 8 10000000:01000000:2.0:1783965206.315334:0:14196:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1783965206.315380:0:14196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.112@tcp lock: ffff947425975400/0xe782b916994fe706 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965206.315392:0:14196:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.112@tcp lock: ffff947425975400/0xe782b916994fe706 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965206.315404:0:14196:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.112@tcp lock: ffff947425975400/0xe782b916994fe706 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783965206.315430:0:14196:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743706f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72a5858e-0958-4c77-91cf-d6507b930817:14196:1870622732943104:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783965206.315509:0:14196:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783965206.315560:0:14196:0:(client.c:2702:ptlrpc_set_wait()) set ffff94743fb23cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1783965206.315809:0:14192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732943104 00000100:00100000:3.0:1783965206.315817:0:14192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732943104 00000100:00100000:3.0:1783965206.315883:0:14192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1783965206.315892:0:14192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743f21d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72a5858e-0958-4c77-91cf-d6507b930817+18:14196:x1870622732943104:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783965206.315905:0:14192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783965206.315919:0:14192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94743fb8ec00/0xe782b916994fe70d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe782b916994fe706 expref: -99 pid: 14192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965206.315943:0:14192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94743fb8ec00/0xe782b916994fe70d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe782b916994fe706 expref: 19 pid: 14192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965206.315954:0:14192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94743fb8ec00/0xe782b916994fe70d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe782b916994fe706 expref: 19 pid: 14192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965206.315963:0:14192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94743fb8ec00, rc 0) 00000100:00100000:3.0:1783965206.316019:0:14192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743f21d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72a5858e-0958-4c77-91cf-d6507b930817+19:14196:x1870622732943104:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 128us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965206.316025:0:14192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1783965206.316112:0:14196:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743706f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72a5858e-0958-4c77-91cf-d6507b930817:14196:1870622732943104:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783965206.316128:0:14196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.112@tcp lock: ffff947425975400/0xe782b916994fe706 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fe70d expref: -99 pid: 14196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965206.316137:0:14196:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.112@tcp lock: ffff947425975400/0xe782b916994fe706 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe782b916994fe70d expref: -99 pid: 14196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783965206.316240:0:14196:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743fb9d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72a5858e-0958-4c77-91cf-d6507b930817:14196:1870622732943232:0@lo:256:ll_cfg_requeue.0 00000100:00100000:0.0:1783965206.316273:0:14196:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783965206.316388:0:14193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732943232 00000100:00100000:3.0:1783965206.316393:0:14193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732943232 00000100:00100000:3.0:1783965206.316418:0:14193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1783965206.316425:0:14193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743f21e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72a5858e-0958-4c77-91cf-d6507b930817+19:14196:x1870622732943232:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1783965206.316438:0:14193:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1783965206.316458:0:14193:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1783965206.316461:0:14193:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:3.0:1783965206.316535:0:14193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743f21e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72a5858e-0958-4c77-91cf-d6507b930817+19:14196:x1870622732943232:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 110us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965206.316542:0:14193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1783965206.316599:0:14196:0:(client.c:2702:ptlrpc_set_wait()) set ffff947429e070c0 going to sleep for 11 seconds 00000100:00100000:0.0:1783965206.316612:0:14196:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743fb9d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72a5858e-0958-4c77-91cf-d6507b930817:14196:1870622732943232:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1783965206.316664:0:14196:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.112@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1783965206.316671:0:14196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.112@tcp lock: ffff947425975400/0xe782b916994fe706 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fe70d expref: -99 pid: 14196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965206.316679:0:14196:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.112@tcp lock: ffff947425975400/0xe782b916994fe706 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fe70d expref: -99 pid: 14196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00100000:2.0:1783965206.682796:0:6637:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:2.0:1783965206.682891:0:6637:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00010000:00010000:0.0:1783965207.084824:0:14187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783965207.597036:0:3325:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783965207.597059:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9474368d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3325:1870622732943360:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783965207.597127:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783965207.597191:0:14838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732943360 00000100:00100000:3.0:1783965207.597197:0:14838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732943360 00000100:00100000:3.0:1783965207.597267:0:14838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1783965207.597276:0:14838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9474368d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3325:x1870622732943360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783965207.597311:0:14838:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783965207.597354:0:14838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9474368d4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3325:x1870622732943360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (227us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965207.597362:0:14838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1783965207.597381:0:14195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783965207.597409:0:3325:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:3.0:1783965207.597431:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9474368d7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3325:1870622732943360:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1783965208.107728:0:14188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783965209.140090:0:14187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1783965209.515864:0:14233:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00080000:2.0:1783965209.644669:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1783965209.644676:0:38:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1783965209.644680:0:38:0:(import.c:65:import_set_state_nolock()) ffff947405904000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1783965209.644693:0:38:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff947405904000 using connection 192.168.204.112@tcp/0@lo 00000100:00100000:2.0:1783965209.644729:0:38:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff94743706df80 x1870622732943744/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1783965209.644788:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743706c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:72a5858e-0958-4c77-91cf-d6507b930817:3325:1870622732943488:0@lo:400:kworker.0 00000100:00100000:2.0:1783965209.644871:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783965209.644923:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743706ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3325:1870622732944128:0@lo:400:kworker.0 00000100:00100000:2.0:1783965209.644953:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783965209.644981:0:3325:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783965209.644987:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743706c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3325:1870622732944000:0@lo:400:kworker.0 00000100:00100000:2.0:1783965209.645010:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783965209.645036:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743706f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3322:1870622732943616:0@lo:400:kworker.0 00000100:00100000:2.0:1783965209.645060:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783965209.645077:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1783965209.645081:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743706f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3322:1870622732943872:0@lo:400:kworker.0 00000100:00100000:2.0:1783965209.645103:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783965209.645149:0:3321:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743706df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3321:1870622732943744:0@lo:8:kworker.0 00000100:00100000:2.0:1783965209.645172:0:3321:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783965209.645224:0:14194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732943488 00000100:00100000:2.0:1783965209.645231:0:14194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732943488 00000100:00100000:2.0:1783965209.645274:0:14194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1783965209.645293:0:14194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743f21d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72a5858e-0958-4c77-91cf-d6507b930817+19:3325:x1870622732943488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783965209.645343:0:14194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743f21d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72a5858e-0958-4c77-91cf-d6507b930817+19:3325:x1870622732943488:12345-0@lo:400:kworker.0 Request processed in 52us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965209.645350:0:14194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1783965209.645381:0:14201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732944128 00000100:00100000:2.0:1783965209.645385:0:14201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732944128 00000100:00100000:2.0:1783965209.645415:0:14201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732944000 00000100:00100000:2.0:1783965209.645418:0:14201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732944000 00000100:00100000:2.0:1783965209.645430:0:14201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732943872 00000100:00100000:2.0:1783965209.645433:0:14201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732943872 00000100:00100000:2.0:1783965209.645445:0:14201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1783965209.645450:0:14201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743706e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3325:x1870622732944128:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783965209.648873:0:14201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743706e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3325:x1870622732944128:12345-0@lo:400:kworker.0 Request processed in 3411us (3908us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965209.648891:0:14201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1783965209.648931:0:14201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1783965209.648947:0:14201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743706ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3325:x1870622732944000:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783965209.650032:0:14201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743706ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3325:x1870622732944000:12345-0@lo:400:kworker.0 Request processed in 1088us (5016us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965209.650044:0:14201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1783965209.650063:0:14201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1783965209.650072:0:14201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743706e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3322:x1870622732943872:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783965209.650131:0:14201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743706e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3322:x1870622732943872:12345-0@lo:400:kworker.0 Request processed in 61us (5026us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965209.650137:0:14201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1783965209.650169:0:14835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732943616 00000100:00100000:2.0:1783965209.650176:0:14835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732943616 00000100:00100000:1.0:1783965209.650335:0:14834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732943744 00000100:00100000:1.0:1783965209.650341:0:14834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732943744 00000100:00100000:1.0:1783965209.650382:0:14834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783965209.650389:0:14834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743706fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3321:x1870622732943744:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1783965209.650421:0:14834:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 443 last 0 00000020:00000080:1.0:1783965209.650450:0:14834:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0xe782b916994fe714 00002000:00100000:1.0:1783965209.650465:0:14834:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff94743e558000 ocd_connect_flags: 0xa044401443000026 ocd_version: 21136a2 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1783965209.650469:0:14834:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1783965209.650471:0:14834:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1783965209.650843:0:14834:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1783965209.650870:0:14834:0:(import.c:65:import_set_state_nolock()) ffff94743e55c000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1783965209.650931:0:14834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743706fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3321:x1870622732943744:12345-0@lo:8:kworker.0 Request processed in 541us (5757us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965209.650937:0:14834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1783965209.651000:0:3325:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94743706c000 x1870622732944000/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783965225 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783965209.651016:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743706c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3325:1870622732944000:0@lo:400:kworker.0 00000100:00100000:1.0:1783965209.651028:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743706c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:72a5858e-0958-4c77-91cf-d6507b930817:3325:1870622732943488:0@lo:400:kworker.0 00010000:00080000:1.0:1783965209.651040:0:3325:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94743706ea00 x1870622732944128/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783965225 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1783965209.651048:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743706ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3325:1870622732944128:0@lo:400:kworker.0 00010000:00080000:0.0:1783965209.651631:0:3322:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94743706f480 x1870622732943872/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1783965225 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1783965209.651643:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743706f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3322:1870622732943872:0@lo:400:kworker.0 00000100:00100000:2.0:1783965209.652631:0:14835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783965209.652642:0:14835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743706f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3322:x1870622732943616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783965209.652733:0:14835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743706f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3322:x1870622732943616:12345-0@lo:400:kworker.0 Request processed in 93us (7671us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965209.652739:0:14835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1783965209.652796:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743706f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3322:1870622732943616:0@lo:400:kworker.0 00000100:00080000:2.0:1783965209.657590:0:14195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783965209.657602:0:14195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1783965209.657658:0:3321:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94743706df80 x1870622732943744/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1783965234 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1783965209.657679:0:3321:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1783965209.657689:0:3321:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1783965209.657695:0:3321:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1783965209.657698:0:3321:0:(import.c:65:import_set_state_nolock()) ffff947405904000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1783965209.657736:0:3321:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1783965209.657743:0:3321:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743706df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3321:1870622732943744:0@lo:8:kworker.0 00000004:00080000:1.0:1783965209.659657:0:14224:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x6:0x0] 00000100:00100000:1.0:1783965209.659687:0:14224:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e29a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14224:1870622732944384:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1783965209.659767:0:14224:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783965209.659798:0:14224:0:(client.c:2702:ptlrpc_set_wait()) set ffff947409525000 going to sleep for 11 seconds 00000004:00080000:1.0:1783965209.659817:0:14223:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1783965209.660306:0:14223:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 443889103660ns, next at 0ns, rc = 0 00000100:00100000:1.0:1783965209.660330:0:3323:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783965209.660345:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e29b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3323:1870622732944256:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783965209.660377:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783965209.660410:0:14837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732944384 00000100:00100000:1.0:1783965209.660417:0:14837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732944384 00000100:00100000:1.0:1783965209.660472:0:14837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783965209.661144:0:14837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e29ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14224:x1870622732944384:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:1.0:1783965209.663639:0:14837:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:1.0:1783965209.663648:0:14837:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:1.0:1783965209.663654:0:14837:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:7 to 0x280000400:33) 00000100:00080000:2.0:1783965209.664303:0:14195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783965209.664326:0:14838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732944256 00000100:00100000:2.0:1783965209.664335:0:14838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732944256 00000100:00100000:2.0:1783965209.664392:0:14838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783965209.664401:0:14838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e298700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3323:x1870622732944256:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783965209.664436:0:14838:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783965209.664535:0:14838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e298700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3323:x1870622732944256:12345-0@lo:13:osp-pre-1-0.0 Request processed in 135us (4157us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965209.664542:0:14838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1783965209.676773:0:3323:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff94743e29b480 x1870622732944256/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1783965225 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1783965209.676802:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e29b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3323:1870622732944256:0@lo:13:osp-pre-1-0.0 00002000:00010000:1.0:1783965209.682049:0:14837:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783965209.682061:0:14837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007169540f/0xe782b916994fe71b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965209.682085:0:14837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=443s v=(0 0) 00010000:00010000:1.0:1783965209.682089:0:14837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783965209.682095:0:14837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007169540f/0xe782b916994fe71b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965209.682113:0:14837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007169540f/0xe782b916994fe71b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965209.682123:0:14837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007169540f/0xe782b916994fe71b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965209.682130:0:14837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007169540f/0xe782b916994fe71b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965209.682153:0:14837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1783965209.682884:0:14837:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783965209.682893:0:14837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bdc85d1d/0xe782b916994fe722 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965209.682904:0:14837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=443s v=(0 0) 00010000:00010000:1.0:1783965209.682908:0:14837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783965209.682912:0:14837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bdc85d1d/0xe782b916994fe722 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965209.682923:0:14837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bdc85d1d/0xe782b916994fe722 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965209.682944:0:14837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bdc85d1d/0xe782b916994fe722 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965209.682951:0:14837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bdc85d1d/0xe782b916994fe722 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965209.682971:0:14837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1783965209.682983:0:14187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783965209.682989:0:14187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007169540f/0xe782b916994fe71b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965209.682996:0:14187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743d9efe00 already unused, calling callback (ffffffffc168d230) 00010000:00010000:1.0:1783965209.683001:0:14187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007169540f/0xe782b916994fe71b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965209.683010:0:14187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007169540f/0xe782b916994fe71b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965209.683028:0:14187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007169540f/0xe782b916994fe71b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965209.683034:0:14187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007169540f/0xe782b916994fe71b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965209.683059:0:14187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783965209.683068:0:14187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bdc85d1d/0xe782b916994fe722 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965209.683074:0:14187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743d9ee000 already unused, calling callback (ffffffffc168d230) 00010000:00010000:1.0:1783965209.683077:0:14187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bdc85d1d/0xe782b916994fe722 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965209.683085:0:14187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bdc85d1d/0xe782b916994fe722 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965209.683095:0:14187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bdc85d1d/0xe782b916994fe722 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965209.683102:0:14187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bdc85d1d/0xe782b916994fe722 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965209.683119:0:14187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783965209.683121:0:14187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783965209.683122:0:14187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1783965209.683561:0:14837:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1783965209.683568:0:14837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000b7b285e/0xe782b916994fe729 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965209.683578:0:14837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=443s v=(0 0) 00010000:00010000:1.0:1783965209.683581:0:14837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783965209.683586:0:14837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000b7b285e/0xe782b916994fe729 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965209.683608:0:14837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000b7b285e/0xe782b916994fe729 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965209.683617:0:14837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000b7b285e/0xe782b916994fe729 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965209.683624:0:14837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000b7b285e/0xe782b916994fe729 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965209.683640:0:14837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783965209.683649:0:14187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783965209.683652:0:14187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000b7b285e/0xe782b916994fe729 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965209.683659:0:14187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743d9eee00 already unused, calling callback (ffffffffc168d230) 00010000:00010000:1.0:1783965209.683662:0:14187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000b7b285e/0xe782b916994fe729 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965209.683670:0:14187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000b7b285e/0xe782b916994fe729 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965209.683680:0:14187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000b7b285e/0xe782b916994fe729 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965209.683687:0:14187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000b7b285e/0xe782b916994fe729 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965209.688777:0:14188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783965209.698413:0:14837:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783965209.698429:0:14837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac2b2a95/0xe782b916994fe730 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.698448:0:14837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=443s v=(0 0) 00010000:00010000:0.0:1783965209.698455:0:14837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783965209.698463:0:14837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ac2b2a95/0xe782b916994fe730 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.698494:0:14837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ac2b2a95/0xe782b916994fe730 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.698506:0:14837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ac2b2a95/0xe782b916994fe730 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.698515:0:14837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ac2b2a95/0xe782b916994fe730 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.698534:0:14837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783965209.698549:0:14188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00002000:00010000:0.0:1783965209.699148:0:14837:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783965209.699156:0:14837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bb47407d/0xe782b916994fe737 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.699165:0:14837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=443s v=(0 0) 00010000:00010000:0.0:1783965209.699170:0:14837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783965209.699174:0:14837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bb47407d/0xe782b916994fe737 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.699185:0:14837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bb47407d/0xe782b916994fe737 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.699194:0:14837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bb47407d/0xe782b916994fe737 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.699234:0:14837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bb47407d/0xe782b916994fe737 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.699245:0:14837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783965209.699716:0:14837:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783965209.699723:0:14837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000739de704/0xe782b916994fe73e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.699731:0:14837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=443s v=(0 0) 00010000:00010000:0.0:1783965209.699734:0:14837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783965209.699738:0:14837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000739de704/0xe782b916994fe73e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.699747:0:14837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000739de704/0xe782b916994fe73e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.699755:0:14837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000739de704/0xe782b916994fe73e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.699763:0:14837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000739de704/0xe782b916994fe73e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.699772:0:14837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1783965209.700229:0:14837:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783965209.700240:0:14837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000296c2a45/0xe782b916994fe745 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.700256:0:14837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=443s v=(0 0) 00010000:00010000:0.0:1783965209.700259:0:14837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783965209.700264:0:14837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000296c2a45/0xe782b916994fe745 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.700273:0:14837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000296c2a45/0xe782b916994fe745 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.700282:0:14837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000296c2a45/0xe782b916994fe745 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.700290:0:14837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000296c2a45/0xe782b916994fe745 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.700305:0:14837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:1.0:1783965209.701002:0:14187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1783965209.701012:0:14187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bb47407d/0xe782b916994fe737 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965209.701023:0:14187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743e2fd400 already unused, calling callback (ffffffffc168d230) 00010000:00010000:1.0:1783965209.701028:0:14187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bb47407d/0xe782b916994fe737 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965209.701038:0:14187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bb47407d/0xe782b916994fe737 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965209.701057:0:14187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bb47407d/0xe782b916994fe737 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965209.701065:0:14187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bb47407d/0xe782b916994fe737 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965209.701081:0:14187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1783965209.701085:0:14187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000739de704/0xe782b916994fe73e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965209.701092:0:14187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743e2fde00 already unused, calling callback (ffffffffc168d230) 00010000:00010000:1.0:1783965209.701096:0:14187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000739de704/0xe782b916994fe73e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965209.701118:0:14187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000739de704/0xe782b916994fe73e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965209.701131:0:14187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000739de704/0xe782b916994fe73e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965209.701137:0:14187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000739de704/0xe782b916994fe73e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965209.701149:0:14187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783965209.701152:0:14187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000296c2a45/0xe782b916994fe745 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965209.701158:0:14187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743e2fdc00 already unused, calling callback (ffffffffc168d230) 00010000:00010000:1.0:1783965209.701161:0:14187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000296c2a45/0xe782b916994fe745 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965209.701168:0:14187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000296c2a45/0xe782b916994fe745 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965209.701176:0:14187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000296c2a45/0xe782b916994fe745 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965209.701183:0:14187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000296c2a45/0xe782b916994fe745 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965209.701271:0:14187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783965209.701273:0:14187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783965209.701275:0:14187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783965209.701619:0:15786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783965209.701622:0:15786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783965209.701624:0:15786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783965209.701625:0:14188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ac2b2a95/0xe782b916994fe730 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.701635:0:14188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743e2fca00 already unused, calling callback (ffffffffc168d230) 00010000:00010000:0.0:1783965209.701639:0:14188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac2b2a95/0xe782b916994fe730 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.701648:0:14188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ac2b2a95/0xe782b916994fe730 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.701742:0:14188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ac2b2a95/0xe782b916994fe730 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.701750:0:14188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ac2b2a95/0xe782b916994fe730 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.701765:0:14188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783965209.701767:0:14188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783965209.701769:0:14188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783965209.701822:0:14837:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783965209.701829:0:14837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000085f10577/0xe782b916994fe74c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.701838:0:14837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=443s v=(0 0) 00010000:00010000:0.0:1783965209.701842:0:14837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783965209.701848:0:14837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000085f10577/0xe782b916994fe74c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.701858:0:14837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000085f10577/0xe782b916994fe74c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.701868:0:14837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000085f10577/0xe782b916994fe74c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.701875:0:14837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000085f10577/0xe782b916994fe74c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.701911:0:14837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783965209.701928:0:14187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783965209.701934:0:14187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000085f10577/0xe782b916994fe74c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965209.701943:0:14187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743e2fc000 already unused, calling callback (ffffffffc168d230) 00010000:00010000:1.0:1783965209.701947:0:14187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000085f10577/0xe782b916994fe74c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965209.701955:0:14187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000085f10577/0xe782b916994fe74c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965209.701967:0:14187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000085f10577/0xe782b916994fe74c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965209.701974:0:14187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000085f10577/0xe782b916994fe74c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965209.701993:0:14187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783965209.701995:0:14187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783965209.701998:0:14187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783965209.702755:0:14837:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783965209.702763:0:14837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005c968278/0xe782b916994fe753 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.702774:0:14837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=443s v=(0 0) 00010000:00010000:0.0:1783965209.702777:0:14837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783965209.702782:0:14837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005c968278/0xe782b916994fe753 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.702793:0:14837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005c968278/0xe782b916994fe753 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.702801:0:14837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005c968278/0xe782b916994fe753 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.702808:0:14837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005c968278/0xe782b916994fe753 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.702825:0:14837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783965209.703566:0:14837:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783965209.703575:0:14837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000038ed6dd1/0xe782b916994fe75a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.703585:0:14837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=443s v=(0 0) 00010000:00010000:0.0:1783965209.703593:0:14837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783965209.703599:0:14837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000038ed6dd1/0xe782b916994fe75a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.703611:0:14837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000038ed6dd1/0xe782b916994fe75a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.703621:0:14837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000038ed6dd1/0xe782b916994fe75a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.703628:0:14837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000038ed6dd1/0xe782b916994fe75a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.703644:0:14837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1783965209.703653:0:14188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783965209.703730:0:14188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005c968278/0xe782b916994fe753 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.703739:0:14188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947430c10000 already unused, calling callback (ffffffffc168d230) 00010000:00010000:0.0:1783965209.703743:0:14188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005c968278/0xe782b916994fe753 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.703752:0:14188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005c968278/0xe782b916994fe753 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.703766:0:14188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005c968278/0xe782b916994fe753 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.703785:0:14188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005c968278/0xe782b916994fe753 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.703804:0:14188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783965209.703807:0:14188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000038ed6dd1/0xe782b916994fe75a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.703813:0:14188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947430c11e00 already unused, calling callback (ffffffffc168d230) 00010000:00010000:0.0:1783965209.703817:0:14188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000038ed6dd1/0xe782b916994fe75a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.703824:0:14188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000038ed6dd1/0xe782b916994fe75a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.703833:0:14188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000038ed6dd1/0xe782b916994fe75a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.703841:0:14188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000038ed6dd1/0xe782b916994fe75a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.703852:0:14188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783965209.703853:0:14188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783965209.703855:0:14188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783965209.705995:0:14837:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783965209.706009:0:14837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fe136eca/0xe782b916994fe761 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.706034:0:14837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=443s v=(0 0) 00010000:00010000:0.0:1783965209.706996:0:14837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783965209.707007:0:14837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fe136eca/0xe782b916994fe761 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.707024:0:14837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fe136eca/0xe782b916994fe761 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.707034:0:14837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fe136eca/0xe782b916994fe761 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.707497:0:14837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fe136eca/0xe782b916994fe761 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.707518:0:14837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783965209.707533:0:14187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783965209.707539:0:14187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fe136eca/0xe782b916994fe761 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.707547:0:14187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947430c11c00 already unused, calling callback (ffffffffc168d230) 00010000:00010000:0.0:1783965209.707552:0:14187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fe136eca/0xe782b916994fe761 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.707561:0:14187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fe136eca/0xe782b916994fe761 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.707591:0:14187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fe136eca/0xe782b916994fe761 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.707600:0:14187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fe136eca/0xe782b916994fe761 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.707626:0:14187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783965209.707629:0:14187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783965209.707630:0:14187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783965209.707639:0:15786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783965209.709303:0:14837:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783965209.709316:0:14837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000215dd3c6/0xe782b916994fe768 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.709331:0:14837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=443s v=(0 0) 00010000:00010000:0.0:1783965209.709336:0:14837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783965209.709343:0:14837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000215dd3c6/0xe782b916994fe768 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.709356:0:14837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000215dd3c6/0xe782b916994fe768 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.709366:0:14837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000215dd3c6/0xe782b916994fe768 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.709374:0:14837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000215dd3c6/0xe782b916994fe768 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.709401:0:14837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783965209.709418:0:14188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783965209.709423:0:14188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000215dd3c6/0xe782b916994fe768 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.709431:0:14188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947430c10200 already unused, calling callback (ffffffffc168d230) 00010000:00010000:0.0:1783965209.709435:0:14188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000215dd3c6/0xe782b916994fe768 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.709444:0:14188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000215dd3c6/0xe782b916994fe768 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.709459:0:14188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000215dd3c6/0xe782b916994fe768 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.709467:0:14188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000215dd3c6/0xe782b916994fe768 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.709487:0:14188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783965209.709489:0:14188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783965209.709491:0:14188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783965209.710125:0:14837:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783965209.710133:0:14837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009e8f4674/0xe782b916994fe76f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.710144:0:14837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=443s v=(0 0) 00010000:00010000:0.0:1783965209.710154:0:14837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783965209.710160:0:14837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009e8f4674/0xe782b916994fe76f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.710171:0:14837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009e8f4674/0xe782b916994fe76f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.710179:0:14837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009e8f4674/0xe782b916994fe76f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.710189:0:14837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009e8f4674/0xe782b916994fe76f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.710230:0:14837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783965209.710639:0:14837:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783965209.710645:0:14837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005867c7ea/0xe782b916994fe776 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.710655:0:14837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=443s v=(0 0) 00010000:00010000:0.0:1783965209.710660:0:14837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783965209.710664:0:14837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005867c7ea/0xe782b916994fe776 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.710675:0:14837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005867c7ea/0xe782b916994fe776 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.710684:0:14837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005867c7ea/0xe782b916994fe776 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.710698:0:14837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005867c7ea/0xe782b916994fe776 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.710723:0:14837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1783965209.711237:0:14837:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783965209.711243:0:14837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e49d806/0xe782b916994fe77d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.711252:0:14837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=443s v=(0 0) 00010000:00010000:0.0:1783965209.711256:0:14837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783965209.711260:0:14837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001e49d806/0xe782b916994fe77d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.711269:0:14837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001e49d806/0xe782b916994fe77d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.711278:0:14837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001e49d806/0xe782b916994fe77d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.711285:0:14837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001e49d806/0xe782b916994fe77d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.711298:0:14837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:0.0:1783965209.711308:0:14188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1783965209.711313:0:14188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009e8f4674/0xe782b916994fe76f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.711327:0:14188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947430c11600 already unused, calling callback (ffffffffc168d230) 00010000:00010000:0.0:1783965209.711332:0:14188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009e8f4674/0xe782b916994fe76f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.711340:0:14188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009e8f4674/0xe782b916994fe76f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.711354:0:14188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009e8f4674/0xe782b916994fe76f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.711363:0:14188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009e8f4674/0xe782b916994fe76f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.711383:0:14188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1783965209.711386:0:14188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005867c7ea/0xe782b916994fe776 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.711393:0:14188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947430c11200 already unused, calling callback (ffffffffc168d230) 00010000:00010000:2.0:1783965209.711394:0:14187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783965209.711397:0:14188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005867c7ea/0xe782b916994fe776 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965209.711402:0:14187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001e49d806/0xe782b916994fe77d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.711407:0:14188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005867c7ea/0xe782b916994fe776 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965209.711420:0:14187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947430c10e00 already unused, calling callback (ffffffffc168d230) 00010000:00010000:0.0:1783965209.711426:0:14188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005867c7ea/0xe782b916994fe776 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965209.711427:0:14187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001e49d806/0xe782b916994fe77d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965209.711442:0:14187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001e49d806/0xe782b916994fe77d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.711447:0:14188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005867c7ea/0xe782b916994fe776 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965209.711461:0:14187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001e49d806/0xe782b916994fe77d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.711464:0:14188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783965209.711468:0:14188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783965209.711470:0:14188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783965209.711473:0:14187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001e49d806/0xe782b916994fe77d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.711480:0:15786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783965209.711493:0:14187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783965209.711497:0:14187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783965209.711499:0:14187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783965209.711976:0:14837:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783965209.711984:0:14837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000006da8dfc/0xe782b916994fe784 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.711993:0:14837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=443s v=(0 0) 00010000:00010000:0.0:1783965209.711997:0:14837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783965209.712003:0:14837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000006da8dfc/0xe782b916994fe784 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.712012:0:14837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000006da8dfc/0xe782b916994fe784 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.712021:0:14837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000006da8dfc/0xe782b916994fe784 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.712027:0:14837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000006da8dfc/0xe782b916994fe784 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.712043:0:14837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783965209.712059:0:14188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783965209.712063:0:14188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000006da8dfc/0xe782b916994fe784 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.712070:0:14188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947430c11000 already unused, calling callback (ffffffffc168d230) 00010000:00010000:0.0:1783965209.712074:0:14188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000006da8dfc/0xe782b916994fe784 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.712081:0:14188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000006da8dfc/0xe782b916994fe784 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.712095:0:14188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000006da8dfc/0xe782b916994fe784 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.712102:0:14188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000006da8dfc/0xe782b916994fe784 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.712120:0:14188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783965209.712123:0:14188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783965209.712125:0:14188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783965209.713568:0:14837:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783965209.713579:0:14837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000078b6546b/0xe782b916994fe78b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.713594:0:14837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=443s v=(0 0) 00010000:00010000:0.0:1783965209.713986:0:14837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783965209.713996:0:14837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000078b6546b/0xe782b916994fe78b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.714024:0:14837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000078b6546b/0xe782b916994fe78b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.714035:0:14837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000078b6546b/0xe782b916994fe78b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.714044:0:14837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000078b6546b/0xe782b916994fe78b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.714066:0:14837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783965209.714085:0:15786:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783965209.714090:0:15786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000078b6546b/0xe782b916994fe78b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.714099:0:15786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947430c10a00 already unused, calling callback (ffffffffc168d230) 00010000:00010000:0.0:1783965209.714104:0:15786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000078b6546b/0xe782b916994fe78b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.714114:0:15786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000078b6546b/0xe782b916994fe78b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.714130:0:15786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000078b6546b/0xe782b916994fe78b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.714139:0:15786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000078b6546b/0xe782b916994fe78b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.714165:0:15786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783965209.714167:0:15786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783965209.714169:0:15786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783965209.715530:0:14837:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783965209.715542:0:14837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000040f2f922/0xe782b916994fe792 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.715566:0:14837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=443s v=(0 0) 00010000:00010000:0.0:1783965209.715571:0:14837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783965209.715578:0:14837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000040f2f922/0xe782b916994fe792 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.715590:0:14837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000040f2f922/0xe782b916994fe792 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.715599:0:14837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000040f2f922/0xe782b916994fe792 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.715606:0:14837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000040f2f922/0xe782b916994fe792 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.715625:0:14837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783965209.715637:0:14187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783965209.715642:0:14187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000040f2f922/0xe782b916994fe792 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.715676:0:14187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947430c11400 already unused, calling callback (ffffffffc168d230) 00010000:00010000:0.0:1783965209.715682:0:14187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000040f2f922/0xe782b916994fe792 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.715690:0:14187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000040f2f922/0xe782b916994fe792 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.715712:0:14187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000040f2f922/0xe782b916994fe792 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.715720:0:14187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000040f2f922/0xe782b916994fe792 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.715741:0:14187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783965209.715743:0:14187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783965209.715745:0:14187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783965209.716279:0:14837:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783965209.716287:0:14837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c6e845fd/0xe782b916994fe799 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.716297:0:14837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=443s v=(0 0) 00010000:00010000:0.0:1783965209.716301:0:14837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783965209.716305:0:14837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c6e845fd/0xe782b916994fe799 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.716316:0:14837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c6e845fd/0xe782b916994fe799 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.716333:0:14837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c6e845fd/0xe782b916994fe799 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.716340:0:14837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c6e845fd/0xe782b916994fe799 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.716355:0:14837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783965209.716365:0:14188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783965209.716370:0:14188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c6e845fd/0xe782b916994fe799 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.716377:0:14188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947305c21000 already unused, calling callback (ffffffffc168d230) 00010000:00010000:0.0:1783965209.716381:0:14188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c6e845fd/0xe782b916994fe799 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.716389:0:14188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c6e845fd/0xe782b916994fe799 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.716402:0:14188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c6e845fd/0xe782b916994fe799 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.716409:0:14188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c6e845fd/0xe782b916994fe799 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.716427:0:14188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783965209.716435:0:14188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783965209.716437:0:14188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1783965209.717529:0:5835:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00010000:0.0:1783965209.717870:0:14837:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783965209.717878:0:14837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000074d1869c/0xe782b916994fe7a0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.717892:0:14837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=443s v=(0 0) 00010000:00010000:0.0:1783965209.717897:0:14837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783965209.717902:0:14837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000074d1869c/0xe782b916994fe7a0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.717915:0:14837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000074d1869c/0xe782b916994fe7a0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.717924:0:14837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000074d1869c/0xe782b916994fe7a0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.717931:0:14837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000074d1869c/0xe782b916994fe7a0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.717947:0:14837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783965209.717960:0:15786:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783965209.717965:0:15786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000074d1869c/0xe782b916994fe7a0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.717972:0:15786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947305c20800 already unused, calling callback (ffffffffc168d230) 00010000:00010000:0.0:1783965209.717975:0:15786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000074d1869c/0xe782b916994fe7a0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.717994:0:15786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000074d1869c/0xe782b916994fe7a0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.718007:0:15786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000074d1869c/0xe782b916994fe7a0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.718015:0:15786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000074d1869c/0xe782b916994fe7a0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.718031:0:15786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783965209.718033:0:15786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783965209.718034:0:15786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783965209.718840:0:14837:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783965209.718848:0:14837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000051062d1e/0xe782b916994fe7a7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.718857:0:14837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=443s v=(0 0) 00010000:00010000:0.0:1783965209.718861:0:14837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783965209.718865:0:14837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000051062d1e/0xe782b916994fe7a7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.718876:0:14837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000051062d1e/0xe782b916994fe7a7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.718884:0:14837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000051062d1e/0xe782b916994fe7a7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.718901:0:14837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000051062d1e/0xe782b916994fe7a7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.718930:0:14837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1783965209.719358:0:14837:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783965209.719364:0:14837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d8aa4c2c/0xe782b916994fe7ae lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965209.719368:0:14187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783965209.719376:0:14837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=443s v=(0 0) 00010000:00010000:1.0:1783965209.719377:0:14187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000051062d1e/0xe782b916994fe7a7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.719381:0:14837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783965209.719389:0:14837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d8aa4c2c/0xe782b916994fe7ae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965209.719394:0:14187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947305c20400 already unused, calling callback (ffffffffc168d230) 00010000:00010000:1.0:1783965209.719401:0:14187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000051062d1e/0xe782b916994fe7a7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.719404:0:14837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d8aa4c2c/0xe782b916994fe7ae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965209.719417:0:14187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000051062d1e/0xe782b916994fe7a7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.719419:0:14837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d8aa4c2c/0xe782b916994fe7ae lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965209.719446:0:14187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000051062d1e/0xe782b916994fe7a7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.719451:0:14837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d8aa4c2c/0xe782b916994fe7ae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965209.719458:0:14187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000051062d1e/0xe782b916994fe7a7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.719473:0:14837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783965209.719477:0:14187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783965209.719482:0:14187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d8aa4c2c/0xe782b916994fe7ae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.719484:0:14188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783965209.719491:0:14187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947305c21800 already unused, calling callback (ffffffffc168d230) 00010000:00010000:1.0:1783965209.719495:0:14187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d8aa4c2c/0xe782b916994fe7ae lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965209.719503:0:14187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d8aa4c2c/0xe782b916994fe7ae lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965209.719525:0:14187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d8aa4c2c/0xe782b916994fe7ae lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965209.719533:0:14187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d8aa4c2c/0xe782b916994fe7ae lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965209.719552:0:14187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783965209.719554:0:14187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783965209.719556:0:14187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783965209.721032:0:14837:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783965209.721049:0:14837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000055351c4b/0xe782b916994fe7b5 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.721063:0:14837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=443s v=(0 0) 00010000:00010000:0.0:1783965209.721068:0:14837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783965209.721074:0:14837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000055351c4b/0xe782b916994fe7b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.721088:0:14837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000055351c4b/0xe782b916994fe7b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.721098:0:14837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000055351c4b/0xe782b916994fe7b5 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.721107:0:14837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000055351c4b/0xe782b916994fe7b5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.721136:0:14837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783965209.721242:0:15786:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783965209.721250:0:15786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000055351c4b/0xe782b916994fe7b5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965209.721259:0:15786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947305c21a00 already unused, calling callback (ffffffffc168d230) 00010000:00010000:1.0:1783965209.721264:0:15786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000055351c4b/0xe782b916994fe7b5 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965209.721272:0:15786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000055351c4b/0xe782b916994fe7b5 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965209.721288:0:15786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000055351c4b/0xe782b916994fe7b5 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965209.721295:0:15786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000055351c4b/0xe782b916994fe7b5 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965209.721323:0:15786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783965209.721324:0:15786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783965209.721326:0:15786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783965209.721925:0:14837:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783965209.721932:0:14837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f141ec21/0xe782b916994fe7bc lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.721942:0:14837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=443s v=(0 0) 00010000:00010000:0.0:1783965209.721946:0:14837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783965209.721950:0:14837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f141ec21/0xe782b916994fe7bc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.721959:0:14837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f141ec21/0xe782b916994fe7bc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.721974:0:14837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f141ec21/0xe782b916994fe7bc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.721981:0:14837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f141ec21/0xe782b916994fe7bc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.722005:0:14837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783965209.722125:0:14188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783965209.722132:0:14188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f141ec21/0xe782b916994fe7bc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965209.722141:0:14188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947305c20c00 already unused, calling callback (ffffffffc168d230) 00010000:00010000:1.0:1783965209.722145:0:14188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f141ec21/0xe782b916994fe7bc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965209.722154:0:14188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f141ec21/0xe782b916994fe7bc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965209.722167:0:14188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f141ec21/0xe782b916994fe7bc lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965209.722175:0:14188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f141ec21/0xe782b916994fe7bc lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965209.722227:0:14188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783965209.722229:0:14188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783965209.722230:0:14188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783965209.722934:0:14837:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783965209.722942:0:14837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e889b746/0xe782b916994fe7c3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.722953:0:14837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=443s v=(0 0) 00010000:00010000:0.0:1783965209.722957:0:14837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783965209.722962:0:14837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e889b746/0xe782b916994fe7c3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.722973:0:14837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e889b746/0xe782b916994fe7c3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.722982:0:14837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e889b746/0xe782b916994fe7c3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.722989:0:14837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e889b746/0xe782b916994fe7c3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.723018:0:14837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783965209.723029:0:14187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783965209.723034:0:14187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e889b746/0xe782b916994fe7c3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.723042:0:14187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947305c21600 already unused, calling callback (ffffffffc168d230) 00010000:00010000:0.0:1783965209.723046:0:14187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e889b746/0xe782b916994fe7c3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.723053:0:14187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e889b746/0xe782b916994fe7c3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.723066:0:14187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e889b746/0xe782b916994fe7c3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.723074:0:14187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e889b746/0xe782b916994fe7c3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.723092:0:14187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783965209.723094:0:14187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783965209.723096:0:14187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783965209.723987:0:14837:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783965209.723996:0:14837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000191979f7/0xe782b916994fe7ca lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.724009:0:14837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=443s v=(0 0) 00010000:00010000:0.0:1783965209.724020:0:14837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783965209.724026:0:14837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000191979f7/0xe782b916994fe7ca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.724039:0:14837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000191979f7/0xe782b916994fe7ca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.724049:0:14837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000191979f7/0xe782b916994fe7ca lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.724057:0:14837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000191979f7/0xe782b916994fe7ca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.724075:0:14837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1783965209.724088:0:15786:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1783965209.724093:0:15786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000191979f7/0xe782b916994fe7ca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.724101:0:15786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947305c20200 already unused, calling callback (ffffffffc168d230) 00010000:00010000:0.0:1783965209.724105:0:15786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000191979f7/0xe782b916994fe7ca lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.724114:0:15786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000191979f7/0xe782b916994fe7ca lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.724127:0:15786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000191979f7/0xe782b916994fe7ca lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.724146:0:15786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000191979f7/0xe782b916994fe7ca lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.724163:0:15786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783965209.724165:0:15786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783965209.724167:0:15786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1783965209.725024:0:14837:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1783965209.725033:0:14837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007de86747/0xe782b916994fe7d1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.725046:0:14837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=443s v=(0 0) 00010000:00010000:0.0:1783965209.725051:0:14837:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783965209.725056:0:14837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007de86747/0xe782b916994fe7d1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.725069:0:14837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007de86747/0xe782b916994fe7d1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.725078:0:14837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007de86747/0xe782b916994fe7d1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.725087:0:14837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007de86747/0xe782b916994fe7d1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965209.725106:0:14837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1783965209.725248:0:14188:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1783965209.725256:0:14188:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007de86747/0xe782b916994fe7d1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965209.725279:0:14188:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947305c20600 already unused, calling callback (ffffffffc168d230) 00010000:00010000:1.0:1783965209.725284:0:14188:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007de86747/0xe782b916994fe7d1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965209.725294:0:14188:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007de86747/0xe782b916994fe7d1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965209.725309:0:14188:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007de86747/0xe782b916994fe7d1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965209.725318:0:14188:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007de86747/0xe782b916994fe7d1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965209.725333:0:14188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783965209.725335:0:14188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783965209.725337:0:14188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1783965209.725895:0:14837:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:6 00000100:00100000:0.0:1783965209.726006:0:14837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e29ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14224:x1870622732944384:12345-0@lo:5:osp-pre-1-0.0 Request processed in 65522us (66235us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965209.726019:0:14837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1783965209.726096:0:14224:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e29a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14224:1870622732944384:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1783965209.726113:0:14224:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x6:0x0] 00000100:00100000:1.0:1783965209.726166:0:14224:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e29a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14224:1870622732944512:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1783965209.726351:0:14224:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783965209.726449:0:14224:0:(client.c:2702:ptlrpc_set_wait()) set ffff947409525000 going to sleep for 11 seconds 00000100:00100000:3.0:1783965209.726452:0:14835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732944512 00000100:00100000:3.0:1783965209.726460:0:14835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732944512 00000100:00100000:3.0:1783965209.726517:0:14835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1783965209.726527:0:14835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e29bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14224:x1870622732944512:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1783965209.726568:0:14835:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:0.0:1783965209.737452:0:14224:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e29a300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14224:1870622732944512:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1783965209.737463:0:14835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e29bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:14224:x1870622732944512:12345-0@lo:5:osp-pre-1-0.0 Request processed in 10773us (10947us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1783965209.737475:0:14835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000004:00080000:0.0:1783965209.737485:0:14224:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00010000:00010000:3.0:1783965210.157751:0:14187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1783965210.297605:0:7523:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1783965210.297623:0:7523:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:02000400:2.0:1783965211.175644:0:15862:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg412-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1783965211.179488:0:15786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1783965212.203400:0:14188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783965212.719458:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743fb9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3323:1870622732944640:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783965212.719527:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783965212.719735:0:14838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732944640 00000100:00100000:2.0:1783965212.719744:0:14838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732944640 00000100:00100000:2.0:1783965212.719847:0:14838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783965212.719857:0:14838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743706df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3323:x1870622732944640:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783965212.719894:0:14838:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783965212.719943:0:14838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743706df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3323:x1870622732944640:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (414us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965212.719951:0:14838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1783965212.720069:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743fb9d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3323:1870622732944640:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1783965212.720345:0:14195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1783965213.227430:0:14187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783965213.560291:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965213.560511:0:14193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715126144 00000100:00100000:3.0:1783965213.560523:0:14193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715126144 00000100:00100000:3.0:1783965213.560600:0:14193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 74 00000100:00100000:3.0:1783965213.560608:0:14193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947408aca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2356:x1870622715126144:12345-192.168.204.12@tcp:250:mount.lustre.0 00010000:00080000:3.0:1783965213.560653:0:14193:0:(ldlm_lib.c:1445:target_handle_connect()) MGS: connection from 8204b8a1-ddc8-44a4-855e-f8a2831c2700@192.168.204.12@tcp t0 exp 0000000000000000 cur 447 last 0 00000020:00000080:3.0:1783965213.560686:0:14193:0:(genops.c:1406:class_connect()) connect: client 8204b8a1-ddc8-44a4-855e-f8a2831c2700, cookie 0xe782b916994fe7d8 00000100:00080000:3.0:1783965213.560849:0:14193:0:(import.c:65:import_set_state_nolock()) ffff94730669b800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1783965213.560971:0:14193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947408aca850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8204b8a1-ddc8-44a4-855e-f8a2831c2700+5:2356:x1870622715126144:12345-192.168.204.12@tcp:250:mount.lustre.0 Request processed in 361us (689us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965213.560981:0:14193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 74 00000100:00100000:0.0:1783965213.572468:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965213.572573:0:14192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715126272 00000100:00100000:1.0:1783965213.572583:0:14192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715126272 00000100:00100000:1.0:1783965213.572650:0:14192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 75 00000100:00100000:1.0:1783965213.572659:0:14192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947408ac8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8204b8a1-ddc8-44a4-855e-f8a2831c2700+5:13693:x1870622715126272:12345-192.168.204.12@tcp:101:mount.lustre.0 00010000:00010000:1.0:1783965213.572674:0:14192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783965213.572691:0:14192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94743d9ef800/0xe782b916994fe7df lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5f0306 expref: -99 pid: 14192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965213.572720:0:14192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94743d9ef800/0xe782b916994fe7df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0306 expref: 6 pid: 14192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965213.572732:0:14192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94743d9ef800/0xe782b916994fe7df lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0306 expref: 6 pid: 14192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965213.572741:0:14192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94743d9ef800, rc 0) 00000100:00100000:1.0:1783965213.572805:0:14192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947408ac8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8204b8a1-ddc8-44a4-855e-f8a2831c2700+6:13693:x1870622715126272:12345-192.168.204.12@tcp:101:mount.lustre.0 Request processed in 146us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965213.572811:0:14192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 75 00000100:00100000:0.0:1783965213.585152:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965213.585243:0:14193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715126400 00000100:00100000:3.0:1783965213.585255:0:14193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715126400 00000100:00100000:3.0:1783965213.585318:0:14193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 76 00000100:00100000:3.0:1783965213.585329:0:14193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947408ac9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8204b8a1-ddc8-44a4-855e-f8a2831c2700+6:13693:x1870622715126400:12345-192.168.204.12@tcp:501:mount.lustre.0 00000100:00100000:3.0:1783965213.587096:0:14193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947408ac9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8204b8a1-ddc8-44a4-855e-f8a2831c2700+6:13693:x1870622715126400:12345-192.168.204.12@tcp:501:mount.lustre.0 Request processed in 1757us (1941us total) trans 0 rc -2/-2 00000100:00100000:3.0:1783965213.587113:0:14193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 76 00000100:00100000:0.0:1783965213.592949:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965213.593076:0:14194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715126528 00000100:00100000:2.0:1783965213.593087:0:14194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715126528 00000100:00100000:2.0:1783965213.593147:0:14194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 77 00000100:00100000:2.0:1783965213.593159:0:14194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947408acb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8204b8a1-ddc8-44a4-855e-f8a2831c2700+6:13693:x1870622715126528:12345-192.168.204.12@tcp:101:mount.lustre.0 00010000:00010000:2.0:1783965213.593176:0:14194:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783965213.593195:0:14194:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff947425974e00/0xe782b916994fe7e6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5f030d expref: -99 pid: 14194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965213.593462:0:14194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff947425974e00/0xe782b916994fe7e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f030d expref: 7 pid: 14194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965213.593476:0:14194:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff947425974e00/0xe782b916994fe7e6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f030d expref: 7 pid: 14194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965213.593487:0:14194:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff947425974e00, rc 0) 00000100:00100000:2.0:1783965213.593559:0:14194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947408acb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8204b8a1-ddc8-44a4-855e-f8a2831c2700+7:13693:x1870622715126528:12345-192.168.204.12@tcp:101:mount.lustre.0 Request processed in 401us (620us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965213.593566:0:14194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 77 00000100:00100000:1.0:1783965213.596391:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965213.596848:0:14193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715126656 00000100:00100000:3.0:1783965213.596859:0:14193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715126656 00000100:00100000:3.0:1783965213.596921:0:14193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 78 00000100:00100000:3.0:1783965213.596930:0:14193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947408ac8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8204b8a1-ddc8-44a4-855e-f8a2831c2700+7:13693:x1870622715126656:12345-192.168.204.12@tcp:501:mount.lustre.0 00000100:00100000:3.0:1783965213.597284:0:14193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947408ac8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8204b8a1-ddc8-44a4-855e-f8a2831c2700+8:13693:x1870622715126656:12345-192.168.204.12@tcp:501:mount.lustre.0 Request processed in 353us (901us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965213.597294:0:14193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 78 00000100:00100000:0.0:1783965213.601135:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965213.601606:0:14192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715126784 00000100:00100000:1.0:1783965213.601621:0:14192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715126784 00000100:00100000:1.0:1783965213.601711:0:14192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 79 00000100:00100000:1.0:1783965213.601726:0:14192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947408acb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8204b8a1-ddc8-44a4-855e-f8a2831c2700+8:13693:x1870622715126784:12345-192.168.204.12@tcp:503:mount.lustre.0 00000100:00100000:1.0:1783965213.602732:0:14192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947408acb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8204b8a1-ddc8-44a4-855e-f8a2831c2700+8:13693:x1870622715126784:12345-192.168.204.12@tcp:503:mount.lustre.0 Request processed in 1002us (1604us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965213.602745:0:14192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 79 00000100:00100000:0.0:1783965213.609215:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965213.609452:0:14194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715126912 00000100:00100000:3.0:1783965213.609490:0:14194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715126912 00000100:00100000:3.0:1783965213.609569:0:14194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 80 00000100:00100000:3.0:1783965213.609581:0:14194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947408acbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8204b8a1-ddc8-44a4-855e-f8a2831c2700+8:13712:x1870622715126912:12345-192.168.204.12@tcp:502:llog_process_th.0 00000100:00100000:3.0:1783965213.610287:0:14194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947408acbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8204b8a1-ddc8-44a4-855e-f8a2831c2700+8:13712:x1870622715126912:12345-192.168.204.12@tcp:502:llog_process_th.0 Request processed in 703us (1091us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965213.610299:0:14194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 80 00000100:00100000:0.0:1783965213.653314:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965213.653657:0:14192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715127040 00000100:00100000:1.0:1783965213.653690:0:14192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715127040 00000100:00100000:1.0:1783965213.653764:0:14192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 81 00000100:00100000:1.0:1783965213.653777:0:14192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947408ac9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8204b8a1-ddc8-44a4-855e-f8a2831c2700+8:13712:x1870622715127040:12345-192.168.204.12@tcp:502:llog_process_th.0 00000100:00100000:1.0:1783965213.654725:0:14192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947408ac9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8204b8a1-ddc8-44a4-855e-f8a2831c2700+8:13712:x1870622715127040:12345-192.168.204.12@tcp:502:llog_process_th.0 Request processed in 938us (1415us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965213.654739:0:14192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 81 00000100:00100000:0.0:1783965213.674920:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965213.675320:0:14194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715127168 00000100:00100000:3.0:1783965213.675334:0:14194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715127168 00000100:00100000:3.0:1783965213.675420:0:14194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 82 00000100:00100000:3.0:1783965213.675434:0:14194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947408ac8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8204b8a1-ddc8-44a4-855e-f8a2831c2700+8:13693:x1870622715127168:12345-192.168.204.12@tcp:101:mount.lustre.0 00010000:00010000:3.0:1783965213.675458:0:14194:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783965213.675483:0:14194:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94743fb8fe00/0xe782b916994fe7ed lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5f0337 expref: -99 pid: 14194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965213.675522:0:14194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94743fb8fe00/0xe782b916994fe7ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0337 expref: 9 pid: 14194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965213.675535:0:14194:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94743fb8fe00/0xe782b916994fe7ed lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0337 expref: 9 pid: 14194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965213.675545:0:14194:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94743fb8fe00, rc 0) 00000100:00100000:3.0:1783965213.675642:0:14194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947408ac8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8204b8a1-ddc8-44a4-855e-f8a2831c2700+9:13693:x1870622715127168:12345-192.168.204.12@tcp:101:mount.lustre.0 Request processed in 211us (736us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965213.675651:0:14194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 82 00000100:00100000:3.0:1783965213.683515:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965213.685390:0:14192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715127296 00000100:00100000:1.0:1783965213.685512:0:14192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715127296 00000100:00100000:1.0:1783965213.685617:0:14192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 83 00000100:00100000:1.0:1783965213.685640:0:14192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947408ac8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8204b8a1-ddc8-44a4-855e-f8a2831c2700+9:13693:x1870622715127296:12345-192.168.204.12@tcp:256:mount.lustre.0 20000000:01000000:1.0:1783965213.685681:0:14192:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1783965213.685716:0:14192:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1783965213.685722:0:14192:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1783965213.685725:0:14192:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1783965213.685728:0:14192:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:2.0:1783965213.688607:0:14192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947408ac8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8204b8a1-ddc8-44a4-855e-f8a2831c2700+9:13693:x1870622715127296:12345-192.168.204.12@tcp:256:mount.lustre.0 Request processed in 2953us (5089us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965213.688635:0:14192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 83 00000100:00100000:3.0:1783965213.692117:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783965213.692695:0:14193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715127424 00000100:00100000:0.0:1783965213.692709:0:14193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715127424 00000100:00100000:0.0:1783965213.692820:0:14193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 84 00000100:00100000:0.0:1783965213.692833:0:14193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947408acac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8204b8a1-ddc8-44a4-855e-f8a2831c2700+9:13693:x1870622715127424:12345-192.168.204.12@tcp:101:mount.lustre.0 00010000:00010000:0.0:1783965213.692855:0:14193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783965213.692944:0:14193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff947305c21200/0xe782b916994fe7f4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5f033e expref: -99 pid: 14193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965213.692985:0:14193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff947305c21200/0xe782b916994fe7f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f033e expref: 10 pid: 14193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965213.693000:0:14193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff947305c21200/0xe782b916994fe7f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f033e expref: 10 pid: 14193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965213.693030:0:14193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff947305c21200, rc 0) 00000100:00100000:0.0:1783965213.693125:0:14193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947408acac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8204b8a1-ddc8-44a4-855e-f8a2831c2700+10:13693:x1870622715127424:12345-192.168.204.12@tcp:101:mount.lustre.0 Request processed in 294us (1024us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965213.693133:0:14193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 84 00000100:00100000:2.0:1783965213.696105:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965213.696697:0:14192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715127552 00000100:00100000:1.0:1783965213.696710:0:14192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715127552 00000100:00100000:1.0:1783965213.696811:0:14192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 85 00000100:00100000:1.0:1783965213.696822:0:14192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e437050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8204b8a1-ddc8-44a4-855e-f8a2831c2700+10:13693:x1870622715127552:12345-192.168.204.12@tcp:501:mount.lustre.0 00000100:00100000:1.0:1783965213.697544:0:14192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e437050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8204b8a1-ddc8-44a4-855e-f8a2831c2700+10:13693:x1870622715127552:12345-192.168.204.12@tcp:501:mount.lustre.0 Request processed in 722us (1500us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965213.697554:0:14192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 85 00000100:00100000:1.0:1783965213.699959:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783965213.700098:0:14193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715127680 00000100:00100000:0.0:1783965213.700108:0:14193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715127680 00000100:00100000:0.0:1783965213.700189:0:14193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 86 00000100:00100000:0.0:1783965213.700232:0:14193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e436450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8204b8a1-ddc8-44a4-855e-f8a2831c2700+10:13693:x1870622715127680:12345-192.168.204.12@tcp:503:mount.lustre.0 00000100:00100000:0.0:1783965213.701155:0:14193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e436450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8204b8a1-ddc8-44a4-855e-f8a2831c2700+10:13693:x1870622715127680:12345-192.168.204.12@tcp:503:mount.lustre.0 Request processed in 946us (1202us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965213.701167:0:14193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 86 00000100:00100000:0.0:1783965213.704564:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965213.705400:0:14192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715127808 00000100:00100000:1.0:1783965213.705416:0:14192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715127808 00000100:00100000:1.0:1783965213.705535:0:14192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 87 00000100:00100000:1.0:1783965213.705548:0:14192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e436850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8204b8a1-ddc8-44a4-855e-f8a2831c2700+10:13719:x1870622715127808:12345-192.168.204.12@tcp:502:llog_process_th.0 00000100:00100000:1.0:1783965213.705950:0:14192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e436850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8204b8a1-ddc8-44a4-855e-f8a2831c2700+10:13719:x1870622715127808:12345-192.168.204.12@tcp:502:llog_process_th.0 Request processed in 403us (1400us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965213.705960:0:14192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 87 00000100:00100000:2.0:1783965213.716492:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783965213.716619:0:14193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715127936 00000100:00100000:0.0:1783965213.716642:0:14193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715127936 00000100:00100000:0.0:1783965213.716720:0:14193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 88 00000100:00100000:0.0:1783965213.716733:0:14193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e435050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8204b8a1-ddc8-44a4-855e-f8a2831c2700+10:13719:x1870622715127936:12345-192.168.204.12@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783965213.717095:0:14193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e435050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8204b8a1-ddc8-44a4-855e-f8a2831c2700+10:13719:x1870622715127936:12345-192.168.204.12@tcp:502:llog_process_th.0 Request processed in 364us (617us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965213.717105:0:14193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 88 00000100:00100000:0.0:1783965213.727943:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965213.728776:0:14201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715128064 00000100:00100000:2.0:1783965213.728793:0:14201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715128064 00000100:00100000:2.0:1783965213.728870:0:14201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 4 00000100:00100000:2.0:1783965213.728880:0:14201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743fb9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2356:x1870622715128064:12345-192.168.204.12@tcp:38:mount.lustre.0 00010000:00080000:2.0:1783965213.728924:0:14201:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from b2c21b91-f3be-4bc4-8944-f5766379921b@192.168.204.12@tcp t0 exp 0000000000000000 cur 447 last 0 00000020:00000080:2.0:1783965213.728990:0:14201:0:(genops.c:1406:class_connect()) connect: client b2c21b91-f3be-4bc4-8944-f5766379921b, cookie 0xe782b916994fe7fb 00000004:00100000:2.0:1783965213.729045:0:14201:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:2.0:1783965213.729053:0:14201:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:2.0:1783965213.830930:0:14201:0:(import.c:65:import_set_state_nolock()) ffff947304b9b000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783965213.831100:0:14201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743fb9df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2c21b91-f3be-4bc4-8944-f5766379921b+6:2356:x1870622715128064:12345-192.168.204.12@tcp:38:mount.lustre.0 Request processed in 102217us (103168us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965213.831120:0:14201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 4 00000100:00100000:1.0:1783965213.841029:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965213.841456:0:14199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715128192 00000100:00100000:3.0:1783965213.841488:0:14199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715128192 00000100:00080000:1.0:1783965213.841662:0:14195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783965213.841733:0:14200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 5 00000100:00100000:2.0:1783965213.841748:0:14200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e29b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2c21b91-f3be-4bc4-8944-f5766379921b+6:0:x1870622715128192:12345-192.168.204.12@tcp:41:mount.lustre.0 00000004:00000024:2.0:1783965213.841818:0:14200:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1783965213.841956:0:14200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e29b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2c21b91-f3be-4bc4-8944-f5766379921b+6:0:x1870622715128192:12345-192.168.204.12@tcp:41:mount.lustre.0 Request processed in 212us (941us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965213.841966:0:14200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 5 00000100:00100000:3.0:1783965213.844716:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965213.844938:0:14201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715128320 00000100:00100000:2.0:1783965213.844953:0:14201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715128320 00000100:00100000:2.0:1783965213.845032:0:14201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 6 00000100:00100000:2.0:1783965213.845067:0:14201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9474368d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2c21b91-f3be-4bc4-8944-f5766379921b+6:13693:x1870622715128320:12345-192.168.204.12@tcp:41:mount.lustre.0 00000004:00000024:2.0:1783965213.845120:0:14201:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1783965213.845447:0:14201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9474368d7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2c21b91-f3be-4bc4-8944-f5766379921b+6:13693:x1870622715128320:12345-192.168.204.12@tcp:41:mount.lustre.0 Request processed in 383us (872us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965213.845457:0:14201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 6 00000100:00100000:0.0:1783965213.853813:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965213.853935:0:14200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715128448 00000100:00100000:2.0:1783965213.853950:0:14200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715128448 00000100:00100000:2.0:1783965213.854024:0:14200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 7 00000100:00100000:2.0:1783965213.854035:0:14200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743fb9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2c21b91-f3be-4bc4-8944-f5766379921b+6:13693:x1870622715128448:12345-192.168.204.12@tcp:40:mount.lustre.0 00000100:00100000:2.0:1783965213.854159:0:14200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743fb9ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2c21b91-f3be-4bc4-8944-f5766379921b+6:13693:x1870622715128448:12345-192.168.204.12@tcp:40:mount.lustre.0 Request processed in 126us (362us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965213.854168:0:14200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 7 00000100:00100000:1.0:1783965213.861452:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965213.861501:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965213.861602:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965213.861705:0:14202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715128832 00000100:00100000:3.0:1783965213.861719:0:14202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715128832 00000100:00100000:3.0:1783965213.861793:0:14202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 0 00000100:00100000:3.0:1783965213.861806:0:14202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947307dc5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b2c21b91-f3be-4bc4-8944-f5766379921b+6:13693:x1870622715128832:12345-192.168.204.12@tcp:33:mount.lustre.0 00000004:00080000:3.0:1783965213.863960:0:14202:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 1452us 00000100:00100000:2.0:1783965213.865149:0:14834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715128576 00000100:00100000:2.0:1783965213.865168:0:14834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715128576 00000100:00100000:2.0:1783965213.865285:0:14834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715128704 00000100:00100000:2.0:1783965213.865290:0:14834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715128704 00000100:00100000:2.0:1783965213.865315:0:14834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 8 00000100:00100000:2.0:1783965213.865331:0:14834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e299f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2356:x1870622715128576:12345-192.168.204.12@tcp:8:mount.lustre.0 00010000:00080000:2.0:1783965213.866342:0:14834:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from b2c21b91-f3be-4bc4-8944-f5766379921b@192.168.204.12@tcp t0 exp 0000000000000000 cur 448 last 0 00000020:00000080:2.0:1783965213.866393:0:14834:0:(genops.c:1406:class_connect()) connect: client b2c21b91-f3be-4bc4-8944-f5766379921b, cookie 0xe782b916994fe802 00002000:00100000:2.0:1783965213.866412:0:14834:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli b2c21b91-f3be-4bc4-8944-f5766379921b/ffff947304b9a000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1783965213.866454:0:14834:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1783965213.866971:0:14834:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1783965213.867021:0:14834:0:(import.c:65:import_set_state_nolock()) ffff947304b98800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783965213.867127:0:14834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e299f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b2c21b91-f3be-4bc4-8944-f5766379921b+6:2356:x1870622715128576:12345-192.168.204.12@tcp:8:mount.lustre.0 Request processed in 1800us (5688us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965213.867146:0:14834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 8 00000100:00100000:2.0:1783965213.867184:0:14834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 9 00000100:00100000:2.0:1783965213.867191:0:14834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947307dc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2356:x1870622715128704:12345-192.168.204.12@tcp:8:mount.lustre.0 00010000:00080000:2.0:1783965213.867416:0:14834:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from b2c21b91-f3be-4bc4-8944-f5766379921b@192.168.204.12@tcp t0 exp 0000000000000000 cur 448 last 0 00000020:00000080:2.0:1783965213.867443:0:14834:0:(genops.c:1406:class_connect()) connect: client b2c21b91-f3be-4bc4-8944-f5766379921b, cookie 0xe782b916994fe809 00002000:00100000:2.0:1783965213.867452:0:14834:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli b2c21b91-f3be-4bc4-8944-f5766379921b/ffff947304b9b800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1783965213.867476:0:14834:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1783965213.867731:0:14834:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1783965213.867773:0:14834:0:(import.c:65:import_set_state_nolock()) ffff9474059b0800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783965213.867805:0:14834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947307dc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b2c21b91-f3be-4bc4-8944-f5766379921b+6:2356:x1870622715128704:12345-192.168.204.12@tcp:8:mount.lustre.0 Request processed in 613us (6303us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965213.867811:0:14834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 9 00000004:00200000:2.0:1783965213.896841:0:14202:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:2.0:1783965213.897061:0:14202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947307dc5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b2c21b91-f3be-4bc4-8944-f5766379921b+6:13693:x1870622715128832:12345-192.168.204.12@tcp:33:mount.lustre.0 Request processed in 35248us (35449us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965213.897079:0:14202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 0 00000100:00100000:1.0:1783965214.112398:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783965214.112521:0:14201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715128960 00000100:00100000:0.0:1783965214.112535:0:14201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715128960 00000100:00100000:0.0:1783965214.112631:0:14201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 8 00000100:00100000:0.0:1783965214.112645:0:14201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947307dc5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2c21b91-f3be-4bc4-8944-f5766379921b+6:13740:x1870622715128960:12345-192.168.204.12@tcp:101:mkdir.0 00010000:00010000:0.0:1783965214.112696:0:14201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783965214.112732:0:14201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947305c21600/0xe782b916994fe810 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5f0368 expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965214.112842:0:14201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff947305c20200/0xe782b916994fe817 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965214.112866:0:14201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947305c20200/0xe782b916994fe817 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965214.112890:0:14201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947305c20200/0xe782b916994fe817 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783965214.113197:0:14201:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1783965214.113246:0:14201:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:0.0:1783965214.113358:0:14201:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff947305c20200/0xe782b916994fe817 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965214.113400:0:14201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947305c21600/0xe782b916994fe810 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0368 expref: 8 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965214.113422:0:14201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff947305c20200/0xe782b916994fe817 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0368 expref: 7 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965214.113434:0:14201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff947409a45600) 00010000:00010000:0.0:1783965214.113438:0:14201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783965214.113442:0:14201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff947305c20200, rc 0) 00000100:00100000:0.0:1783965214.113548:0:14201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947307dc5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2c21b91-f3be-4bc4-8944-f5766379921b+7:13740:x1870622715128960:12345-192.168.204.12@tcp:101:mkdir.0 Request processed in 905us (1166us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965214.113559:0:14201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 8 00010000:00010000:0.0:1783965214.252081:0:15786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783965214.763636:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9474368d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:72a5858e-0958-4c77-91cf-d6507b930817:3324:1870622732944768:0@lo:400:kworker.0 00000100:00100000:2.0:1783965214.763735:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783965214.763808:0:3324:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1783965214.763815:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9474368d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3324:1870622732944896:0@lo:400:kworker.0 00000100:00100000:2.0:1783965214.763876:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783965214.763919:0:14837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732944896 00000100:00100000:2.0:1783965214.763928:0:14837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732944896 00000100:00100000:2.0:1783965214.763989:0:14837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1783965214.764006:0:14837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743706dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3324:x1870622732944896:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783965214.764061:0:14837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743706dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3324:x1870622732944896:12345-0@lo:400:kworker.0 Request processed in 57us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965214.764069:0:14837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1783965214.764092:0:14195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783965214.764125:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9474368d6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3324:1870622732944896:0@lo:400:kworker.0 00000100:00100000:2.0:1783965214.764559:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743fb9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3323:1870622732945152:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783965214.764593:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783965214.764630:0:3323:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1783965214.764635:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9474368d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3323:1870622732945024:0@lo:400:kworker.0 00000100:00100000:2.0:1783965214.764654:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783965214.764677:0:14838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732945152 00000100:00100000:2.0:1783965214.764680:0:14838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732945152 00000100:00100000:2.0:1783965214.764712:0:14838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783965214.764718:0:14838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743706d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3323:x1870622732945152:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1783965214.764737:0:14838:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783965214.764773:0:14838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743706d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3323:x1870622732945152:12345-0@lo:13:osp-pre-1-0.0 Request processed in 55us (178us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965214.764779:0:14838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1783965214.764797:0:14195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783965214.764812:0:3323:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1783965214.764837:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743fb9d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3323:1870622732945152:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783965214.766712:0:14835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732945024 00000100:00100000:1.0:1783965214.766733:0:14835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732945024 00000100:00100000:1.0:1783965214.766821:0:14835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783965214.766844:0:14835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743706d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3323:x1870622732945024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783965214.766972:0:14835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743706d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3323:x1870622732945024:12345-0@lo:400:kworker.0 Request processed in 132us (2315us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965214.766980:0:14835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1783965214.767035:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9474368d4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3323:1870622732945024:0@lo:400:kworker.0 00000100:00100000:1.0:1783965214.767073:0:14192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732944768 00000100:00100000:1.0:1783965214.767077:0:14192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732944768 00000100:00100000:1.0:1783965214.767111:0:14192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1783965214.767118:0:14192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94741cd50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72a5858e-0958-4c77-91cf-d6507b930817+19:3324:x1870622732944768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783965214.767162:0:14192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94741cd50050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72a5858e-0958-4c77-91cf-d6507b930817+19:3324:x1870622732944768:12345-0@lo:400:kworker.0 Request processed in 45us (3427us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965214.767169:0:14192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1783965214.767243:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9474368d5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:72a5858e-0958-4c77-91cf-d6507b930817:3324:1870622732944768:0@lo:400:kworker.0 00000100:00100000:1.0:1783965214.769280:0:3323:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1783965214.769308:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9474368d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3323:1870622732945536:0@lo:400:kworker.0 00000100:00100000:1.0:1783965214.769391:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783965214.769459:0:14199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732945536 00000100:00100000:1.0:1783965214.769467:0:14199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732945536 00000100:00100000:0.0:1783965214.769527:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9474368d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3324:1870622732945280:0@lo:400:kworker.0 00000100:00100000:0.0:1783965214.769563:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783965214.769585:0:3324:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1783965214.769591:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9474368d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3324:1870622732945408:0@lo:400:kworker.0 00000100:00100000:0.0:1783965214.769636:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1783965214.770134:0:14195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783965214.771869:0:14201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732945280 00000100:00100000:3.0:1783965214.771888:0:14201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732945280 00000100:00100000:2.0:1783965214.771926:0:14200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732945408 00000100:00100000:2.0:1783965214.771931:0:14200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732945408 00000100:00100000:3.0:1783965214.771952:0:14201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1783965214.771963:0:14201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947307dc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3323:x1870622732945536:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783965214.771968:0:14200:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1783965214.771978:0:14200:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1783965214.772157:0:14200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1783965214.772164:0:14200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743fb9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3324:x1870622732945280:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1783965214.772438:0:14195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783965214.772561:0:14201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947307dc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3323:x1870622732945536:12345-0@lo:400:kworker.0 Request processed in 598us (3167us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965214.772561:0:14200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743fb9ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3324:x1870622732945280:12345-0@lo:400:kworker.0 Request processed in 396us (2995us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965214.772570:0:14201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1783965214.772574:0:14200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1783965214.772596:0:14200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1783965214.772616:0:14200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743fb9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3324:x1870622732945408:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783965214.772648:0:14200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743fb9dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3324:x1870622732945408:12345-0@lo:400:kworker.0 Request processed in 46us (3012us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965214.772655:0:14200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1783965214.774400:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9474368d7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3323:1870622732945536:0@lo:400:kworker.0 00000100:00100000:0.0:1783965214.774499:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9474368d6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3324:1870622732945408:0@lo:400:kworker.0 00000100:00100000:0.0:1783965214.774517:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9474368d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3324:1870622732945280:0@lo:400:kworker.0 00010000:00010000:1.0:1783965215.275581:0:14188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1783965215.345387:0:7523:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of b2c21b91-f3be-4bc4-8944-f5766379921b 00000100:00100000:0.0:1783965216.029605:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965216.030902:0:14201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715129088 00000100:00100000:3.0:1783965216.030920:0:14201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715129088 00000100:00100000:3.0:1783965216.031099:0:14201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 9 00000100:00100000:3.0:1783965216.031111:0:14201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743fb9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2c21b91-f3be-4bc4-8944-f5766379921b+7:13793:x1870622715129088:12345-192.168.204.12@tcp:41:lfs.0 00000004:00000024:3.0:1783965216.031170:0:14201:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1783965216.031325:0:14201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743fb9f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2c21b91-f3be-4bc4-8944-f5766379921b+7:13793:x1870622715129088:12345-192.168.204.12@tcp:41:lfs.0 Request processed in 215us (1752us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965216.031334:0:14201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 9 00000100:00080000:0.0:1783965216.033171:0:14195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783965216.034745:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965216.034967:0:14838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715129216 00000100:00100000:2.0:1783965216.034980:0:14838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715129216 00000100:00100000:2.0:1783965216.035092:0:14838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 5 00000100:00100000:2.0:1783965216.035116:0:14838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9474368d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b2c21b91-f3be-4bc4-8944-f5766379921b+6:13793:x1870622715129216:12345-192.168.204.12@tcp:13:lfs.0 00002000:00000024:2.0:1783965216.035178:0:14838:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783965216.035339:0:14838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9474368d5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b2c21b91-f3be-4bc4-8944-f5766379921b+6:13793:x1870622715129216:12345-192.168.204.12@tcp:13:lfs.0 Request processed in 237us (606us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965216.035348:0:14838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 5 00000100:00080000:0.0:1783965216.035543:0:14195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783965216.038326:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965216.038683:0:14838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715129344 00000100:00100000:2.0:1783965216.038696:0:14838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715129344 00000100:00100000:2.0:1783965216.038787:0:14838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 6 00000100:00100000:2.0:1783965216.038799:0:14838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947307dc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b2c21b91-f3be-4bc4-8944-f5766379921b+5:13793:x1870622715129344:12345-192.168.204.12@tcp:13:lfs.0 00002000:00000024:2.0:1783965216.038866:0:14838:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783965216.038986:0:14838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947307dc4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:b2c21b91-f3be-4bc4-8944-f5766379921b+5:13793:x1870622715129344:12345-192.168.204.12@tcp:13:lfs.0 Request processed in 189us (675us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965216.039003:0:14838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 6 00000100:00080000:0.0:1783965216.039956:0:14195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783965216.233130:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965216.237391:0:14194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715129472 00000100:00100000:3.0:1783965216.237416:0:14194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715129472 00000100:00100000:3.0:1783965216.237602:0:14194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 90 00000100:00100000:3.0:1783965216.237617:0:14194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94741cd52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8204b8a1-ddc8-44a4-855e-f8a2831c2700+10:13826:x1870622715129472:12345-192.168.204.12@tcp:101:mount.lustre.0 00010000:00010000:3.0:1783965216.237661:0:14194:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783965216.237688:0:14194:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94743fb8e400/0xe782b916994fe81e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5f036f expref: -99 pid: 14194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965216.237727:0:14194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94743fb8e400/0xe782b916994fe81e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f036f expref: 11 pid: 14194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965216.237739:0:14194:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94743fb8e400/0xe782b916994fe81e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f036f expref: 11 pid: 14194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965216.237750:0:14194:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94743fb8e400, rc 0) 00000100:00100000:3.0:1783965216.237865:0:14194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94741cd52450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8204b8a1-ddc8-44a4-855e-f8a2831c2700+11:13826:x1870622715129472:12345-192.168.204.12@tcp:101:mount.lustre.0 Request processed in 251us (4752us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965216.237874:0:14194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 90 00000100:00100000:1.0:1783965216.253075:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783965216.253297:0:14193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715129600 00000100:00100000:0.0:1783965216.253312:0:14193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715129600 00000100:00100000:0.0:1783965216.253383:0:14193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 91 00000100:00100000:0.0:1783965216.253396:0:14193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94741cd51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8204b8a1-ddc8-44a4-855e-f8a2831c2700+11:13826:x1870622715129600:12345-192.168.204.12@tcp:501:mount.lustre.0 00000100:00100000:0.0:1783965216.255542:0:14193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94741cd51050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8204b8a1-ddc8-44a4-855e-f8a2831c2700+11:13826:x1870622715129600:12345-192.168.204.12@tcp:501:mount.lustre.0 Request processed in 2132us (2465us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965216.255561:0:14193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 91 00000100:00100000:0.0:1783965216.261625:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965216.262100:0:14194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715129728 00000100:00100000:3.0:1783965216.262114:0:14194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715129728 00000100:00100000:3.0:1783965216.262197:0:14194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 92 00000100:00100000:3.0:1783965216.262245:0:14194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94741cd50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8204b8a1-ddc8-44a4-855e-f8a2831c2700+11:13826:x1870622715129728:12345-192.168.204.12@tcp:503:mount.lustre.0 00000100:00100000:3.0:1783965216.262761:0:14194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94741cd50850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8204b8a1-ddc8-44a4-855e-f8a2831c2700+11:13826:x1870622715129728:12345-192.168.204.12@tcp:503:mount.lustre.0 Request processed in 518us (1150us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965216.262782:0:14194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 92 00000100:00100000:1.0:1783965216.284287:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783965216.284412:0:14193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715129856 00000100:00100000:0.0:1783965216.284426:0:14193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715129856 00000100:00100000:0.0:1783965216.284502:0:14193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 93 00000100:00100000:0.0:1783965216.284533:0:14193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94741cd52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8204b8a1-ddc8-44a4-855e-f8a2831c2700+11:13832:x1870622715129856:12345-192.168.204.12@tcp:502:llog_process_th.0 00000100:00100000:0.0:1783965216.285198:0:14193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94741cd52850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8204b8a1-ddc8-44a4-855e-f8a2831c2700+11:13832:x1870622715129856:12345-192.168.204.12@tcp:502:llog_process_th.0 Request processed in 662us (921us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965216.285247:0:14193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 93 00010000:00010000:0.0:1783965216.300734:0:14187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783965216.307685:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965216.307780:0:14194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715129984 00000100:00100000:3.0:1783965216.307793:0:14194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715129984 00000100:00100000:3.0:1783965216.307852:0:14194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 94 00000100:00100000:3.0:1783965216.307863:0:14194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94741cd52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8204b8a1-ddc8-44a4-855e-f8a2831c2700+11:13832:x1870622715129984:12345-192.168.204.12@tcp:502:llog_process_th.0 00000100:00100000:3.0:1783965216.308285:0:14194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94741cd52050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8204b8a1-ddc8-44a4-855e-f8a2831c2700+11:13832:x1870622715129984:12345-192.168.204.12@tcp:502:llog_process_th.0 Request processed in 420us (612us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965216.308304:0:14194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 94 00000100:00100000:2.0:1783965216.316231:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965216.316393:0:14192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715130112 00000100:00100000:1.0:1783965216.316408:0:14192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715130112 00000100:00100000:1.0:1783965216.316483:0:14192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 95 00000100:00100000:1.0:1783965216.316495:0:14192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94741cd51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8204b8a1-ddc8-44a4-855e-f8a2831c2700+11:13826:x1870622715130112:12345-192.168.204.12@tcp:101:mount.lustre.0 00010000:00010000:1.0:1783965216.316520:0:14192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783965216.316549:0:14192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94743d9ef400/0xe782b916994fe825 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5f0399 expref: -99 pid: 14192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965216.316600:0:14192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94743d9ef400/0xe782b916994fe825 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0399 expref: 12 pid: 14192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965216.316614:0:14192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94743d9ef400/0xe782b916994fe825 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0399 expref: 12 pid: 14192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965216.316625:0:14192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94743d9ef400, rc 0) 00000100:00100000:1.0:1783965216.316703:0:14192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94741cd51450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8204b8a1-ddc8-44a4-855e-f8a2831c2700+12:13826:x1870622715130112:12345-192.168.204.12@tcp:101:mount.lustre.0 Request processed in 210us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965216.316731:0:14192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 95 00000100:00100000:1.0:1783965216.322376:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783965216.322549:0:14193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715130240 00000100:00100000:0.0:1783965216.322564:0:14193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715130240 00000100:00100000:0.0:1783965216.322650:0:14193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 96 00000100:00100000:0.0:1783965216.322663:0:14193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94741cd50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8204b8a1-ddc8-44a4-855e-f8a2831c2700+12:13826:x1870622715130240:12345-192.168.204.12@tcp:256:mount.lustre.0 20000000:01000000:0.0:1783965216.322709:0:14193:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1783965216.322743:0:14193:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1783965216.322748:0:14193:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1783965216.322751:0:14193:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1783965216.322754:0:14193:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:2.0:1783965216.325535:0:14193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94741cd50c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8204b8a1-ddc8-44a4-855e-f8a2831c2700+12:13826:x1870622715130240:12345-192.168.204.12@tcp:256:mount.lustre.0 Request processed in 2857us (3157us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965216.325553:0:14193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 96 00000100:00100000:2.0:1783965216.331990:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965216.332131:0:14194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715130368 00000100:00100000:3.0:1783965216.332145:0:14194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715130368 00000100:00100000:2.0:1783965216.332620:0:14194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 97 00000100:00100000:2.0:1783965216.332636:0:14194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94741cd53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8204b8a1-ddc8-44a4-855e-f8a2831c2700+12:13826:x1870622715130368:12345-192.168.204.12@tcp:101:mount.lustre.0 00010000:00010000:2.0:1783965216.332658:0:14194:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783965216.332681:0:14194:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff947425975e00/0xe782b916994fe82c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5f03a0 expref: -99 pid: 14194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965216.332721:0:14194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff947425975e00/0xe782b916994fe82c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f03a0 expref: 13 pid: 14194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965216.332735:0:14194:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff947425975e00/0xe782b916994fe82c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f03a0 expref: 13 pid: 14194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965216.332746:0:14194:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff947425975e00, rc 0) 00000100:00100000:2.0:1783965216.332849:0:14194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94741cd53850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8204b8a1-ddc8-44a4-855e-f8a2831c2700+13:13826:x1870622715130368:12345-192.168.204.12@tcp:101:mount.lustre.0 Request processed in 216us (878us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965216.332857:0:14194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 97 00000100:00100000:0.0:1783965216.335690:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965216.335872:0:14192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715130496 00000100:00100000:1.0:1783965216.335885:0:14192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715130496 00000100:00100000:2.0:1783965216.335989:0:14194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 98 00000100:00100000:2.0:1783965216.336005:0:14194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94741cd53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8204b8a1-ddc8-44a4-855e-f8a2831c2700+13:13826:x1870622715130496:12345-192.168.204.12@tcp:501:mount.lustre.0 00000100:00100000:2.0:1783965216.336683:0:14194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94741cd53050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8204b8a1-ddc8-44a4-855e-f8a2831c2700+13:13826:x1870622715130496:12345-192.168.204.12@tcp:501:mount.lustre.0 Request processed in 675us (1005us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965216.336695:0:14194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 98 00000100:00100000:1.0:1783965216.339647:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783965216.340619:0:14193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715130624 00000100:00100000:0.0:1783965216.340636:0:14193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715130624 00000100:00100000:0.0:1783965216.340716:0:14193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 99 00000100:00100000:0.0:1783965216.340728:0:14193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94741cd53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8204b8a1-ddc8-44a4-855e-f8a2831c2700+13:13826:x1870622715130624:12345-192.168.204.12@tcp:503:mount.lustre.0 00000100:00100000:2.0:1783965216.341985:0:14193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94741cd53450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8204b8a1-ddc8-44a4-855e-f8a2831c2700+13:13826:x1870622715130624:12345-192.168.204.12@tcp:503:mount.lustre.0 Request processed in 1241us (2336us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965216.342071:0:14193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 99 00000100:00100000:0.0:1783965216.345178:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965216.345593:0:14194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715130752 00000100:00100000:2.0:1783965216.345622:0:14194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715130752 00000100:00100000:2.0:1783965216.345789:0:14194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 100 00000100:00100000:2.0:1783965216.345804:0:14194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94741cd51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8204b8a1-ddc8-44a4-855e-f8a2831c2700+13:13836:x1870622715130752:12345-192.168.204.12@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783965216.346173:0:14194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94741cd51850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8204b8a1-ddc8-44a4-855e-f8a2831c2700+13:13836:x1870622715130752:12345-192.168.204.12@tcp:502:llog_process_th.0 Request processed in 371us (1009us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965216.346183:0:14194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 100 00000100:00100000:0.0:1783965216.349300:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965216.349413:0:14193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715130880 00000100:00100000:2.0:1783965216.349426:0:14193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715130880 00000100:00100000:2.0:1783965216.349485:0:14193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 101 00000100:00100000:2.0:1783965216.349497:0:14193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94741cd53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8204b8a1-ddc8-44a4-855e-f8a2831c2700+13:13836:x1870622715130880:12345-192.168.204.12@tcp:502:llog_process_th.0 00000100:00100000:2.0:1783965216.351021:0:14193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94741cd53c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8204b8a1-ddc8-44a4-855e-f8a2831c2700+13:13836:x1870622715130880:12345-192.168.204.12@tcp:502:llog_process_th.0 Request processed in 1514us (1723us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965216.351035:0:14193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 101 00000100:00100000:0.0:1783965216.364823:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965216.365090:0:14200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715131008 00000100:00100000:2.0:1783965216.365104:0:14200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715131008 00000100:00100000:2.0:1783965216.365245:0:14200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 10 00000100:00100000:2.0:1783965216.365256:0:14200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743fb9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2356:x1870622715131008:12345-192.168.204.12@tcp:38:mount.lustre.0 00010000:00080000:2.0:1783965216.365302:0:14200:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-MDT0000: connection from d42e9324-0c5a-4045-80ff-e53d47e8c2f0@192.168.204.12@tcp t0 exp 0000000000000000 cur 450 last 0 00000020:00000080:2.0:1783965216.365381:0:14200:0:(genops.c:1406:class_connect()) connect: client d42e9324-0c5a-4045-80ff-e53d47e8c2f0, cookie 0xe782b916994fe833 00000004:00100000:2.0:1783965216.365427:0:14200:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1783965216.365611:0:14200:0:(import.c:65:import_set_state_nolock()) ffff947405904800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783965216.365749:0:14200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743fb9c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d42e9324-0c5a-4045-80ff-e53d47e8c2f0+6:2356:x1870622715131008:12345-192.168.204.12@tcp:38:mount.lustre.0 Request processed in 492us (941us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965216.365758:0:14200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 10 00000100:00100000:1.0:1783965216.387850:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965216.387899:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965216.388813:0:14201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715131264 00000100:00100000:3.0:1783965216.388830:0:14201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715131264 00000100:00100000:2.0:1783965216.388916:0:15978:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715131136 00000100:00100000:2.0:1783965216.388921:0:15978:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715131136 00000100:00100000:2.0:1783965216.388995:0:15978:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 11 00000100:00100000:2.0:1783965216.389009:0:15978:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947307dc4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d42e9324-0c5a-4045-80ff-e53d47e8c2f0+7:0:x1870622715131136:12345-192.168.204.12@tcp:41:mount.lustre.0 00000004:00000024:2.0:1783965216.389054:0:15978:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1783965216.389162:0:15978:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947307dc4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d42e9324-0c5a-4045-80ff-e53d47e8c2f0+7:0:x1870622715131136:12345-192.168.204.12@tcp:41:mount.lustre.0 Request processed in 155us (1260us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965216.389170:0:15978:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 11 00000100:00080000:0.0:1783965216.390235:0:14195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783965216.390338:0:14201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 12 00000100:00100000:3.0:1783965216.390350:0:14201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947307dc6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d42e9324-0c5a-4045-80ff-e53d47e8c2f0+6:13826:x1870622715131264:12345-192.168.204.12@tcp:41:mount.lustre.0 00000004:00000024:3.0:1783965216.390380:0:14201:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1783965216.391707:0:14201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947307dc6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d42e9324-0c5a-4045-80ff-e53d47e8c2f0+6:13826:x1870622715131264:12345-192.168.204.12@tcp:41:mount.lustre.0 Request processed in 1344us (3857us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965216.391722:0:14201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 12 00000100:00100000:1.0:1783965216.398293:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965216.398408:0:15978:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715131392 00000100:00100000:2.0:1783965216.398421:0:15978:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715131392 00000100:00100000:2.0:1783965216.398500:0:15978:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 13 00000100:00100000:2.0:1783965216.398513:0:15978:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947307dc7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d42e9324-0c5a-4045-80ff-e53d47e8c2f0+6:13826:x1870622715131392:12345-192.168.204.12@tcp:40:mount.lustre.0 00000100:00100000:2.0:1783965216.398659:0:15978:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947307dc7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d42e9324-0c5a-4045-80ff-e53d47e8c2f0+6:13826:x1870622715131392:12345-192.168.204.12@tcp:40:mount.lustre.0 Request processed in 148us (381us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965216.398670:0:15978:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 13 00000100:00100000:0.0:1783965216.406324:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783965216.406376:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783965216.406429:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783965216.406528:0:14203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715131776 00000100:00100000:0.0:1783965216.406541:0:14203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715131776 00000100:00100000:0.0:1783965216.406614:0:14203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 1 00000100:00100000:0.0:1783965216.406626:0:14203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743fb9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d42e9324-0c5a-4045-80ff-e53d47e8c2f0+6:13826:x1870622715131776:12345-192.168.204.12@tcp:33:mount.lustre.0 00000004:00200000:0.0:1783965216.407000:0:14203:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:0.0:1783965216.407182:0:14203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743fb9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d42e9324-0c5a-4045-80ff-e53d47e8c2f0+6:13826:x1870622715131776:12345-192.168.204.12@tcp:33:mount.lustre.0 Request processed in 556us (750us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965216.407191:0:14203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 1 00000100:00100000:2.0:1783965216.407455:0:14834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715131520 00000100:00100000:2.0:1783965216.407462:0:14834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715131520 00000100:00100000:2.0:1783965216.407495:0:14834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715131648 00000100:00100000:2.0:1783965216.407498:0:14834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715131648 00000100:00100000:2.0:1783965216.407511:0:14834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 10 00000100:00100000:2.0:1783965216.407518:0:14834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743fb9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2356:x1870622715131520:12345-192.168.204.12@tcp:8:mount.lustre.0 00010000:00080000:2.0:1783965216.407553:0:14834:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0000: connection from d42e9324-0c5a-4045-80ff-e53d47e8c2f0@192.168.204.12@tcp t0 exp 0000000000000000 cur 450 last 0 00000020:00000080:2.0:1783965216.407607:0:14834:0:(genops.c:1406:class_connect()) connect: client d42e9324-0c5a-4045-80ff-e53d47e8c2f0, cookie 0xe782b916994fe83a 00002000:00100000:2.0:1783965216.407630:0:14834:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli d42e9324-0c5a-4045-80ff-e53d47e8c2f0/ffff947425afd000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1783965216.407647:0:14834:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1783965216.407783:0:14834:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1783965216.407825:0:14834:0:(import.c:65:import_set_state_nolock()) ffff947425af8000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783965216.407875:0:14834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743fb9d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d42e9324-0c5a-4045-80ff-e53d47e8c2f0+6:2356:x1870622715131520:12345-192.168.204.12@tcp:8:mount.lustre.0 Request processed in 356us (1568us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965216.407882:0:14834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 10 00000100:00100000:2.0:1783965216.407906:0:14834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 11 00000100:00100000:2.0:1783965216.407910:0:14834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743fb9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2356:x1870622715131648:12345-192.168.204.12@tcp:8:mount.lustre.0 00010000:00080000:2.0:1783965216.407927:0:14834:0:(ldlm_lib.c:1445:target_handle_connect()) lustre-OST0001: connection from d42e9324-0c5a-4045-80ff-e53d47e8c2f0@192.168.204.12@tcp t0 exp 0000000000000000 cur 450 last 0 00000020:00000080:2.0:1783965216.407949:0:14834:0:(genops.c:1406:class_connect()) connect: client d42e9324-0c5a-4045-80ff-e53d47e8c2f0, cookie 0xe782b916994fe841 00002000:00100000:2.0:1783965216.407955:0:14834:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli d42e9324-0c5a-4045-80ff-e53d47e8c2f0/ffff9473051e9000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 21136a2 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1783965216.407962:0:14834:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1783965216.408146:0:14834:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1783965216.408164:0:14834:0:(import.c:65:import_set_state_nolock()) ffff9473051ea800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1783965216.408189:0:14834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743fb9d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d42e9324-0c5a-4045-80ff-e53d47e8c2f0+6:2356:x1870622715131648:12345-192.168.204.12@tcp:8:mount.lustre.0 Request processed in 277us (1813us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965216.408197:0:14834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 11 00000100:00100000:0.0:1783965216.578681:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965216.578828:0:14200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715131904 00000100:00100000:2.0:1783965216.578841:0:14200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715131904 00000100:00100000:3.0:1783965216.578963:0:14201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 14 00000100:00100000:3.0:1783965216.578979:0:14201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743fb9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d42e9324-0c5a-4045-80ff-e53d47e8c2f0+6:13857:x1870622715131904:12345-192.168.204.12@tcp:101:mkdir.0 00010000:00010000:3.0:1783965216.579068:0:14201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783965216.579108:0:14201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f600/0xe782b916994fe848 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5f03ca expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965216.579191:0:14201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e800/0xe782b916994fe84f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965216.579238:0:14201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e800/0xe782b916994fe84f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965216.579256:0:14201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e800/0xe782b916994fe84f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783965216.579608:0:14201:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1783965216.579622:0:14201:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:3.0:1783965216.579712:0:14201:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e800/0xe782b916994fe84f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965216.579749:0:14201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f600/0xe782b916994fe848 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f03ca expref: 8 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965216.579770:0:14201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e800/0xe782b916994fe84f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f03ca expref: 7 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965216.579779:0:14201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff947409a45600) 00010000:00010000:3.0:1783965216.579783:0:14201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1783965216.579878:0:14201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94743fb8e800, rc 0) 00000100:00100000:3.0:1783965216.579999:0:14201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743fb9e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d42e9324-0c5a-4045-80ff-e53d47e8c2f0+7:13857:x1870622715131904:12345-192.168.204.12@tcp:101:mkdir.0 Request processed in 1025us (1333us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965216.580006:0:14201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 14 00000001:00100000:3.0:1783965216.904931:0:6637:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of d42e9324-0c5a-4045-80ff-e53d47e8c2f0 00000001:00100000:3.0:1783965216.904954:0:6637:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of b2c21b91-f3be-4bc4-8944-f5766379921b 00010000:00010000:0.0:1783965217.323448:0:15786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1783965217.837884:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947307dc6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3323:1870622732945664:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1783965217.837954:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783965217.843729:0:14838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732945664 00000100:00100000:2.0:1783965217.843741:0:14838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732945664 00000100:00100000:2.0:1783965217.843813:0:14838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1783965217.843834:0:14838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743706c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3323:x1870622732945664:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1783965217.843873:0:14838:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783965217.843948:0:14838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743706c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3323:x1870622732945664:12345-0@lo:13:osp-pre-0-0.0 Request processed in 117us (5993us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965217.843956:0:14838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1783965217.844017:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947307dc6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3323:1870622732945664:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1783965217.844306:0:14195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1783965218.347865:0:14188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1783965218.940126:0:5835:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of d42e9324-0c5a-4045-80ff-e53d47e8c2f0 00000001:00100000:3.0:1783965218.940147:0:5835:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of b2c21b91-f3be-4bc4-8944-f5766379921b 00000001:02000400:1.0:1783965218.955747:0:16069:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:0.0:1783965219.371607:0:14187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1783965219.756818:0:14233:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1783965219.883821:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e610380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3323:1870622732946176:0@lo:400:kworker.0 00000100:00100000:0.0:1783965219.883907:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783965219.883949:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e612680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:72a5858e-0958-4c77-91cf-d6507b930817:3324:1870622732945792:0@lo:400:kworker.0 00000100:00100000:1.0:1783965219.883992:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783965219.884038:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e611c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3324:1870622732946304:0@lo:400:kworker.0 00000100:00100000:1.0:1783965219.884064:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e611f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3322:1870622732946048:0@lo:400:kworker.0 00000100:00100000:1.0:1783965219.884087:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783965219.884124:0:14194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732945792 00000100:00100000:1.0:1783965219.884131:0:14194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732945792 00000100:00100000:1.0:1783965219.884172:0:14194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1783965219.884181:0:14194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94741cd51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72a5858e-0958-4c77-91cf-d6507b930817+19:3324:x1870622732945792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783965219.884237:0:15978:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732946176 00000100:00100000:0.0:1783965219.884242:0:15978:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732946176 00000100:00100000:1.0:1783965219.884253:0:14194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94741cd51c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72a5858e-0958-4c77-91cf-d6507b930817+19:3324:x1870622732945792:12345-0@lo:400:kworker.0 Request processed in 72us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965219.884262:0:14194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1783965219.884281:0:15978:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1783965219.884290:0:15978:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e610000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3323:x1870622732946176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783965219.884298:0:14834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732946048 00000100:00100000:1.0:1783965219.884303:0:14834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732946048 00000100:00100000:0.0:1783965219.884337:0:15978:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e610000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3323:x1870622732946176:12345-0@lo:400:kworker.0 Request processed in 49us (430us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965219.884344:0:14834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1783965219.884347:0:15978:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1783965219.884355:0:14834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947307dc6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3322:x1870622732946048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783965219.884394:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e610380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3323:1870622732946176:0@lo:400:kworker.0 00000100:00100000:1.0:1783965219.884400:0:14834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947307dc6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3322:x1870622732946048:12345-0@lo:400:kworker.0 Request processed in 45us (309us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965219.884416:0:14834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1783965219.884446:0:14195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783965219.884470:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e611f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3322:1870622732946048:0@lo:400:kworker.0 00000100:00100000:1.0:1783965219.884488:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783965219.884535:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e612680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:72a5858e-0958-4c77-91cf-d6507b930817:3324:1870622732945792:0@lo:400:kworker.0 00000100:00100000:1.0:1783965219.885644:0:3324:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1783965219.885676:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e611880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3324:1870622732945920:0@lo:400:kworker.0 00000100:00100000:1.0:1783965219.885721:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783965219.885747:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e612d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3324:1870622732946432:0@lo:400:kworker.0 00000100:00100000:1.0:1783965219.885897:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783965219.885930:0:14835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732945920 00000100:00100000:1.0:1783965219.885935:0:14835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732945920 00000100:00100000:1.0:1783965219.885975:0:14835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1783965219.885982:0:14835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947307dc4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3324:x1870622732945920:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1783965219.886026:0:14835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947307dc4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3324:x1870622732945920:12345-0@lo:400:kworker.0 Request processed in 45us (305us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965219.886033:0:14835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:1.0:1783965219.886048:0:14195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1783965219.886056:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743706ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3322:1870622732946560:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783965219.886084:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783965219.886119:0:14839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732946560 00000100:00100000:1.0:1783965219.886123:0:14839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732946560 00000100:00100000:1.0:1783965219.886148:0:14839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783965219.886154:0:14839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947307dc5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1870622732946560:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1783965219.886184:0:14839:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1783965219.886247:0:14839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947307dc5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1870622732946560:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965219.886253:0:14839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1783965219.886289:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743706ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3322:1870622732946560:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1783965219.886318:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e611880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3324:1870622732945920:0@lo:400:kworker.0 00000100:00100000:0.0:1783965219.886592:0:14200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732946304 00000100:00100000:0.0:1783965219.886597:0:14200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732946304 00000100:00080000:0.0:1783965219.886772:0:14195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783965219.886784:0:15978:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732946432 00000100:00100000:0.0:1783965219.886787:0:15978:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732946432 00000100:00100000:0.0:1783965219.886829:0:15978:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1783965219.886837:0:15978:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947307dc5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3324:x1870622732946304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783965219.886884:0:15978:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947307dc5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3324:x1870622732946304:12345-0@lo:400:kworker.0 Request processed in 48us (2394us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965219.886890:0:15978:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1783965219.886902:0:15978:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1783965219.886908:0:15978:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947307dc7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3324:x1870622732946432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783965219.887426:0:15978:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947307dc7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3324:x1870622732946432:12345-0@lo:400:kworker.0 Request processed in 516us (1527us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965219.887433:0:15978:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:0.0:1783965219.887455:0:14195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1783965219.888607:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e612d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3324:1870622732946432:0@lo:400:kworker.0 00000100:00100000:1.0:1783965219.888624:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e611c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3324:1870622732946304:0@lo:400:kworker.0 00010000:00010000:3.0:1783965220.396489:0:15786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1783965220.463123:0:7523:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of d42e9324-0c5a-4045-80ff-e53d47e8c2f0 00010000:00010000:2.0:1783965221.428613:0:14188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783965221.760066:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783965221.760118:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965221.760145:0:14193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715132032 00000100:00100000:0.0:1783965221.760156:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965221.760157:0:14193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715132032 00000100:00100000:0.0:1783965221.760180:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783965221.760227:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965221.760241:0:14193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 103 00000100:00100000:2.0:1783965221.760258:0:14193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94741cd52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8204b8a1-ddc8-44a4-855e-f8a2831c2700+13:2357:x1870622715132032:12345-192.168.204.12@tcp:400:kworker.0 00000100:00100000:0.0:1783965221.760259:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783965221.760285:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965221.760420:0:14834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715132288 00000100:00100000:3.0:1783965221.760426:0:14834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715132288 00000100:00100000:3.0:1783965221.760463:0:14834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715132800 00000100:00100000:3.0:1783965221.760465:0:14834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715132800 00000100:00100000:3.0:1783965221.760495:0:14834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715132416 00000100:00100000:3.0:1783965221.760499:0:14834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715132416 00000100:00100000:3.0:1783965221.760522:0:14834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715132672 00000100:00100000:3.0:1783965221.760524:0:14834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715132672 00000100:00100000:3.0:1783965221.760539:0:14834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 6 00000100:00100000:3.0:1783965221.760546:0:14834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e610380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b2c21b91-f3be-4bc4-8944-f5766379921b+5:2357:x1870622715132288:12345-192.168.204.12@tcp:400:kworker.0 00000100:00100000:2.0:1783965221.761291:0:14193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94741cd52c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8204b8a1-ddc8-44a4-855e-f8a2831c2700+13:2357:x1870622715132032:12345-192.168.204.12@tcp:400:kworker.0 Request processed in 1038us (1232us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965221.761300:0:14193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 103 00000100:00080000:2.0:1783965221.761359:0:14195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1783965221.761364:0:14195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1783965221.762879:0:14199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715132544 00000100:00100000:2.0:1783965221.762891:0:14199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715132544 00000100:00100000:2.0:1783965221.763271:0:14199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715132160 00000100:00100000:2.0:1783965221.763275:0:14199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715132160 00000100:00100000:2.0:1783965221.763305:0:14199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 19 00000100:00100000:2.0:1783965221.763315:0:14199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e610e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d42e9324-0c5a-4045-80ff-e53d47e8c2f0+6:2357:x1870622715132544:12345-192.168.204.12@tcp:400:kworker.0 00000100:00100000:2.0:1783965221.763390:0:14199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e610e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d42e9324-0c5a-4045-80ff-e53d47e8c2f0+6:2357:x1870622715132544:12345-192.168.204.12@tcp:400:kworker.0 Request processed in 76us (3233us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965221.763398:0:14199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 19 00000100:00100000:2.0:1783965221.763422:0:14199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 20 00000100:00100000:2.0:1783965221.763438:0:14199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e612300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2c21b91-f3be-4bc4-8944-f5766379921b+6:2357:x1870622715132160:12345-192.168.204.12@tcp:400:kworker.0 00000100:00100000:2.0:1783965221.763468:0:14199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e612300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2c21b91-f3be-4bc4-8944-f5766379921b+6:2357:x1870622715132160:12345-192.168.204.12@tcp:400:kworker.0 Request processed in 32us (3241us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965221.763489:0:14199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 20 00000100:00100000:2.0:1783965221.763514:0:14835:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1783965221.763521:0:14835:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00080000:2.0:1783965221.763558:0:14195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783965221.763676:0:14835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 7 00000100:00100000:2.0:1783965221.763692:0:14835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e612a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d42e9324-0c5a-4045-80ff-e53d47e8c2f0+5:2357:x1870622715132800:12345-192.168.204.12@tcp:400:kworker.0 00000100:00100000:2.0:1783965221.763729:0:14835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e612a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d42e9324-0c5a-4045-80ff-e53d47e8c2f0+5:2357:x1870622715132800:12345-192.168.204.12@tcp:400:kworker.0 Request processed in 41us (3544us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965221.763739:0:14835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 7 00000100:00100000:2.0:1783965221.763758:0:14835:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1783965221.763766:0:14835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 8 00000100:00100000:2.0:1783965221.763773:0:14835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e611500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b2c21b91-f3be-4bc4-8944-f5766379921b+5:2357:x1870622715132416:12345-192.168.204.12@tcp:400:kworker.0 00000100:00100000:2.0:1783965221.763799:0:14835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e611500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b2c21b91-f3be-4bc4-8944-f5766379921b+5:2357:x1870622715132416:12345-192.168.204.12@tcp:400:kworker.0 Request processed in 26us (3544us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965221.763805:0:14835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 8 00000100:00100000:2.0:1783965221.763815:0:14835:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:2.0:1783965221.763826:0:14835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 9 00000100:00100000:2.0:1783965221.763833:0:14835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e611180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d42e9324-0c5a-4045-80ff-e53d47e8c2f0+5:2357:x1870622715132672:12345-192.168.204.12@tcp:400:kworker.0 00000100:00100000:2.0:1783965221.764058:0:14835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e611180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:d42e9324-0c5a-4045-80ff-e53d47e8c2f0+5:2357:x1870622715132672:12345-192.168.204.12@tcp:400:kworker.0 Request processed in 224us (3771us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965221.764065:0:14835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 9 00000100:00100000:3.0:1783965221.769591:0:14834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e610380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b2c21b91-f3be-4bc4-8944-f5766379921b+5:2357:x1870622715132288:12345-192.168.204.12@tcp:400:kworker.0 Request processed in 9032us (9460us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965221.769610:0:14834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 6 00000020:00000080:3.0:1783965222.377382:0:16221:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffa66c19c0 20000000:00000080:3.0:1783965222.377401:0:16221:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff947306866c00 uarg=0000000000000000 20000000:01000000:3.0:1783965222.377439:0:16221:0:(mgs_llog.c:6188:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1783965222.377444:0:16221:0:(mgs_llog.c:4643:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1783965222.377449:0:16221:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1783965222.378414:0:16222:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:3.0:1783965222.378578:0:16221:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1783965222.389808:0:16221:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1783965222.390042:0:16221:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff94743fb8f600/0xe782b916994fe856 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965222.390061:0:16221:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff947436f27e00/0xe782b916994fe54d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe782b916994fe546 expref: 18 pid: 14193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965222.390070:0:16221:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff94743e2fce00/0xe782b916994fe59a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe782b916994fe593 expref: 18 pid: 14193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965222.390077:0:16221:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff947425974800/0xe782b916994fe6d5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe782b916994fe6ce expref: 18 pid: 14192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965222.390087:0:16221:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff947305c21200/0xe782b916994fe7f4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f033e expref: 12 pid: 14193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965222.390095:0:16221:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff947425975e00/0xe782b916994fe82c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f03a0 expref: 12 pid: 14194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965222.390114:0:16221:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff94743fb8f600/0xe782b916994fe856 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965222.390158:0:16221:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff947425975e00/0xe782b916994fe82c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f03a0 expref: 12 pid: 14194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965222.390174:0:16221:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff947425975e00/0xe782b916994fe82c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f03a0 expref: 12 pid: 14194 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783965222.390517:0:16221:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9474368d4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16221:1870622732946688:192.168.204.12@tcp:104: 00010000:00010000:2.0:1783965222.390717:0:16221:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff947305c21200/0xe782b916994fe7f4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f033e expref: 12 pid: 14193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965222.390746:0:16221:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff947305c21200/0xe782b916994fe7f4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f033e expref: 12 pid: 14193 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783965222.390757:0:16221:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743706ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16221:1870622732946816:192.168.204.12@tcp:104: 00010000:00010000:2.0:1783965222.390806:0:16221:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff947425974800/0xe782b916994fe6d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe782b916994fe6ce expref: 18 pid: 14192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965222.390826:0:16221:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff947425974800/0xe782b916994fe6d5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe782b916994fe6ce expref: 18 pid: 14192 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783965222.390838:0:16221:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743706f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16221:1870622732946944:0@lo:104: 00000100:00100000:2.0:1783965222.390882:0:16221:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783965222.390919:0:16221:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff94743e2fce00/0xe782b916994fe59a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe782b916994fe593 expref: 18 pid: 14193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965222.390927:0:16221:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff94743e2fce00/0xe782b916994fe59a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe782b916994fe593 expref: 18 pid: 14193 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783965222.390935:0:16221:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743706ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16221:1870622732947072:0@lo:104: 00000100:00100000:2.0:1783965222.390955:0:16221:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1783965222.390985:0:16221:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff947436f27e00/0xe782b916994fe54d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0xe782b916994fe546 expref: 18 pid: 14193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965222.390993:0:16221:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff947436f27e00/0xe782b916994fe54d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0xe782b916994fe546 expref: 18 pid: 14193 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783965222.391001:0:16221:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743706c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16221:1870622732947200:0@lo:104: 00000100:00100000:2.0:1783965222.391026:0:16221:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783965222.391044:0:16221:0:(client.c:2702:ptlrpc_set_wait()) set ffff947408bc8000 going to sleep for 11 seconds 00000100:00100000:3.0:1783965222.391618:0:14183:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1783965222.391634:0:14183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732946944 00000100:00100000:3.0:1783965222.391641:0:14183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732946944 00000100:00100000:3.0:1783965222.391737:0:14183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732947072 00000100:00100000:3.0:1783965222.391741:0:14183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732947072 00000100:00100000:3.0:1783965222.391752:0:14183:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732947200 00000100:00100000:3.0:1783965222.391754:0:14183:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732947200 00000100:00100000:3.0:1783965222.391767:0:14183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783965222.391775:0:14183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743706f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:72a5858e-0958-4c77-91cf-d6507b930817+5:16221:x1870622732946944:12345-0@lo:104: 00010000:00010000:3.0:1783965222.391787:0:14183:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.112@tcp lock: ffff94743fb8f000/0xe782b916994fe6ce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe782b916994fe6d5 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965222.391847:0:14183:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1783965222.391853:0:14183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743706f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:72a5858e-0958-4c77-91cf-d6507b930817+5:16221:x1870622732946944:12345-0@lo:104: Request processed in 79us (977us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965222.391860:0:14183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1783965222.391877:0:14183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783965222.391883:0:14183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743706c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:72a5858e-0958-4c77-91cf-d6507b930817+4:16221:x1870622732947072:12345-0@lo:104: 00000100:00100000:2.0:1783965222.392014:0:16221:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743706f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16221:1870622732946944:0@lo:104: 00010000:00010000:2.0:1783965222.392042:0:14187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1783965222.392048:0:14187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.112@tcp lock: ffff94743fb8f000/0xe782b916994fe6ce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0xe782b916994fe6d5 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965222.392055:0:14187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743fb8f000 already unused, calling callback (ffffffffc1ca8c20) 10000000:00010000:2.0:1783965222.392059:0:14187:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.112@tcp lock: ffff94743fb8f000/0xe782b916994fe6ce lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0xe782b916994fe6d5 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965222.392068:0:14187:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.112@tcp lock: ffff94743fb8f000/0xe782b916994fe6ce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0xe782b916994fe6d5 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1783965222.392074:0:14187:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.112@tcp lock: ffff94743fb8f000/0xe782b916994fe6ce lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0xe782b916994fe6d5 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783965222.392080:0:14187:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1783965222.392114:0:14187:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.112@tcp lock: ffff94743fb8f000/0xe782b916994fe6ce lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe782b916994fe6d5 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965222.392121:0:14187:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1783965222.392139:0:14187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.112@tcp lock: ffff94743fb8f000/0xe782b916994fe6ce lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe782b916994fe6d5 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965222.392146:0:14187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.112@tcp lock: ffff94743fb8f000/0xe782b916994fe6ce lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe782b916994fe6d5 expref: -99 pid: 15504 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965222.392158:0:14187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783965222.392160:0:14187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1783965222.392162:0:14187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783965222.392236:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1783965222.392250:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e29a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:72a5858e-0958-4c77-91cf-d6507b930817:3322:1870622732947328:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1783965222.392284:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783965222.392316:0:14186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732947328 00000100:00100000:2.0:1783965222.392328:0:14186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732947328 00010000:00010000:2.0:1783965222.392351:0:14186:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff947425974800/0xe782b916994fe6d5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe782b916994fe6ce expref: 19 pid: 14192 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783965222.392374:0:14186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1783965222.392382:0:14186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947307dc6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:72a5858e-0958-4c77-91cf-d6507b930817+19:3322:x1870622732947328:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783965222.392391:0:14186:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783965222.392397:0:14186:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff947425974800/0xe782b916994fe6d5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe782b916994fe6ce expref: 19 pid: 14192 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965222.392406:0:14186:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff947425974800/0xe782b916994fe6d5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe782b916994fe6ce expref: 19 pid: 14192 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965222.392419:0:14186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff947425974800/0xe782b916994fe6d5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe782b916994fe6ce expref: 19 pid: 14192 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965222.392432:0:14186:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783965222.392477:0:14186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947307dc6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:72a5858e-0958-4c77-91cf-d6507b930817+18:3322:x1870622732947328:12345-0@lo:103:ldlm_bl.0 Request processed in 96us (193us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965222.392484:0:14186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:3.0:1783965222.392994:0:14183:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.112@tcp lock: ffff947425975800/0xe782b916994fe593 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe782b916994fe59a expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965222.393049:0:14183:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1783965222.393055:0:14183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743706c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:72a5858e-0958-4c77-91cf-d6507b930817+4:16221:x1870622732947072:12345-0@lo:104: Request processed in 1172us (2099us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965222.393062:0:14183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783965222.393078:0:14183:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1783965222.393085:0:14183:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94740be36c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:72a5858e-0958-4c77-91cf-d6507b930817+3:16221:x1870622732947200:12345-0@lo:104: 00010000:00010000:3.0:1783965222.393092:0:14183:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.204.112@tcp lock: ffff94743d9ee600/0xe782b916994fe546 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe782b916994fe54d expref: -99 pid: 14196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965222.393125:0:14183:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1783965222.393130:0:14183:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94740be36c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:72a5858e-0958-4c77-91cf-d6507b930817+3:16221:x1870622732947200:12345-0@lo:104: Request processed in 46us (2104us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965222.393136:0:14183:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:3.0:1783965222.393175:0:15786:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1783965222.393179:0:15786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.112@tcp lock: ffff947425975800/0xe782b916994fe593 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0xe782b916994fe59a expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965222.393196:0:15786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947425975800 already unused, calling callback (ffffffffc1ca8c20) 10000000:00010000:3.0:1783965222.393220:0:15786:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.112@tcp lock: ffff947425975800/0xe782b916994fe593 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0xe782b916994fe59a expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965222.393229:0:15786:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.112@tcp lock: ffff947425975800/0xe782b916994fe593 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0xe782b916994fe59a expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783965222.393235:0:15786:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.112@tcp lock: ffff947425975800/0xe782b916994fe593 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0xe782b916994fe59a expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783965222.393248:0:15786:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1783965222.393283:0:15786:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.112@tcp lock: ffff947425975800/0xe782b916994fe593 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe782b916994fe59a expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965222.393289:0:15786:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783965222.393312:0:15786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.112@tcp lock: ffff947425975800/0xe782b916994fe593 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe782b916994fe59a expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965222.393318:0:15786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.112@tcp lock: ffff947425975800/0xe782b916994fe593 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe782b916994fe59a expref: -99 pid: 14833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965222.393330:0:15786:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783965222.393333:0:15786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.204.112@tcp lock: ffff94743d9ee600/0xe782b916994fe546 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0xe782b916994fe54d expref: -99 pid: 14196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965222.393338:0:15786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743d9ee600 already unused, calling callback (ffffffffc1ca8c20) 10000000:00010000:3.0:1783965222.393340:0:15786:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.204.112@tcp lock: ffff94743d9ee600/0xe782b916994fe546 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0xe782b916994fe54d expref: -99 pid: 14196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965222.393347:0:15786:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.204.112@tcp lock: ffff94743d9ee600/0xe782b916994fe546 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0xe782b916994fe54d expref: -99 pid: 14196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1783965222.393352:0:15786:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.204.112@tcp lock: ffff94743d9ee600/0xe782b916994fe546 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0xe782b916994fe54d expref: -99 pid: 14196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1783965222.393357:0:15786:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1783965222.393370:0:15786:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.204.112@tcp lock: ffff94743d9ee600/0xe782b916994fe546 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe782b916994fe54d expref: -99 pid: 14196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965222.393376:0:15786:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1783965222.393390:0:15786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.204.112@tcp lock: ffff94743d9ee600/0xe782b916994fe546 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe782b916994fe54d expref: -99 pid: 14196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965222.393396:0:15786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.204.112@tcp lock: ffff94743d9ee600/0xe782b916994fe546 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0xe782b916994fe54d expref: -99 pid: 14196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965222.393414:0:15786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783965222.393416:0:15786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783965222.393418:0:15786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783965222.393425:0:14188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783965222.393436:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9474368d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:72a5858e-0958-4c77-91cf-d6507b930817:3325:1870622732947584:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783965222.393481:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783965222.393512:0:3325:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783965222.393529:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9474368d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:72a5858e-0958-4c77-91cf-d6507b930817:3325:1870622732947456:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783965222.393552:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783965222.393576:0:14185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732947584 00000100:00100000:3.0:1783965222.393586:0:14185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732947584 00010000:00010000:3.0:1783965222.393607:0:14185:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff947436f27e00/0xe782b916994fe54d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe782b916994fe546 expref: 18 pid: 14193 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783965222.393625:0:14185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732947456 00000100:00100000:3.0:1783965222.393628:0:14185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732947456 00010000:00010000:3.0:1783965222.393641:0:14185:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff94743e2fce00/0xe782b916994fe59a lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe782b916994fe593 expref: 19 pid: 14193 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783965222.393654:0:14185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1783965222.393659:0:14185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9474368d6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:72a5858e-0958-4c77-91cf-d6507b930817+19:3325:x1870622732947584:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783965222.393666:0:14185:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783965222.393671:0:14185:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff947436f27e00/0xe782b916994fe54d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe782b916994fe546 expref: 19 pid: 14193 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965222.393689:0:14185:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff947436f27e00/0xe782b916994fe54d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe782b916994fe546 expref: 19 pid: 14193 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965222.393702:0:14185:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783965222.393863:0:16221:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743706ea00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16221:1870622732947072:0@lo:104: 00000100:00100000:0.0:1783965222.393886:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e29a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:72a5858e-0958-4c77-91cf-d6507b930817:3322:1870622732947328:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783965222.394358:0:16221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff947436f27e00/0xe782b916994fe54d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe782b916994fe546 expref: 19 pid: 14193 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783965222.394372:0:16221:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743706c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16221:1870622732947200:0@lo:104: 00000100:00100000:2.0:1783965222.394399:0:14186:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1783965222.394419:0:14186:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:2.0:1783965222.394455:0:14184:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1783965222.394478:0:14184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783965222.394486:0:14184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94741d457450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:72a5858e-0958-4c77-91cf-d6507b930817+18:3325:x1870622732947456:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1783965222.394501:0:14184:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783965222.394507:0:14184:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff94743e2fce00/0xe782b916994fe59a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0xe782b916994fe593 expref: 18 pid: 14193 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965222.394515:0:14184:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff94743e2fce00/0xe782b916994fe59a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0xe782b916994fe593 expref: 18 pid: 14193 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965222.394526:0:14184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94743e2fce00/0xe782b916994fe59a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0xe782b916994fe593 expref: 18 pid: 14193 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965222.394535:0:14184:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783965222.394573:0:14184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94741d457450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:72a5858e-0958-4c77-91cf-d6507b930817+17:3325:x1870622732947456:12345-0@lo:103:ldlm_bl.0 Request processed in 87us (1019us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965222.394580:0:14184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1783965222.394619:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9474368d5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:72a5858e-0958-4c77-91cf-d6507b930817:3325:1870622732947456:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1783965222.399691:0:14185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9474368d6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:72a5858e-0958-4c77-91cf-d6507b930817+16:3325:x1870622732947584:12345-0@lo:103:ldlm_bl.0 Request processed in 6023us (6201us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965222.399706:0:14185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1783965222.400531:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783965222.400560:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783965222.400582:0:14186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715132928 00000100:00100000:0.0:1783965222.400590:0:14186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715132928 00010000:00010000:0.0:1783965222.400621:0:14186:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff947425975e00/0xe782b916994fe82c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f03a0 expref: 13 pid: 14194 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783965222.400648:0:14186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715133056 00000100:00100000:0.0:1783965222.400661:0:14186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715133056 00010000:00010000:0.0:1783965222.400675:0:14186:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff947305c21200/0xe782b916994fe7f4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f033e expref: 14 pid: 14193 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783965222.400690:0:14186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 7 00000100:00100000:0.0:1783965222.400698:0:14186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e613100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8204b8a1-ddc8-44a4-855e-f8a2831c2700+14:2359:x1870622715132928:12345-192.168.204.12@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783965222.400713:0:14186:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783965222.400718:0:14186:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff947425975e00/0xe782b916994fe82c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f03a0 expref: 14 pid: 14194 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965222.400743:0:14186:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff947425975e00/0xe782b916994fe82c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f03a0 expref: 14 pid: 14194 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965222.400764:0:14186:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783965222.400810:0:14186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e613100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8204b8a1-ddc8-44a4-855e-f8a2831c2700+14:2359:x1870622715132928:12345-192.168.204.12@tcp:103:ldlm_bl.0 Request processed in 112us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965222.400956:0:14186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 7 00000100:00100000:0.0:1783965222.400974:0:14186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 8 00000100:00100000:0.0:1783965222.400981:0:14186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e610700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8204b8a1-ddc8-44a4-855e-f8a2831c2700+13:2360:x1870622715133056:12345-192.168.204.12@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783965222.400989:0:14186:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783965222.400994:0:14186:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff947305c21200/0xe782b916994fe7f4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f033e expref: 13 pid: 14193 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965222.401003:0:14186:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff947305c21200/0xe782b916994fe7f4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f033e expref: 13 pid: 14193 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965222.401016:0:14186:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff94743fb8f600/0xe782b916994fe856 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 16221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965222.401035:0:14186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94743fb8f600/0xe782b916994fe856 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 16221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965222.401054:0:14186:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff94743fb8f600/0xe782b916994fe856 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965222.401061:0:14186:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff94743fb8f600/0xe782b916994fe856 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965222.401067:0:14186:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff94743fb8f600/0xe782b916994fe856 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965222.401074:0:14186:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff94743fb8f600/0xe782b916994fe856 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965222.401080:0:14186:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743fb8f600 already unused, calling callback (ffffffffc168d230) 00010000:00010000:0.0:1783965222.401085:0:14186:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff94743fb8f600/0xe782b916994fe856 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965222.401092:0:14186:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff94743fb8f600/0xe782b916994fe856 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965222.401101:0:14186:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff94743fb8f600/0xe782b916994fe856 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965222.401116:0:14186:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783965222.401138:0:14186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e610700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8204b8a1-ddc8-44a4-855e-f8a2831c2700+13:2360:x1870622715133056:12345-192.168.204.12@tcp:103:ldlm_bl.0 Request processed in 157us (576us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965222.401145:0:14186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 8 00010000:00010000:3.0:1783965222.403592:0:16221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff947425975e00/0xe782b916994fe82c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f03a0 expref: 12 pid: 14194 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783965222.403616:0:16221:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9474368d4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16221:1870622732946688:192.168.204.12@tcp:104: 00010000:00010000:3.0:1783965222.403633:0:16221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff947305c21200/0xe782b916994fe7f4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f033e expref: 11 pid: 14193 timeout: 556 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783965222.403641:0:16221:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743706ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16221:1870622732946816:192.168.204.12@tcp:104: 00010000:00010000:3.0:1783965222.403681:0:16221:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff94743fb8f600/0xe782b916994fe856 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965222.403691:0:16221:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff94743fb8f600/0xe782b916994fe856 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965222.403698:0:16221:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff94743fb8f600/0xe782b916994fe856 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965222.403705:0:16221:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff94743fb8f600/0xe782b916994fe856 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16221 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783965222.405280:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9474368d6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:72a5858e-0958-4c77-91cf-d6507b930817:3325:1870622732947584:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1783965222.447179:0:14187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1783965222.955583:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e299180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3322:1870622732947712:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783965222.955657:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783965222.955722:0:14839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732947712 00000100:00100000:3.0:1783965222.955732:0:14839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732947712 00000100:00100000:3.0:1783965222.955804:0:14839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1783965222.955814:0:14839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947307dc7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1870622732947712:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1783965222.955850:0:14839:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783965222.955912:0:14839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947307dc7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1870622732947712:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965222.955920:0:14839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1783965222.955979:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e299180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3322:1870622732947712:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1783965222.956518:0:14195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1783965223.468619:0:15786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1783965223.597219:0:14196:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1783965223.597229:0:14196:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff947425afb000 from 10 10000000:01000000:2.0:1783965223.597234:0:14196:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783965223.597477:0:14196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.112@tcp lock: ffff947425975a00/0xe782b916994fe85d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965223.597490:0:14196:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.112@tcp lock: ffff947425975a00/0xe782b916994fe85d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965223.597502:0:14196:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.112@tcp lock: ffff947425975a00/0xe782b916994fe85d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783965223.597557:0:14196:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e29a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72a5858e-0958-4c77-91cf-d6507b930817:14196:1870622732947840:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783965223.597626:0:14196:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783965223.597680:0:14196:0:(client.c:2702:ptlrpc_set_wait()) set ffff947405a49f00 going to sleep for 11 seconds 00000100:00100000:3.0:1783965223.597963:0:14192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732947840 00000100:00100000:3.0:1783965223.597971:0:14192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732947840 00000100:00100000:3.0:1783965223.598191:0:14192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1783965223.598221:0:14192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94741cd50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72a5858e-0958-4c77-91cf-d6507b930817+16:14196:x1870622732947840:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1783965223.598235:0:14192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783965223.598252:0:14192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94743fb8f600/0xe782b916994fe864 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0xe782b916994fe85d expref: -99 pid: 14192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965223.598348:0:14192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94743fb8f600/0xe782b916994fe864 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe782b916994fe85d expref: 17 pid: 14192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965223.598361:0:14192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94743fb8f600/0xe782b916994fe864 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe782b916994fe85d expref: 17 pid: 14192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965223.598373:0:14192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94743fb8f600, rc 0) 00000100:00100000:3.0:1783965223.598491:0:14192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94741cd50450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72a5858e-0958-4c77-91cf-d6507b930817+17:14196:x1870622732947840:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 292us (864us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965223.598498:0:14192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:0.0:1783965223.604669:0:14196:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e29a300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72a5858e-0958-4c77-91cf-d6507b930817:14196:1870622732947840:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783965223.604705:0:14196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.112@tcp lock: ffff947425975a00/0xe782b916994fe85d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fe864 expref: -99 pid: 14196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965223.604720:0:14196:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.112@tcp lock: ffff947425975a00/0xe782b916994fe85d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0xe782b916994fe864 expref: -99 pid: 14196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783965223.604824:0:14196:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e613480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72a5858e-0958-4c77-91cf-d6507b930817:14196:1870622732947968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783965223.604896:0:14196:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783965223.604991:0:14196:0:(client.c:2702:ptlrpc_set_wait()) set ffff94740b19d300 going to sleep for 11 seconds 00000100:00100000:2.0:1783965223.605386:0:14194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732947968 00000100:00100000:2.0:1783965223.605394:0:14194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732947968 00000100:00100000:2.0:1783965223.605532:0:14194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1783965223.605543:0:14194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436b8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72a5858e-0958-4c77-91cf-d6507b930817+17:14196:x1870622732947968:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783965223.605948:0:14194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436b8c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72a5858e-0958-4c77-91cf-d6507b930817+17:14196:x1870622732947968:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 407us (1050us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965223.605957:0:14194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1783965223.606493:0:14196:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e613480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72a5858e-0958-4c77-91cf-d6507b930817:14196:1870622732947968:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783965223.606564:0:14196:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947307dc4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72a5858e-0958-4c77-91cf-d6507b930817:14196:1870622732948096:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783965223.606610:0:14196:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783965223.606648:0:14196:0:(client.c:2702:ptlrpc_set_wait()) set ffff94741cee8540 going to sleep for 11 seconds 00000100:00100000:2.0:1783965223.606756:0:14193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732948096 00000100:00100000:2.0:1783965223.606762:0:14193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732948096 00000100:00100000:2.0:1783965223.606801:0:14193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1783965223.606809:0:14193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436b8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72a5858e-0958-4c77-91cf-d6507b930817+17:14196:x1870622732948096:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1783965223.606997:0:14193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436b8e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72a5858e-0958-4c77-91cf-d6507b930817+17:14196:x1870622732948096:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 189us (386us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965223.607004:0:14193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1783965223.607061:0:14196:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947307dc4380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72a5858e-0958-4c77-91cf-d6507b930817:14196:1870622732948096:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1783965223.608725:0:16264:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1783965223.613642:0:14196:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1783965223.613680:0:14196:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783965223.613693:0:14196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.112@tcp lock: ffff947425975a00/0xe782b916994fe85d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fe864 expref: -99 pid: 14196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965223.613705:0:14196:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.112@tcp lock: ffff947425975a00/0xe782b916994fe85d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fe864 expref: -99 pid: 14196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1783965223.613730:0:14196:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1783965223.613732:0:14196:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff947304973000 from 10 10000000:01000000:1.0:1783965223.613735:0:14196:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1783965223.614019:0:14196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.112@tcp lock: ffff94743d9eec00/0xe782b916994fe86b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965223.614100:0:14196:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.112@tcp lock: ffff94743d9eec00/0xe782b916994fe86b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965223.614114:0:14196:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.112@tcp lock: ffff94743d9eec00/0xe782b916994fe86b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783965223.614145:0:14196:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947307dc5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72a5858e-0958-4c77-91cf-d6507b930817:14196:1870622732948224:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1783965223.614399:0:14196:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783965223.614491:0:14196:0:(client.c:2702:ptlrpc_set_wait()) set ffff94741cee8f00 going to sleep for 11 seconds 00000100:00100000:2.0:1783965223.614533:0:14192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732948224 00000100:00100000:2.0:1783965223.614542:0:14192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732948224 00000100:00100000:2.0:1783965223.614709:0:14192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1783965223.614719:0:14192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436b8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72a5858e-0958-4c77-91cf-d6507b930817+17:14196:x1870622732948224:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783965223.614733:0:14192:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783965223.614753:0:14192:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff947425975000/0xe782b916994fe872 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0xe782b916994fe86b expref: -99 pid: 14192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965223.614778:0:14192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff947425975000/0xe782b916994fe872 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe782b916994fe86b expref: 18 pid: 14192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965223.614789:0:14192:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff947425975000/0xe782b916994fe872 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe782b916994fe86b expref: 18 pid: 14192 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965223.614799:0:14192:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff947425975000, rc 0) 00000100:00100000:2.0:1783965223.614857:0:14192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436b8ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:72a5858e-0958-4c77-91cf-d6507b930817+18:14196:x1870622732948224:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 139us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965223.614863:0:14192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1783965223.614951:0:14196:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947307dc5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72a5858e-0958-4c77-91cf-d6507b930817:14196:1870622732948224:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783965223.614968:0:14196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.112@tcp lock: ffff94743d9eec00/0xe782b916994fe86b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fe872 expref: -99 pid: 14196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965223.614978:0:14196:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.112@tcp lock: ffff94743d9eec00/0xe782b916994fe86b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0xe782b916994fe872 expref: -99 pid: 14196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783965223.615046:0:14196:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947307dc5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72a5858e-0958-4c77-91cf-d6507b930817:14196:1870622732948352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783965223.615073:0:14196:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783965223.615508:0:14196:0:(client.c:2702:ptlrpc_set_wait()) set ffff94741cee8f00 going to sleep for 11 seconds 00000100:00100000:0.0:1783965223.615620:0:14193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732948352 00000100:00100000:0.0:1783965223.615625:0:14193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732948352 00000100:00100000:0.0:1783965223.615651:0:14193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1783965223.615658:0:14193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436b8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72a5858e-0958-4c77-91cf-d6507b930817+18:14196:x1870622732948352:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783965223.616153:0:14193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436b8f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72a5858e-0958-4c77-91cf-d6507b930817+18:14196:x1870622732948352:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 494us (1077us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965223.616161:0:14193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1783965223.616405:0:14196:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947307dc5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72a5858e-0958-4c77-91cf-d6507b930817:14196:1870622732948352:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783965223.616456:0:14196:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947307dc5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72a5858e-0958-4c77-91cf-d6507b930817:14196:1870622732948480:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783965223.616503:0:14196:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783965223.616626:0:14196:0:(client.c:2702:ptlrpc_set_wait()) set ffff94741cee8f00 going to sleep for 11 seconds 00000100:00100000:0.0:1783965223.616659:0:14193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732948480 00000100:00100000:0.0:1783965223.616664:0:14193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732948480 00000100:00100000:0.0:1783965223.616697:0:14193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1783965223.616704:0:14193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436b8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72a5858e-0958-4c77-91cf-d6507b930817+18:14196:x1870622732948480:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1783965223.617179:0:14193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436b8f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72a5858e-0958-4c77-91cf-d6507b930817+18:14196:x1870622732948480:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 474us (674us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965223.617186:0:14193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1783965223.617387:0:14196:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947307dc5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72a5858e-0958-4c77-91cf-d6507b930817:14196:1870622732948480:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1783965223.621499:0:16265:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1783965223.621751:0:14196:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1783965223.621776:0:14196:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1783965223.621788:0:14196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.112@tcp lock: ffff94743d9eec00/0xe782b916994fe86b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fe872 expref: -99 pid: 14196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965223.621799:0:14196:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.112@tcp lock: ffff94743d9eec00/0xe782b916994fe86b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fe872 expref: -99 pid: 14196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1783965223.621810:0:14196:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1783965223.621813:0:14196:0:(mgc_request.c:1801:mgc_process_log()) Process log params-ffff94743fbe4800 from 10 10000000:01000000:2.0:1783965223.621816:0:14196:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1783965223.621852:0:14196:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.204.112@tcp lock: ffff947425975c00/0xe782b916994fe879 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965223.621860:0:14196:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.204.112@tcp lock: ffff947425975c00/0xe782b916994fe879 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965223.621871:0:14196:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.204.112@tcp lock: ffff947425975c00/0xe782b916994fe879 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783965223.622099:0:14196:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e298380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72a5858e-0958-4c77-91cf-d6507b930817:14196:1870622732948608:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1783965223.622165:0:14196:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783965223.622236:0:14196:0:(client.c:2702:ptlrpc_set_wait()) set ffff947405a49540 going to sleep for 11 seconds 00000100:00100000:0.0:1783965223.622363:0:14194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732948608 00000100:00100000:0.0:1783965223.622377:0:14194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732948608 00000100:00100000:0.0:1783965223.622463:0:14194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1783965223.622473:0:14194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436b8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72a5858e-0958-4c77-91cf-d6507b930817+18:14196:x1870622732948608:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783965223.622486:0:14194:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783965223.622499:0:14194:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff947305c20c00/0xe782b916994fe880 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0xe782b916994fe879 expref: -99 pid: 14194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965223.622525:0:14194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff947305c20c00/0xe782b916994fe880 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0xe782b916994fe879 expref: 19 pid: 14194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965223.622631:0:14194:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff947305c20c00/0xe782b916994fe880 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0xe782b916994fe879 expref: 19 pid: 14194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965223.622643:0:14194:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff947305c20c00, rc 0) 00000100:00100000:0.0:1783965223.622726:0:14194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436b8e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72a5858e-0958-4c77-91cf-d6507b930817+19:14196:x1870622732948608:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 254us (560us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965223.622734:0:14194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1783965223.622802:0:14196:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e298380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72a5858e-0958-4c77-91cf-d6507b930817:14196:1870622732948608:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1783965223.622818:0:14196:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.204.112@tcp lock: ffff947425975c00/0xe782b916994fe879 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fe880 expref: -99 pid: 14196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965223.622826:0:14196:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.204.112@tcp lock: ffff947425975c00/0xe782b916994fe879 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0xe782b916994fe880 expref: -99 pid: 14196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783965223.622875:0:14196:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e298380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72a5858e-0958-4c77-91cf-d6507b930817:14196:1870622732948736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1783965223.622910:0:14196:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783965223.623021:0:14196:0:(client.c:2702:ptlrpc_set_wait()) set ffff947405a49540 going to sleep for 11 seconds 00000100:00100000:0.0:1783965223.623176:0:14193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732948736 00000100:00100000:0.0:1783965223.623182:0:14193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732948736 00000100:00100000:0.0:1783965223.623288:0:14193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1783965223.623296:0:14193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436b8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72a5858e-0958-4c77-91cf-d6507b930817+19:14196:x1870622732948736:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783965223.623703:0:14193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436b8f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72a5858e-0958-4c77-91cf-d6507b930817+19:14196:x1870622732948736:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 407us (790us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965223.623710:0:14193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1783965223.624935:0:14196:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e298380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72a5858e-0958-4c77-91cf-d6507b930817:14196:1870622732948736:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783965223.624990:0:14196:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947307dc5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72a5858e-0958-4c77-91cf-d6507b930817:14196:1870622732948864:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783965223.625049:0:14196:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783965223.625079:0:14196:0:(client.c:2702:ptlrpc_set_wait()) set ffff94741cee8f00 going to sleep for 11 seconds 00000100:00100000:1.0:1783965223.625095:0:14194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732948864 00000100:00100000:1.0:1783965223.625100:0:14194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732948864 00000100:00100000:1.0:1783965223.625136:0:14194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:1.0:1783965223.625145:0:14194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436b8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72a5858e-0958-4c77-91cf-d6507b930817+19:14196:x1870622732948864:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783965223.626105:0:14194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436b8e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72a5858e-0958-4c77-91cf-d6507b930817+19:14196:x1870622732948864:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 958us (1053us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965223.626115:0:14194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1783965223.626140:0:14196:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947307dc5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:72a5858e-0958-4c77-91cf-d6507b930817:14196:1870622732948864:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1783965223.630344:0:16269:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1783965223.630617:0:14196:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1783965223.630640:0:14196:0:(mgc_request.c:1878:mgc_process_log()) MGC192.168.204.112@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1783965223.630651:0:14196:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.204.112@tcp lock: ffff947425975c00/0xe782b916994fe879 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fe880 expref: -99 pid: 14196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965223.630663:0:14196:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.204.112@tcp lock: ffff947425975c00/0xe782b916994fe879 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0xe782b916994fe880 expref: -99 pid: 14196 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783965223.741289:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783965223.747821:0:14193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715133184 00000100:00100000:0.0:1783965223.747849:0:14193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715133184 00000100:00100000:0.0:1783965223.747942:0:14193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 113 00000100:00100000:0.0:1783965223.747955:0:14193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436b8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8204b8a1-ddc8-44a4-855e-f8a2831c2700+11:13707:x1870622715133184:12345-192.168.204.12@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1783965223.747973:0:14193:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783965223.747993:0:14193:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff947305c20400/0xe782b916994fe887 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5f03d1 expref: -99 pid: 14193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965223.748025:0:14193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff947305c20400/0xe782b916994fe887 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f03d1 expref: 12 pid: 14193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965223.748036:0:14193:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff947305c20400/0xe782b916994fe887 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f03d1 expref: 12 pid: 14193 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965223.748046:0:14193:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff947305c20400, rc 0) 00000100:00100000:0.0:1783965223.748121:0:14193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436b8d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8204b8a1-ddc8-44a4-855e-f8a2831c2700+12:13707:x1870622715133184:12345-192.168.204.12@tcp:101:ll_cfg_requeue.0 Request processed in 169us (6843us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965223.748129:0:14193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 113 00000100:00100000:3.0:1783965223.752520:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965223.753431:0:14192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715133312 00000100:00100000:1.0:1783965223.753607:0:14192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715133312 00000100:00100000:1.0:1783965223.755881:0:14192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 114 00000100:00100000:1.0:1783965223.755901:0:14192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436b8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8204b8a1-ddc8-44a4-855e-f8a2831c2700+12:13707:x1870622715133312:12345-192.168.204.12@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1783965223.756227:0:14192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436b8dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8204b8a1-ddc8-44a4-855e-f8a2831c2700+12:13707:x1870622715133312:12345-192.168.204.12@tcp:501:ll_cfg_requeue.0 Request processed in 331us (3713us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965223.756236:0:14192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 114 00000100:00100000:0.0:1783965223.762799:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965223.762925:0:14193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715133440 00000100:00100000:1.0:1783965223.762936:0:14193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715133440 00000100:00100000:1.0:1783965223.762985:0:14193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 115 00000100:00100000:1.0:1783965223.762995:0:14193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436b8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8204b8a1-ddc8-44a4-855e-f8a2831c2700+12:13707:x1870622715133440:12345-192.168.204.12@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1783965223.763237:0:14193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436b8d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8204b8a1-ddc8-44a4-855e-f8a2831c2700+12:13707:x1870622715133440:12345-192.168.204.12@tcp:503:ll_cfg_requeue.0 Request processed in 242us (446us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965223.763245:0:14193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 115 00000100:00100000:2.0:1783965223.773197:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965223.774322:0:14194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715133568 00000100:00100000:1.0:1783965223.774333:0:14194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715133568 00000100:00100000:1.0:1783965223.774381:0:14194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 116 00000100:00100000:1.0:1783965223.774391:0:14194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436b8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8204b8a1-ddc8-44a4-855e-f8a2831c2700+12:13707:x1870622715133568:12345-192.168.204.12@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1783965223.774407:0:14194:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783965223.774424:0:14194:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff94743d9ef000/0xe782b916994fe88e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5f03d8 expref: -99 pid: 14194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965223.774473:0:14194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff94743d9ef000/0xe782b916994fe88e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f03d8 expref: 13 pid: 14194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965223.774485:0:14194:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff94743d9ef000/0xe782b916994fe88e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f03d8 expref: 13 pid: 14194 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965223.774494:0:14194:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94743d9ef000, rc 0) 00000100:00100000:1.0:1783965223.774555:0:14194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436b8fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:8204b8a1-ddc8-44a4-855e-f8a2831c2700+13:13707:x1870622715133568:12345-192.168.204.12@tcp:101:ll_cfg_requeue.0 Request processed in 164us (1619us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965223.774569:0:14194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 116 00000100:00100000:2.0:1783965223.778857:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783965223.779395:0:14193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715133696 00000100:00100000:0.0:1783965223.779405:0:14193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715133696 00000100:00100000:0.0:1783965223.779606:0:14193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 117 00000100:00100000:0.0:1783965223.779617:0:14193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436b8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8204b8a1-ddc8-44a4-855e-f8a2831c2700+13:13707:x1870622715133696:12345-192.168.204.12@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1783965223.780648:0:14193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436b8c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:8204b8a1-ddc8-44a4-855e-f8a2831c2700+13:13707:x1870622715133696:12345-192.168.204.12@tcp:501:ll_cfg_requeue.0 Request processed in 1026us (1796us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965223.780660:0:14193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 117 00000100:00100000:0.0:1783965223.786111:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965223.786309:0:14192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715133824 00000100:00100000:3.0:1783965223.786322:0:14192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715133824 00000100:00100000:3.0:1783965223.786413:0:14192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 118 00000100:00100000:3.0:1783965223.786423:0:14192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436b8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8204b8a1-ddc8-44a4-855e-f8a2831c2700+13:13707:x1870622715133824:12345-192.168.204.12@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1783965223.786675:0:14192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436b8c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8204b8a1-ddc8-44a4-855e-f8a2831c2700+13:13707:x1870622715133824:12345-192.168.204.12@tcp:503:ll_cfg_requeue.0 Request processed in 252us (572us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965223.786684:0:14192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 118 00010000:00010000:3.0:1783965224.491367:0:14188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1783965225.003725:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1783965225.003761:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e298a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3322:1870622732948992:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1783965225.003877:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783965225.004299:0:14839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732948992 00000100:00100000:3.0:1783965225.004311:0:14839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732948992 00000100:00100000:3.0:1783965225.004396:0:14839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1783965225.004407:0:14839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e613b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1870622732948992:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783965225.004461:0:14839:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1783965225.004527:0:14839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e613b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3322:x1870622732948992:12345-0@lo:13:osp-pre-1-0.0 Request processed in 122us (650us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965225.004535:0:14839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1783965225.004603:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e298a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3322:1870622732948992:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1783965225.007264:0:14195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783965225.007550:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e29a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3322:1870622732949376:0@lo:400:kworker.0 00000100:00100000:1.0:1783965225.007652:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783965225.007786:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e298380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3325:1870622732949248:0@lo:400:kworker.0 00000100:00100000:3.0:1783965225.007828:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783965225.007874:0:3325:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1783965225.007881:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e298a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:72a5858e-0958-4c77-91cf-d6507b930817:3325:1870622732949120:0@lo:400:kworker.0 00000100:00100000:3.0:1783965225.007928:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783965225.007961:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e299180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3323:1870622732949504:0@lo:400:kworker.0 00000100:00100000:3.0:1783965225.007986:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783965225.008046:0:14835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732949248 00000100:00100000:3.0:1783965225.008071:0:14835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732949248 00000100:00100000:3.0:1783965225.008138:0:14835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1783965225.008148:0:14835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9474368d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3325:x1870622732949248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783965225.008230:0:14835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9474368d4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3325:x1870622732949248:12345-0@lo:400:kworker.0 Request processed in 83us (400us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965225.008238:0:14835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00080000:3.0:1783965225.008269:0:14195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1783965225.008302:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e298380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3325:1870622732949248:0@lo:400:kworker.0 00000100:00100000:3.0:1783965225.008335:0:15978:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732949376 00000100:00100000:3.0:1783965225.008339:0:15978:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732949376 00000100:00100000:3.0:1783965225.008364:0:15978:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732949504 00000100:00100000:3.0:1783965225.008368:0:15978:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732949504 00000100:00100000:3.0:1783965225.008392:0:15978:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1783965225.008398:0:15978:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947307dc5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3322:x1870622732949376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783965225.010484:0:14193:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732949120 00000100:00100000:0.0:1783965225.010502:0:14193:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732949120 00000100:00100000:0.0:1783965225.010585:0:14193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1783965225.010597:0:14193:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94741cd56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72a5858e-0958-4c77-91cf-d6507b930817+19:3325:x1870622732949120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783965225.010704:0:14193:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94741cd56450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:72a5858e-0958-4c77-91cf-d6507b930817+19:3325:x1870622732949120:12345-0@lo:400:kworker.0 Request processed in 110us (2787us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965225.010711:0:14193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1783965225.010784:0:14199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1783965225.010794:0:14199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9474368d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3323:x1870622732949504:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783965225.010839:0:14199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9474368d7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3323:x1870622732949504:12345-0@lo:400:kworker.0 Request processed in 46us (2852us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965225.010845:0:14199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1783965225.010904:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e299180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3323:1870622732949504:0@lo:400:kworker.0 00000100:00080000:0.0:1783965225.010971:0:14195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1783965225.011000:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e298a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:72a5858e-0958-4c77-91cf-d6507b930817:3325:1870622732949120:0@lo:400:kworker.0 00000100:00100000:2.0:1783965225.017109:0:3325:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1783965225.017143:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e298a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3325:1870622732949632:0@lo:400:kworker.0 00000100:00100000:2.0:1783965225.017282:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1783965225.017356:0:14199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732949632 00000100:00100000:0.0:1783965225.017369:0:14199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732949632 00000100:00100000:0.0:1783965225.017460:0:14199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1783965225.017472:0:14199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e299180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3325:x1870622732949632:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1783965225.017541:0:14199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e299180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3325:x1870622732949632:12345-0@lo:400:kworker.0 Request processed in 71us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965225.017550:0:14199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:2.0:1783965225.018390:0:14195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1783965225.018515:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e298a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3325:1870622732949632:0@lo:400:kworker.0 00000100:00100000:3.0:1783965225.022110:0:15978:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947307dc5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3322:x1870622732949376:12345-0@lo:400:kworker.0 Request processed in 13693us (14440us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965225.022131:0:15978:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1783965225.024345:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e29a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3322:1870622732949376:0@lo:400:kworker.0 00010000:00010000:3.0:1783965225.519508:0:14187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783965226.232517:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783965226.232955:0:14200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715133952 00000100:00100000:0.0:1783965226.232973:0:14200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715133952 00000100:00100000:0.0:1783965226.233168:0:14200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 15 00000100:00100000:0.0:1783965226.233184:0:14200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9474368d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2c21b91-f3be-4bc4-8944-f5766379921b+6:14369:x1870622715133952:12345-192.168.204.12@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1783965226.233264:0:14200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783965226.233295:0:14200:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947305c20600/0xe782b916994fe895 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5f03df expref: -99 pid: 14200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965226.233404:0:14200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff947305c21000/0xe782b916994fe89c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965226.233431:0:14200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947305c21000/0xe782b916994fe89c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965226.233448:0:14200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947305c21000/0xe782b916994fe89c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965226.233467:0:14200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff947305c21200/0xe782b916994fe8a3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965226.233475:0:14200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947305c21200/0xe782b916994fe8a3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965226.233483:0:14200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947305c21200/0xe782b916994fe8a3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14200 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1783965226.233755:0:14195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1783965226.235039:0:14200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff947305c21600/0xe782b916994fe8aa lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965226.235062:0:14200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947305c21600/0xe782b916994fe8aa lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965226.235074:0:14200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947305c21600/0xe782b916994fe8aa lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14200 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783965226.235187:0:14200:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1783965226.235192:0:14200:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1783965226.240225:0:14200:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff947305c21600/0xe782b916994fe8aa lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965226.240260:0:14200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff947305c21000/0xe782b916994fe89c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965226.240268:0:14200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff947305c21000/0xe782b916994fe89c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965226.240277:0:14200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff947305c21000/0xe782b916994fe89c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965226.240283:0:14200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947305c21000 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1783965226.240288:0:14200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947305c21000/0xe782b916994fe89c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965226.240296:0:14200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947305c21000/0xe782b916994fe89c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965226.240317:0:14200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff947409a45600) 00010000:00010000:0.0:1783965226.240320:0:14200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783965226.240327:0:14200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff947305c21000/0xe782b916994fe89c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965226.240333:0:14200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947305c21000/0xe782b916994fe89c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965226.240349:0:14200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff947305c21200/0xe782b916994fe8a3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965226.240368:0:14200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff947305c21200/0xe782b916994fe8a3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965226.240374:0:14200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff947305c21200/0xe782b916994fe8a3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965226.240379:0:14200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947305c21200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1783965226.240382:0:14200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947305c21200/0xe782b916994fe8a3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965226.240402:0:14200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947305c21200/0xe782b916994fe8a3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965226.240412:0:14200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff947409a45400) 00010000:00010000:0.0:1783965226.240415:0:14200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783965226.240418:0:14200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff947305c21200/0xe782b916994fe8a3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965226.240432:0:14200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947305c21200/0xe782b916994fe8a3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965226.240495:0:14200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947305c20600/0xe782b916994fe895 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f03df expref: 8 pid: 14200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965226.240511:0:14200:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff947305c21600/0xe782b916994fe8aa lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f03df expref: 7 pid: 14200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965226.240520:0:14200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff947409a45900) 00010000:00010000:0.0:1783965226.240522:0:14200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783965226.240532:0:14200:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff947305c21600, rc 0) 00000100:00100000:0.0:1783965226.243135:0:14200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9474368d6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2c21b91-f3be-4bc4-8944-f5766379921b+7:14369:x1870622715133952:12345-192.168.204.12@tcp:101:lhsmtool_posix.0 Request processed in 9938us (10609us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965226.243153:0:14200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 15 00000100:00100000:0.0:1783965226.259347:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965226.259593:0:14201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715134208 00000100:00100000:2.0:1783965226.259607:0:14201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715134208 00000100:00100000:2.0:1783965226.259704:0:14201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 16 00000100:00100000:2.0:1783965226.259717:0:14201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e610a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2c21b91-f3be-4bc4-8944-f5766379921b+7:14369:x1870622715134208:12345-192.168.204.12@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783965226.259766:0:14201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783965226.259796:0:14201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947425975800/0xe782b916994fe8b1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5f03e6 expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965226.259900:0:14201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff947425974600/0xe782b916994fe8b8 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965226.259919:0:14201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947425974600/0xe782b916994fe8b8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965226.259933:0:14201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947425974600/0xe782b916994fe8b8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965226.260086:0:14201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff947425975600/0xe782b916994fe8bf lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965226.260111:0:14201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947425975600/0xe782b916994fe8bf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965226.260125:0:14201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947425975600/0xe782b916994fe8bf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965226.262866:0:14201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff947425974200/0xe782b916994fe8c6 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965226.262907:0:14201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947425974200/0xe782b916994fe8c6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965226.263062:0:14201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947425974200/0xe782b916994fe8c6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783965226.263083:0:14201:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:3.0:1783965226.266222:0:14201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff947425974600/0xe782b916994fe8b8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965226.266246:0:14201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff947425974600/0xe782b916994fe8b8 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965226.266256:0:14201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff947425974600/0xe782b916994fe8b8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965226.266265:0:14201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947425974600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1783965226.266279:0:14201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947425974600/0xe782b916994fe8b8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965226.266289:0:14201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947425974600/0xe782b916994fe8b8 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965226.266313:0:14201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff947409a45900) 00010000:00010000:3.0:1783965226.266317:0:14201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783965226.266324:0:14201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff947425974600/0xe782b916994fe8b8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965226.266332:0:14201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947425974600/0xe782b916994fe8b8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965226.266350:0:14201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff947425975600/0xe782b916994fe8bf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965226.266357:0:14201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff947425975600/0xe782b916994fe8bf lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965226.266363:0:14201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff947425975600/0xe782b916994fe8bf lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965226.266368:0:14201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947425975600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1783965226.266371:0:14201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947425975600/0xe782b916994fe8bf lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965226.266377:0:14201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947425975600/0xe782b916994fe8bf lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965226.266398:0:14201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff947402a2d400) 00010000:00010000:3.0:1783965226.266401:0:14201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783965226.266411:0:14201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff947425975600/0xe782b916994fe8bf lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965226.266417:0:14201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947425975600/0xe782b916994fe8bf lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965226.270196:0:14201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947425975800/0xe782b916994fe8b1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f03e6 expref: 10 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965226.270255:0:14201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff947425974200/0xe782b916994fe8c6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f03e6 expref: 9 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965226.270266:0:14201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff947402a2da00) 00010000:00010000:3.0:1783965226.270270:0:14201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783965226.270275:0:14201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff947425974200, rc 0) 00000100:00100000:3.0:1783965226.270405:0:14201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e610a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2c21b91-f3be-4bc4-8944-f5766379921b+9:14369:x1870622715134208:12345-192.168.204.12@tcp:101:lhsmtool_posix.0 Request processed in 10689us (11074us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1783965226.270418:0:14201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 16 00000100:00100000:2.0:1783965226.281762:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965226.281937:0:14199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715134336 00000100:00100000:1.0:1783965226.281951:0:14199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715134336 00000100:00100000:1.0:1783965226.282032:0:14199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 17 00000100:00100000:1.0:1783965226.282044:0:14199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e298a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2c21b91-f3be-4bc4-8944-f5766379921b+9:14369:x1870622715134336:12345-192.168.204.12@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1783965226.282248:0:14199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e298a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2c21b91-f3be-4bc4-8944-f5766379921b+9:14369:x1870622715134336:12345-192.168.204.12@tcp:59:lhsmtool_posix.0 Request processed in 204us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965226.282256:0:14199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 17 00000100:00100000:2.0:1783965226.313707:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965226.314325:0:15978:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715134464 00000100:00100000:3.0:1783965226.314342:0:15978:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715134464 00000100:00100000:3.0:1783965226.314901:0:15978:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 18 00000100:00100000:3.0:1783965226.314988:0:15978:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e298380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2c21b91-f3be-4bc4-8944-f5766379921b+9:14375:x1870622715134464:12345-192.168.204.12@tcp:101:lfs.0 00010000:00010000:3.0:1783965226.315018:0:15978:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783965226.315048:0:15978:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8ea00/0xe782b916994fe8d4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5f03ed expref: -99 pid: 15978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965226.315142:0:15978:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fa00/0xe782b916994fe8db lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965226.315186:0:15978:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fa00/0xe782b916994fe8db lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965226.315243:0:15978:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fa00/0xe782b916994fe8db lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965226.315265:0:15978:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f400/0xe782b916994fe8e2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965226.315273:0:15978:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f400/0xe782b916994fe8e2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965226.315280:0:15978:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f400/0xe782b916994fe8e2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965226.315934:0:15978:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fa00/0xe782b916994fe8db lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965226.315948:0:15978:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fa00/0xe782b916994fe8db lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965226.315956:0:15978:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fa00/0xe782b916994fe8db lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965226.315963:0:15978:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743fb8fa00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1783965226.315969:0:15978:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fa00/0xe782b916994fe8db lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965226.315978:0:15978:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fa00/0xe782b916994fe8db lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965226.315997:0:15978:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff947409a45600) 00010000:00010000:2.0:1783965226.316001:0:15978:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783965226.316007:0:15978:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fa00/0xe782b916994fe8db lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965226.316015:0:15978:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8fa00/0xe782b916994fe8db lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965226.316029:0:15978:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f400/0xe782b916994fe8e2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965226.316036:0:15978:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f400/0xe782b916994fe8e2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965226.316041:0:15978:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f400/0xe782b916994fe8e2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965226.316053:0:15978:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743fb8f400 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1783965226.316056:0:15978:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f400/0xe782b916994fe8e2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965226.316062:0:15978:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f400/0xe782b916994fe8e2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965226.316072:0:15978:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9474130d6200) 00010000:00010000:2.0:1783965226.316075:0:15978:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783965226.316077:0:15978:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f400/0xe782b916994fe8e2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965226.316084:0:15978:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f400/0xe782b916994fe8e2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965226.316132:0:15978:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8ea00/0xe782b916994fe8d4 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f03ed expref: 10 pid: 15978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965226.316145:0:15978:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff947409a45600) 00010000:00010000:2.0:1783965226.316147:0:15978:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783965226.316151:0:15978:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8ea00/0xe782b916994fe8d4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f03ed expref: 10 pid: 15978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965226.316161:0:15978:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94743fb8ea00, rc 0) 00000100:00100000:2.0:1783965226.316354:0:15978:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e298380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2c21b91-f3be-4bc4-8944-f5766379921b+9:14375:x1870622715134464:12345-192.168.204.12@tcp:101:lfs.0 Request processed in 1379us (2659us total) trans 0 rc 301/301 00000100:00100000:2.0:1783965226.316364:0:15978:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 18 00000100:00100000:2.0:1783965226.327372:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783965226.327920:0:14208:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715134592 00000100:00100000:0.0:1783965226.327936:0:14208:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715134592 00000100:00100000:0.0:1783965226.328018:0:14208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 0 00000100:00100000:0.0:1783965226.328030:0:14208:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e29a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:b2c21b91-f3be-4bc4-8944-f5766379921b+9:14375:x1870622715134592:12345-192.168.204.12@tcp:700:lfs.0 00000100:00100000:0.0:1783965226.328192:0:14208:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e29a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:b2c21b91-f3be-4bc4-8944-f5766379921b+9:14375:x1870622715134592:12345-192.168.204.12@tcp:700:lfs.0 Request processed in 163us (835us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965226.328253:0:14208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 0 00000100:00100000:1.0:1783965226.336346:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783965226.336880:0:14199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715134848 00000100:00100000:0.0:1783965226.336895:0:14199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715134848 00000100:00100000:0.0:1783965226.337108:0:14199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 19 00000100:00100000:0.0:1783965226.337120:0:14199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947307dc4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2c21b91-f3be-4bc4-8944-f5766379921b+9:14375:x1870622715134848:12345-192.168.204.12@tcp:36:lfs.0 00010000:00010000:0.0:1783965226.337261:0:14199:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783965226.337300:0:14199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947305c20200/0xe782b916994fe817 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0368 expref: 9 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965226.337326:0:14199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff947409a45600) 00010000:00010000:0.0:1783965226.337333:0:14199:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783965226.338399:0:14199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff947305c20600/0xe782b916994fe8e9 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965226.338542:0:14199:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e800/0xe782b916994fe84f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f03ca expref: 5 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965226.338568:0:14199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff947305c20600/0xe782b916994fe8e9 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965226.338625:0:14199:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e800/0xe782b916994fe84f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f03ca expref: 5 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965226.340334:0:14199:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e800/0xe782b916994fe84f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f03ca expref: 5 pid: 14201 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783965226.340367:0:14199:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e613800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14199:1870622732949760:192.168.204.12@tcp:104: 00000100:00100000:0.0:1783965226.340974:0:14199:0:(client.c:2702:ptlrpc_set_wait()) set ffff947425854b40 going to sleep for 11 seconds 00000100:00100000:2.0:1783965226.346583:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965226.346761:0:14184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715134976 00000100:00100000:1.0:1783965226.346775:0:14184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715134976 00010000:00010000:1.0:1783965226.346856:0:14184:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e800/0xe782b916994fe84f lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f03ca expref: 6 pid: 14201 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783965226.346920:0:14184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 9 00000100:00100000:1.0:1783965226.346932:0:14184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947429f47480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d42e9324-0c5a-4045-80ff-e53d47e8c2f0+6:2359:x1870622715134976:12345-192.168.204.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783965226.346952:0:14184:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783965226.346960:0:14184:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e800/0xe782b916994fe84f lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f03ca expref: 6 pid: 14201 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965226.346977:0:14184:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e800/0xe782b916994fe84f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f03ca expref: 6 pid: 14201 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965226.347026:0:14184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff947409a45600) 00010000:00010000:0.0:1783965226.347031:0:14199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e800/0xe782b916994fe84f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f03ca expref: 6 pid: 14201 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965226.347033:0:14184:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff947305c20600/0xe782b916994fe8e9 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965226.347044:0:14184:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff947305c20600/0xe782b916994fe8e9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50290000000000 pid: 14199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965226.347053:0:14184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947305c20600/0xe782b916994fe8e9 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50290000000000 pid: 14199 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783965226.347053:0:14199:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e613800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14199:1870622732949760:192.168.204.12@tcp:104: 00010000:00010000:1.0:1783965226.347074:0:14184:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783965226.347086:0:14199:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff947305c20600/0xe782b916994fe8e9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965226.347096:0:14199:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff947305c20600/0xe782b916994fe8e9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965226.347102:0:14199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947305c20600/0xe782b916994fe8e9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965226.347130:0:14199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff947305c20200/0xe782b916994fe8f0 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965226.347140:0:14199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947305c20200/0xe782b916994fe8f0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14199 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783965226.347142:0:14184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947429f47480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:d42e9324-0c5a-4045-80ff-e53d47e8c2f0+5:2359:x1870622715134976:12345-192.168.204.12@tcp:103:ldlm_bl.0 Request processed in 213us (578us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965226.347151:0:14184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 9 00010000:00010000:0.0:1783965226.347155:0:14199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947305c20200/0xe782b916994fe8f0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14199 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783965226.351230:0:14199:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:0.0:1783965226.351261:0:14199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff947305c20600/0xe782b916994fe8e9 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965226.351275:0:14199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff947305c20600/0xe782b916994fe8e9 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965226.351284:0:14199:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff947305c20600/0xe782b916994fe8e9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965226.351290:0:14199:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947305c20600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1783965226.351298:0:14199:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947305c20600/0xe782b916994fe8e9 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965226.351306:0:14199:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947305c20600/0xe782b916994fe8e9 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965226.351328:0:14199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff947409a45600) 00010000:00010000:0.0:1783965226.351331:0:14199:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783965226.351336:0:14199:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff947305c20600/0xe782b916994fe8e9 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965226.351342:0:14199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947305c20600/0xe782b916994fe8e9 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14199 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783965226.351367:0:14199:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008cb79999 reply state 00000000e626c688 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff947305c20200/0xe782b916994fe8f0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14199 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783965226.351399:0:14199:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783965226.351546:0:14199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947307dc4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2c21b91-f3be-4bc4-8944-f5766379921b+10:14375:x1870622715134848:12345-192.168.204.12@tcp:36:lfs.0 Request processed in 14421us (15216us total) trans 8589934594 rc 0/0 00000100:00100000:0.0:1783965226.351558:0:14199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 19 00000100:00080000:2.0:1783965226.353721:0:14195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1783965226.363163:0:3308:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff947305c20200/0xe782b916994fe8f0 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965226.363187:0:3308:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff947305c20200/0xe782b916994fe8f0 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965226.363196:0:3308:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff947305c20200/0xe782b916994fe8f0 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965226.363251:0:3308:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947305c20200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1783965226.363256:0:3308:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947305c20200/0xe782b916994fe8f0 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965226.363266:0:3308:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947305c20200/0xe782b916994fe8f0 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965226.363307:0:3308:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff947409a45400) 00010000:00010000:3.0:1783965226.363310:0:3308:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783965226.363316:0:3308:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff947305c20200/0xe782b916994fe8f0 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965226.363323:0:3308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947305c20200/0xe782b916994fe8f0 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14199 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783965226.453103:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783965226.453236:0:14201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715135104 00000100:00100000:0.0:1783965226.453250:0:14201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715135104 00000100:00100000:0.0:1783965226.453337:0:14201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 20 00000100:00100000:0.0:1783965226.453350:0:14201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947307dc6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2c21b91-f3be-4bc4-8944-f5766379921b+9:14383:x1870622715135104:12345-192.168.204.12@tcp:101:lctl.0 00010000:00010000:0.0:1783965226.453395:0:14201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783965226.453427:0:14201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947305c20600/0xe782b916994fe8f7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5f03f4 expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965226.453522:0:14201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff947305c21200/0xe782b916994fe8fe lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965226.453540:0:14201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947305c21200/0xe782b916994fe8fe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965226.453555:0:14201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947305c21200/0xe782b916994fe8fe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783965226.453649:0:14201:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1783965226.453655:0:14201:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:0.0:1783965226.453709:0:14201:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff947305c21200/0xe782b916994fe8fe lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965226.453739:0:14201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947305c20600/0xe782b916994fe8f7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f03f4 expref: 11 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965226.453788:0:14201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff947305c21200/0xe782b916994fe8fe lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f03f4 expref: 10 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965226.453799:0:14201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff947409a45600) 00010000:00010000:0.0:1783965226.453802:0:14201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783965226.453806:0:14201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff947305c21200, rc 0) 00000100:00100000:0.0:1783965226.453888:0:14201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947307dc6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2c21b91-f3be-4bc4-8944-f5766379921b+10:14383:x1870622715135104:12345-192.168.204.12@tcp:101:lctl.0 Request processed in 540us (798us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965226.453897:0:14201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 20 00000100:00100000:2.0:1783965226.486707:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783965226.490036:0:14200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715135232 00000100:00100000:0.0:1783965226.490059:0:14200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715135232 00000100:00100000:0.0:1783965226.490174:0:14200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 21 00000100:00100000:0.0:1783965226.490189:0:14200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947429f44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d42e9324-0c5a-4045-80ff-e53d47e8c2f0+5:14384:x1870622715135232:12345-192.168.204.12@tcp:101:lfs.0 00010000:00010000:0.0:1783965226.490239:0:14200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783965226.490271:0:14200:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947305c20600/0xe782b916994fe905 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5f03fb expref: -99 pid: 14200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965226.490362:0:14200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff947305c21000/0xe782b916994fe90c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965226.490391:0:14200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947305c21000/0xe782b916994fe90c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965226.490406:0:14200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947305c21000/0xe782b916994fe90c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14200 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783965226.492365:0:14200:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1783965226.492404:0:14200:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:0.0:1783965226.492446:0:14200:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff947305c21000/0xe782b916994fe90c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965226.492500:0:14200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947305c20600/0xe782b916994fe905 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f03fb expref: 7 pid: 14200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965226.492527:0:14200:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff947305c21000/0xe782b916994fe90c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f03fb expref: 6 pid: 14200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965226.492539:0:14200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff947409a45600) 00010000:00010000:0.0:1783965226.492543:0:14200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783965226.492547:0:14200:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff947305c21000, rc 0) 00000100:00100000:0.0:1783965226.492739:0:14200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947429f44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d42e9324-0c5a-4045-80ff-e53d47e8c2f0+6:14384:x1870622715135232:12345-192.168.204.12@tcp:101:lfs.0 Request processed in 2551us (6047us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965226.492750:0:14200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 21 00000100:00100000:3.0:1783965226.497937:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965226.498151:0:15978:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715135360 00000100:00100000:2.0:1783965226.498166:0:15978:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715135360 00000100:00100000:2.0:1783965226.498270:0:15978:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 22 00000100:00100000:2.0:1783965226.498285:0:15978:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9474368d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d42e9324-0c5a-4045-80ff-e53d47e8c2f0+6:14384:x1870622715135360:12345-192.168.204.12@tcp:101:lfs.0 00010000:00010000:2.0:1783965226.498324:0:15978:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783965226.498357:0:15978:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947425974600/0xe782b916994fe913 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5f0402 expref: -99 pid: 15978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965226.498460:0:15978:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff947425975e00/0xe782b916994fe91a lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965226.498480:0:15978:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947425975e00/0xe782b916994fe91a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965226.498495:0:15978:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947425975e00/0xe782b916994fe91a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965226.498513:0:15978:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff947425974800/0xe782b916994fe921 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965226.498520:0:15978:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947425974800/0xe782b916994fe921 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965226.498527:0:15978:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947425974800/0xe782b916994fe921 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965226.499144:0:15978:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff947425975200/0xe782b916994fe928 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965226.499276:0:15978:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947425975200/0xe782b916994fe928 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965226.499294:0:15978:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947425975200/0xe782b916994fe928 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783965226.499393:0:15978:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:2.0:1783965226.499398:0:15978:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1783965226.499430:0:15978:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff947425975200/0xe782b916994fe928 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965226.499444:0:15978:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff947425975e00/0xe782b916994fe91a lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965226.499451:0:15978:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff947425975e00/0xe782b916994fe91a lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965226.499458:0:15978:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff947425975e00/0xe782b916994fe91a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965226.499464:0:15978:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947425975e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1783965226.499467:0:15978:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947425975e00/0xe782b916994fe91a lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965226.499474:0:15978:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947425975e00/0xe782b916994fe91a lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965226.499486:0:15978:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff947409a45600) 00010000:00010000:2.0:1783965226.499490:0:15978:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783965226.499494:0:15978:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff947425975e00/0xe782b916994fe91a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965226.499511:0:15978:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947425975e00/0xe782b916994fe91a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965226.499532:0:15978:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff947425974800/0xe782b916994fe921 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965226.499539:0:15978:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff947425974800/0xe782b916994fe921 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965226.499545:0:15978:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff947425974800/0xe782b916994fe921 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965226.499549:0:15978:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947425974800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1783965226.499552:0:15978:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947425974800/0xe782b916994fe921 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965226.499558:0:15978:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947425974800/0xe782b916994fe921 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965226.499567:0:15978:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff947402a2d700) 00010000:00010000:2.0:1783965226.499569:0:15978:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783965226.499573:0:15978:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff947425974800/0xe782b916994fe921 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965226.499579:0:15978:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947425974800/0xe782b916994fe921 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965226.499620:0:15978:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947425974600/0xe782b916994fe913 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0402 expref: 8 pid: 15978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965226.499647:0:15978:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff947425975200/0xe782b916994fe928 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0402 expref: 7 pid: 15978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965226.499655:0:15978:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff947402a2d600) 00010000:00010000:2.0:1783965226.499658:0:15978:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1783965226.499660:0:15978:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff947425975200, rc 0) 00000100:00100000:2.0:1783965226.499751:0:15978:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9474368d7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:d42e9324-0c5a-4045-80ff-e53d47e8c2f0+7:14384:x1870622715135360:12345-192.168.204.12@tcp:101:lfs.0 Request processed in 1468us (1829us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965226.499773:0:15978:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 22 00000100:00100000:1.0:1783965226.506344:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965226.506479:0:14199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715135616 00000100:00100000:2.0:1783965226.506490:0:14199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715135616 00000100:00100000:2.0:1783965226.506553:0:14199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 23 00000100:00100000:2.0:1783965226.506564:0:14199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947307dc6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d42e9324-0c5a-4045-80ff-e53d47e8c2f0+7:14384:x1870622715135616:12345-192.168.204.12@tcp:101:lfs.0 00010000:00010000:2.0:1783965226.506587:0:14199:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783965226.509242:0:14199:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947425974c00/0xe782b916994fe92f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5f0409 expref: -99 pid: 14199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783965226.509414:0:14199:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1783965226.509554:0:14199:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff947425974c00/0xe782b916994fe92f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0409 expref: 9 pid: 14199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965226.509652:0:14199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff947409a45600) 00010000:00010000:2.0:1783965226.509656:0:14199:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783965226.509662:0:14199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947425974c00/0xe782b916994fe92f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0409 expref: 9 pid: 14199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965226.509698:0:14199:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff947425974c00, rc 0) 00000100:00100000:2.0:1783965226.510498:0:14199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947307dc6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:d42e9324-0c5a-4045-80ff-e53d47e8c2f0+8:14384:x1870622715135616:12345-192.168.204.12@tcp:101:lfs.0 Request processed in 3930us (4162us total) trans 8589934595 rc 301/301 00000100:00100000:2.0:1783965226.510510:0:14199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 23 00000100:00100000:3.0:1783965226.515281:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783965226.515424:0:14201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715135872 00000100:00100000:0.0:1783965226.515443:0:14201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715135872 00000100:00100000:0.0:1783965226.515536:0:14201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 24 00000100:00100000:0.0:1783965226.515548:0:14201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9474368d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d42e9324-0c5a-4045-80ff-e53d47e8c2f0+8:14384:x1870622715135872:12345-192.168.204.12@tcp:36:lfs.0 00010000:00010000:0.0:1783965226.515627:0:14201:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783965226.515663:0:14201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947425975200/0xe782b916994fe928 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0402 expref: 8 pid: 15978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965226.515692:0:14201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff947402a2d600) 00010000:00010000:0.0:1783965226.515708:0:14201:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783965226.515754:0:14201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff947305c20600/0xe782b916994fe93d lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965226.515792:0:14201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947305c20600/0xe782b916994fe93d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965226.515804:0:14201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947305c20600/0xe782b916994fe93d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783965226.516110:0:14201:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003de2850f reply state 00000000b3a84aa4 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff947305c20600/0xe782b916994fe93d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14201 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783965226.516122:0:14201:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1783965226.516138:0:14201:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000100:00100000:0.0:1783965226.516305:0:14201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9474368d5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d42e9324-0c5a-4045-80ff-e53d47e8c2f0+9:14384:x1870622715135872:12345-192.168.204.12@tcp:36:lfs.0 Request processed in 758us (1034us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1783965226.516313:0:14201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 24 00000100:00100000:0.0:1783965226.525781:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965226.526057:0:14202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715136128 00000100:00100000:1.0:1783965226.526069:0:14202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715136128 00000100:00100000:1.0:1783965226.526135:0:14202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 2 00000100:00100000:1.0:1783965226.526146:0:14202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e613800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d42e9324-0c5a-4045-80ff-e53d47e8c2f0+9:14384:x1870622715136128:12345-192.168.204.12@tcp:35:lfs.0 00000100:00100000:1.0:1783965226.526476:0:14202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e613800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d42e9324-0c5a-4045-80ff-e53d47e8c2f0+10:14384:x1870622715136128:12345-192.168.204.12@tcp:35:lfs.0 Request processed in 331us (720us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1783965226.526485:0:14202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 2 00010000:00010000:2.0:1783965226.534010:0:3309:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff947305c20600/0xe782b916994fe93d lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965226.534087:0:3309:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff947305c20600/0xe782b916994fe93d lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965226.534097:0:3309:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff947305c20600/0xe782b916994fe93d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965226.534103:0:3309:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947305c20600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1783965226.534107:0:3309:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947305c20600/0xe782b916994fe93d lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965226.534114:0:3309:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947305c20600/0xe782b916994fe93d lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965226.534133:0:3309:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff947409a45a00) 00010000:00010000:2.0:1783965226.534136:0:3309:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1783965226.534142:0:3309:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff947305c20600/0xe782b916994fe93d lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965226.534148:0:3309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947305c20600/0xe782b916994fe93d lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14201 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783965226.538588:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783965226.538684:0:14200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715136384 00000100:00100000:0.0:1783965226.538695:0:14200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715136384 00000100:00100000:0.0:1783965226.538755:0:14200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 25 00000100:00100000:0.0:1783965226.538777:0:14200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743fb9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d42e9324-0c5a-4045-80ff-e53d47e8c2f0+9:14384:x1870622715136384:12345-192.168.204.12@tcp:101:lfs.0 00010000:00010000:0.0:1783965226.538968:0:14200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783965226.538992:0:14200:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947305c20800/0xe782b916994fe944 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5f0410 expref: -99 pid: 14200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965226.539071:0:14200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff947305c20e00/0xe782b916994fe94b lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965226.539088:0:14200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947305c20e00/0xe782b916994fe94b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965226.539121:0:14200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947305c20e00/0xe782b916994fe94b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965226.539138:0:14200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff947305c20a00/0xe782b916994fe952 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965226.539145:0:14200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947305c20a00/0xe782b916994fe952 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965226.539150:0:14200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947305c20a00/0xe782b916994fe952 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14200 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783965226.539345:0:14200:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:0.0:1783965226.539474:0:14200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff947305c20e00/0xe782b916994fe94b lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965226.539482:0:14200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff947305c20e00/0xe782b916994fe94b lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965226.539488:0:14200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff947305c20e00/0xe782b916994fe94b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965226.539494:0:14200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947305c20e00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1783965226.539499:0:14200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947305c20e00/0xe782b916994fe94b lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965226.539507:0:14200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947305c20e00/0xe782b916994fe94b lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965226.539519:0:14200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff947409a45600) 00010000:00010000:0.0:1783965226.539522:0:14200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783965226.539534:0:14200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff947305c20e00/0xe782b916994fe94b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965226.539539:0:14200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947305c20e00/0xe782b916994fe94b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965226.539697:0:14200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff947305c20a00/0xe782b916994fe952 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965226.539703:0:14200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff947305c20a00/0xe782b916994fe952 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965226.540038:0:14200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff947305c20a00/0xe782b916994fe952 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965226.540045:0:14200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947305c20a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1783965226.540049:0:14200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947305c20a00/0xe782b916994fe952 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965226.540055:0:14200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947305c20a00/0xe782b916994fe952 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965226.540067:0:14200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff947409a45a00) 00010000:00010000:0.0:1783965226.540070:0:14200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1783965226.540073:0:14200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff947305c20a00/0xe782b916994fe952 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965226.540079:0:14200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947305c20a00/0xe782b916994fe952 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965226.541773:0:14200:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff947305c20800/0xe782b916994fe944 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0410 expref: 11 pid: 14200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965226.541816:0:14200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff947409a45600) 00010000:00010000:0.0:1783965226.541818:0:14200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1783965226.541823:0:14200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947305c20800/0xe782b916994fe944 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0410 expref: 11 pid: 14200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965226.541839:0:14200:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff947305c20800, rc 0) 00000100:00100000:0.0:1783965226.541913:0:14200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743fb9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:d42e9324-0c5a-4045-80ff-e53d47e8c2f0+10:14384:x1870622715136384:12345-192.168.204.12@tcp:101:lfs.0 Request processed in 3139us (3335us total) trans 8589934598 rc 301/301 00000100:00100000:0.0:1783965226.541920:0:14200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 25 00010000:00010000:3.0:1783965226.542489:0:15786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783965226.546468:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783965226.546590:0:14201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715136512 00000100:00100000:0.0:1783965226.546600:0:14201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715136512 00000100:00100000:0.0:1783965226.546668:0:14201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 26 00000100:00100000:0.0:1783965226.546679:0:14201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9474368d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d42e9324-0c5a-4045-80ff-e53d47e8c2f0+10:14384:x1870622715136512:12345-192.168.204.12@tcp:101:lfs.0 00010000:00010000:0.0:1783965226.546703:0:14201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783965226.546726:0:14201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947305c20000/0xe782b916994fe960 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5f0417 expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965226.546826:0:14201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff947305c21c00/0xe782b916994fe967 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965226.546841:0:14201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947305c21c00/0xe782b916994fe967 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965226.546852:0:14201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947305c21c00/0xe782b916994fe967 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1783965226.546905:0:14201:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:0.0:1783965226.546922:0:14201:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1783965226.546951:0:14201:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff947305c21c00/0xe782b916994fe967 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965226.546979:0:14201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947305c20000/0xe782b916994fe960 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0417 expref: 12 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965226.546999:0:14201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff947305c21c00/0xe782b916994fe967 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0417 expref: 11 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965226.547007:0:14201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff947409a45400) 00010000:00010000:0.0:1783965226.547010:0:14201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1783965226.547013:0:14201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff947305c21c00, rc 0) 00000100:00100000:0.0:1783965226.547066:0:14201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9474368d4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:d42e9324-0c5a-4045-80ff-e53d47e8c2f0+11:14384:x1870622715136512:12345-192.168.204.12@tcp:101:lfs.0 Request processed in 389us (607us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965226.547074:0:14201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 26 00000100:00100000:1.0:1783965226.554695:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783965226.554803:0:14202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715136640 00000100:00100000:0.0:1783965226.554814:0:14202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715136640 00000100:00100000:0.0:1783965226.554872:0:14202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 3 00000100:00100000:0.0:1783965226.554882:0:14202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743fb9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d42e9324-0c5a-4045-80ff-e53d47e8c2f0+11:14384:x1870622715136640:12345-192.168.204.12@tcp:37:lfs.0 00000100:00100000:0.0:1783965226.560024:0:14202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743fb9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:d42e9324-0c5a-4045-80ff-e53d47e8c2f0+11:14384:x1870622715136640:12345-192.168.204.12@tcp:37:lfs.0 Request processed in 5131us (5328us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965226.560040:0:14202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 3 00000100:00100000:3.0:1783965226.568436:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965226.568762:0:14203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715136896 00000100:00100000:1.0:1783965226.568778:0:14203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715136896 00000100:00100000:1.0:1783965226.568877:0:14203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 4 00000100:00100000:1.0:1783965226.568888:0:14203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947304be7850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d42e9324-0c5a-4045-80ff-e53d47e8c2f0+11:14384:x1870622715136896:12345-192.168.204.12@tcp:35:lfs.0 00000100:00100000:1.0:1783965226.569464:0:14203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947304be7850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:d42e9324-0c5a-4045-80ff-e53d47e8c2f0+12:14384:x1870622715136896:12345-192.168.204.12@tcp:35:lfs.0 Request processed in 574us (1053us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1783965226.569473:0:14203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 4 00000100:00100000:1.0:1783965226.632551:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965226.632680:0:14199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715137024 00000100:00100000:2.0:1783965226.632704:0:14199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715137024 00000100:00100000:2.0:1783965226.632768:0:14199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 27 00000100:00100000:2.0:1783965226.632779:0:14199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743fb9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2c21b91-f3be-4bc4-8944-f5766379921b+10:14390:x1870622715137024:12345-192.168.204.12@tcp:101:bash.0 00010000:00010000:2.0:1783965226.632798:0:14199:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783965226.632820:0:14199:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947425974c00/0xe782b916994fe96e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5f041e expref: -99 pid: 14199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965226.632893:0:14199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff947425974600/0xe782b916994fe975 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965226.632906:0:14199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947425974600/0xe782b916994fe975 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965226.632917:0:14199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947425974600/0xe782b916994fe975 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965226.632931:0:14199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff947425974800/0xe782b916994fe97c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965226.632937:0:14199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947425974800/0xe782b916994fe97c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965226.632943:0:14199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947425974800/0xe782b916994fe97c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965226.633065:0:14199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff947425975e00/0xe782b916994fe983 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965226.633074:0:14199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947425975e00/0xe782b916994fe983 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965226.633081:0:14199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947425975e00/0xe782b916994fe983 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14199 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783965226.633123:0:14199:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:2.0:1783965226.633127:0:14199:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1783965226.633161:0:14199:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff947425975e00/0xe782b916994fe983 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965226.633173:0:14199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff947425974600/0xe782b916994fe975 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965226.633178:0:14199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff947425974600/0xe782b916994fe975 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965226.633184:0:14199:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff947425974600/0xe782b916994fe975 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965226.633189:0:14199:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947425974600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1783965226.633193:0:14199:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947425974600/0xe782b916994fe975 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965226.633239:0:14199:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947425974600/0xe782b916994fe975 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965226.633251:0:14199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff947409a45600) 00010000:00010000:2.0:1783965226.633254:0:14199:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783965226.633258:0:14199:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff947425974600/0xe782b916994fe975 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965226.633264:0:14199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947425974600/0xe782b916994fe975 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965226.633276:0:14199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff947425974800/0xe782b916994fe97c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965226.633290:0:14199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff947425974800/0xe782b916994fe97c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965226.633295:0:14199:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff947425974800/0xe782b916994fe97c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965226.633300:0:14199:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947425974800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1783965226.633302:0:14199:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947425974800/0xe782b916994fe97c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965226.633307:0:14199:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947425974800/0xe782b916994fe97c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965226.633314:0:14199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff947402a2d700) 00010000:00010000:2.0:1783965226.633316:0:14199:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783965226.633318:0:14199:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff947425974800/0xe782b916994fe97c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965226.633323:0:14199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947425974800/0xe782b916994fe97c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965226.633349:0:14199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947425974c00/0xe782b916994fe96e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f041e expref: 12 pid: 14199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965226.633360:0:14199:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff947425975e00/0xe782b916994fe983 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f041e expref: 11 pid: 14199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965226.633366:0:14199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff947409a45400) 00010000:00010000:2.0:1783965226.633369:0:14199:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1783965226.633376:0:14199:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff947425975e00, rc 0) 00000100:00100000:2.0:1783965226.633448:0:14199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743fb9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2c21b91-f3be-4bc4-8944-f5766379921b+11:14390:x1870622715137024:12345-192.168.204.12@tcp:101:bash.0 Request processed in 671us (908us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965226.633455:0:14199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 27 00000100:00100000:1.0:1783965226.645796:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783965226.647089:0:14201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715137280 00000100:00100000:0.0:1783965226.647105:0:14201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715137280 00000100:00100000:0.0:1783965226.647180:0:14201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 28 00000100:00100000:0.0:1783965226.647189:0:14201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743fb9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2c21b91-f3be-4bc4-8944-f5766379921b+11:14390:x1870622715137280:12345-192.168.204.12@tcp:101:bash.0 00010000:00010000:0.0:1783965226.647241:0:14201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1783965226.647274:0:14201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947305c20000/0xe782b916994fe98a lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5f0425 expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965226.647409:0:14201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff947305c20800/0xe782b916994fe991 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965226.647423:0:14201:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff947305c21c00/0xe782b916994fe967 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0417 expref: 11 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965226.647431:0:14201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff947305c20800/0xe782b916994fe991 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965226.647464:0:14201:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff947305c21c00/0xe782b916994fe967 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0417 expref: 11 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965226.647476:0:14201:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff947305c21c00/0xe782b916994fe967 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0417 expref: 11 pid: 14201 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783965226.647488:0:14201:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743e613800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14201:1870622732949888:192.168.204.12@tcp:104: 00000100:00100000:0.0:1783965226.647579:0:14201:0:(client.c:2702:ptlrpc_set_wait()) set ffff947425854180 going to sleep for 11 seconds 00000100:00100000:0.0:1783965226.653078:0:14201:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743e613800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14201:1870622732949888:192.168.204.12@tcp:104: 00010000:00010000:0.0:1783965226.653124:0:14201:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff947305c20800/0xe782b916994fe991 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14201 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783965226.660832:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965226.662070:0:14185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715137408 00000100:00100000:2.0:1783965226.662083:0:14185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715137408 00010000:00010000:0.0:1783965226.665295:0:14185:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff947305c21c00/0xe782b916994fe967 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0417 expref: 12 pid: 14201 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783965226.665422:0:14185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 10 00000100:00100000:0.0:1783965226.665436:0:14185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743fb9b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d42e9324-0c5a-4045-80ff-e53d47e8c2f0+12:2360:x1870622715137408:12345-192.168.204.12@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783965226.665468:0:14185:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783965226.665477:0:14185:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff947305c21c00/0xe782b916994fe967 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0417 expref: 12 pid: 14201 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965226.665493:0:14185:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff947305c21c00/0xe782b916994fe967 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0417 expref: 12 pid: 14201 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965226.665517:0:14185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947305c21c00/0xe782b916994fe967 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0417 expref: 12 pid: 14201 timeout: 560 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965226.665533:0:14185:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff947409a45400) 00010000:00010000:0.0:1783965226.665538:0:14185:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff947305c20800/0xe782b916994fe991 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965226.665548:0:14185:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff947305c20800/0xe782b916994fe991 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965226.665556:0:14185:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947305c20800/0xe782b916994fe991 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965226.665597:0:14185:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1783965226.665665:0:14185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743fb9b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:d42e9324-0c5a-4045-80ff-e53d47e8c2f0+11:2360:x1870622715137408:12345-192.168.204.12@tcp:103:ldlm_bl.0 Request processed in 234us (4843us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965226.665674:0:14185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 10 00010000:00010000:3.0:1783965226.665741:0:14201:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff947305c20800/0xe782b916994fe991 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965226.665750:0:14201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947305c20800/0xe782b916994fe991 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965226.665774:0:14201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e000/0xe782b916994fe998 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965226.665785:0:14201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e000/0xe782b916994fe998 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965226.665806:0:14201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e000/0xe782b916994fe998 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965226.666765:0:14201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f800/0xe782b916994fe99f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965226.666791:0:14201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f800/0xe782b916994fe99f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965226.666800:0:14201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f800/0xe782b916994fe99f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783965226.666813:0:14201:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1783965226.666843:0:14201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff947305c20800/0xe782b916994fe991 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965226.666850:0:14201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff947305c20800/0xe782b916994fe991 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965226.666856:0:14201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff947305c20800/0xe782b916994fe991 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965226.666861:0:14201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947305c20800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1783965226.666866:0:14201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947305c20800/0xe782b916994fe991 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965226.666874:0:14201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947305c20800/0xe782b916994fe991 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965226.666885:0:14201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff947409a45400) 00010000:00010000:3.0:1783965226.666888:0:14201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783965226.666892:0:14201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff947305c20800/0xe782b916994fe991 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965226.666898:0:14201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947305c20800/0xe782b916994fe991 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1783965226.666911:0:14201:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007d0a487b reply state 00000000e44448df transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e000/0xe782b916994fe998 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14201 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783965226.666930:0:14201:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1783965226.666966:0:14201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947305c20000/0xe782b916994fe98a lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0425 expref: 14 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965226.666981:0:14201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f800/0xe782b916994fe99f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0425 expref: 13 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965226.666989:0:14201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9474130d6f00) 00010000:00010000:3.0:1783965226.666991:0:14201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:3.0:1783965226.666993:0:14201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94743fb8f800, rc 0) 00000100:00100000:3.0:1783965226.667042:0:14201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743fb9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2c21b91-f3be-4bc4-8944-f5766379921b+14:14390:x1870622715137280:12345-192.168.204.12@tcp:101:bash.0 Request processed in 19852us (21261us total) trans 8589934600 rc 0/0 00000100:00100000:3.0:1783965226.667050:0:14201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 28 00010000:00010000:3.0:1783965226.672348:0:3308:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e000/0xe782b916994fe998 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965226.672366:0:3308:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e000/0xe782b916994fe998 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965226.672374:0:3308:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e000/0xe782b916994fe998 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965226.672389:0:3308:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743fb8e000 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1783965226.672394:0:3308:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e000/0xe782b916994fe998 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965226.672401:0:3308:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e000/0xe782b916994fe998 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965226.672441:0:3308:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9474130d6700) 00010000:00010000:3.0:1783965226.672445:0:3308:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783965226.672450:0:3308:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e000/0xe782b916994fe998 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965226.672456:0:3308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e000/0xe782b916994fe998 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14201 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783965226.691880:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965226.693957:0:14199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715137536 00000100:00100000:2.0:1783965226.693972:0:14199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715137536 00000100:00100000:2.0:1783965226.694038:0:14199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 29 00000100:00100000:2.0:1783965226.694047:0:14199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743fb99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2c21b91-f3be-4bc4-8944-f5766379921b+13:14390:x1870622715137536:12345-192.168.204.12@tcp:101:bash.0 00010000:00010000:2.0:1783965226.694072:0:14199:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783965226.694096:0:14199:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947425974c00/0xe782b916994fe9ad lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5f042c expref: -99 pid: 14199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965226.694170:0:14199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff947425974800/0xe782b916994fe9b4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965226.694185:0:14199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947425974800/0xe782b916994fe9b4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965226.694197:0:14199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947425974800/0xe782b916994fe9b4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14199 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783965226.694270:0:14199:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1783965226.694274:0:14199:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1783965226.694292:0:14199:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff947425974800/0xe782b916994fe9b4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965226.694304:0:14199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947425974800/0xe782b916994fe9b4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965226.694348:0:14199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947425974c00/0xe782b916994fe9ad lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f042c expref: 15 pid: 14199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965226.694368:0:14199:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff947425974800/0xe782b916994fe9b4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f042c expref: 14 pid: 14199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965226.694388:0:14199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9474130d6f00) 00010000:00010000:2.0:1783965226.694392:0:14199:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783965226.694395:0:14199:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff947425974800, rc 0) 00000100:00100000:2.0:1783965226.694455:0:14199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743fb99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2c21b91-f3be-4bc4-8944-f5766379921b+14:14390:x1870622715137536:12345-192.168.204.12@tcp:101:bash.0 Request processed in 408us (2584us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965226.694462:0:14199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 29 00000100:00100000:1.0:1783965226.699477:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965226.699800:0:14202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715137792 00000100:00100000:2.0:1783965226.699810:0:14202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715137792 00000100:00100000:2.0:1783965226.699964:0:14202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 5 00000100:00100000:2.0:1783965226.699975:0:14202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743fb9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b2c21b91-f3be-4bc4-8944-f5766379921b+14:14390:x1870622715137792:12345-192.168.204.12@tcp:35:bash.0 00000100:00100000:2.0:1783965226.701046:0:14202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743fb9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b2c21b91-f3be-4bc4-8944-f5766379921b+15:14390:x1870622715137792:12345-192.168.204.12@tcp:35:bash.0 Request processed in 1066us (1574us total) trans 8589934601 rc 0/0 00000100:00100000:2.0:1783965226.701057:0:14202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 5 00000100:00100000:1.0:1783965226.845777:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965226.847707:0:15978:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715138048 00000100:00100000:2.0:1783965226.847729:0:15978:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715138048 00000100:00100000:2.0:1783965226.849127:0:15978:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 30 00000100:00100000:2.0:1783965226.849149:0:15978:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743fb99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2c21b91-f3be-4bc4-8944-f5766379921b+15:14400:x1870622715138048:12345-192.168.204.12@tcp:101:lfs.0 00010000:00010000:2.0:1783965226.849176:0:15978:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783965226.849213:0:15978:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947425974c00/0xe782b916994fe9bb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5f0433 expref: -99 pid: 15978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783965226.849350:0:15978:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1783965226.849649:0:15978:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff947425974c00/0xe782b916994fe9bb lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0433 expref: 17 pid: 15978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965226.849664:0:15978:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff947409a45600) 00010000:00010000:2.0:1783965226.849667:0:15978:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783965226.849672:0:15978:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947425974c00/0xe782b916994fe9bb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0433 expref: 17 pid: 15978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965226.849686:0:15978:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff947425974c00, rc 0) 00000100:00100000:2.0:1783965226.850485:0:15978:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743fb99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2c21b91-f3be-4bc4-8944-f5766379921b+16:14400:x1870622715138048:12345-192.168.204.12@tcp:101:lfs.0 Request processed in 1341us (4714us total) trans 8589934602 rc 301/301 00000100:00100000:2.0:1783965226.850496:0:15978:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 30 00000100:00100000:3.0:1783965226.866363:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965226.866438:0:14203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715138304 00000100:00100000:1.0:1783965226.866459:0:14203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715138304 00000100:00100000:1.0:1783965226.866521:0:14203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 6 00000100:00100000:1.0:1783965226.866532:0:14203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9474368d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b2c21b91-f3be-4bc4-8944-f5766379921b+16:14400:x1870622715138304:12345-192.168.204.12@tcp:35:lfs.0 00000100:00100000:1.0:1783965226.866807:0:14203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9474368d6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b2c21b91-f3be-4bc4-8944-f5766379921b+17:14400:x1870622715138304:12345-192.168.204.12@tcp:35:lfs.0 Request processed in 276us (609us total) trans 8589934603 rc 0/0 00000100:00100000:1.0:1783965226.866816:0:14203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 6 00000100:00100000:1.0:1783965226.879354:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965226.884106:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965226.884240:0:14837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715138688 00000100:00100000:0.0:1783965226.884242:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965226.884251:0:14837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715138688 00000100:00100000:0.0:1783965226.884284:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965226.884331:0:14837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715138944 00000100:00100000:0.0:1783965226.884332:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965226.884345:0:14837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715138944 00000100:00100000:0.0:1783965226.884350:0:16185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715138560 00000100:00100000:0.0:1783965226.884355:0:16185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715138560 00000100:00100000:2.0:1783965226.884367:0:14837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715138816 00000100:00100000:2.0:1783965226.884371:0:14837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715138816 00000100:00100000:2.0:1783965226.884418:0:14837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 11 00000100:00100000:2.0:1783965226.884428:0:14837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743fb9bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b2c21b91-f3be-4bc4-8944-f5766379921b+5:2358:x1870622715138688:12345-192.168.204.12@tcp:400:kworker.0 00000100:00100000:2.0:1783965226.884513:0:14837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743fb9bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b2c21b91-f3be-4bc4-8944-f5766379921b+5:2358:x1870622715138688:12345-192.168.204.12@tcp:400:kworker.0 Request processed in 86us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965226.885108:0:14192:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715138432 00000100:00100000:3.0:1783965226.885116:0:14192:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715138432 00000100:00100000:0.0:1783965226.894104:0:16185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 12 00000100:00100000:0.0:1783965226.894133:0:16185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e613800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d42e9324-0c5a-4045-80ff-e53d47e8c2f0+5:2358:x1870622715138944:12345-192.168.204.12@tcp:400:kworker.0 00000100:00100000:0.0:1783965226.894253:0:16185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e613800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:d42e9324-0c5a-4045-80ff-e53d47e8c2f0+5:2358:x1870622715138944:12345-192.168.204.12@tcp:400:kworker.0 Request processed in 135us (10012us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965226.898019:0:14834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 13 00000100:00100000:1.0:1783965226.898048:0:14834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e613480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b2c21b91-f3be-4bc4-8944-f5766379921b+5:2358:x1870622715138560:12345-192.168.204.12@tcp:400:kworker.0 00000100:00100000:2.0:1783965226.898073:0:14837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 11 00000100:00100000:2.0:1783965226.898112:0:14837:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 4 min 3 max 116 00000100:00100000:2.0:1783965226.898122:0:14837:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_004' 00000100:00100000:1.0:1783965226.898132:0:14834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e613480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b2c21b91-f3be-4bc4-8944-f5766379921b+5:2358:x1870622715138560:12345-192.168.204.12@tcp:400:kworker.0 Request processed in 100us (13847us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965226.898143:0:14834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 13 00000100:00080000:2.0:1783965226.898168:0:14195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1783965226.898174:0:14195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1783965226.898255:0:14834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 14 00000100:00100000:1.0:1783965226.898264:0:14834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e611c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d42e9324-0c5a-4045-80ff-e53d47e8c2f0+5:2358:x1870622715138816:12345-192.168.204.12@tcp:400:kworker.0 00000100:00100000:1.0:1783965226.898296:0:14834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e611c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:d42e9324-0c5a-4045-80ff-e53d47e8c2f0+5:2358:x1870622715138816:12345-192.168.204.12@tcp:400:kworker.0 Request processed in 34us (13965us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965226.898303:0:14834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 14 00000100:00100000:2.0:1783965226.898442:0:14192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 120 00000100:00100000:2.0:1783965226.898452:0:14192:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94741cd57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8204b8a1-ddc8-44a4-855e-f8a2831c2700+13:2358:x1870622715138432:12345-192.168.204.12@tcp:400:kworker.0 00000100:00100000:2.0:1783965226.898487:0:14192:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94741cd57850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:8204b8a1-ddc8-44a4-855e-f8a2831c2700+13:2358:x1870622715138432:12345-192.168.204.12@tcp:400:kworker.0 Request processed in 38us (19142us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965226.898494:0:14192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 120 00000100:00100000:0.0:1783965226.902340:0:16185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 12 00000100:00100000:0.0:1783965226.919125:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965226.922749:0:14199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715139200 00000100:00100000:2.0:1783965226.922769:0:14199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715139200 00000100:00100000:2.0:1783965226.923116:0:14199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 31 00000100:00100000:2.0:1783965226.923129:0:14199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e612d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2c21b91-f3be-4bc4-8944-f5766379921b+17:14403:x1870622715139200:12345-192.168.204.12@tcp:101:lfs.0 00010000:00010000:2.0:1783965226.923163:0:14199:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783965226.923190:0:14199:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947425974600/0xe782b916994fe9c9 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5f043a expref: -99 pid: 14199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965226.923382:0:14199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff947425974c00/0xe782b916994fe9d0 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965226.923396:0:14199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947425974c00/0xe782b916994fe9d0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965226.923422:0:14199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947425974c00/0xe782b916994fe9d0 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14199 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783965226.923436:0:14199:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1783965226.923568:0:14199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947425974600/0xe782b916994fe9c9 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f043a expref: 20 pid: 14199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965226.923588:0:14199:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff947425974c00/0xe782b916994fe9d0 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f043a expref: 19 pid: 14199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965226.923611:0:14199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9474130d6f00) 00010000:00010000:2.0:1783965226.923614:0:14199:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783965226.923617:0:14199:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff947425974c00, rc 0) 00000100:00100000:2.0:1783965226.923697:0:14199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e612d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2c21b91-f3be-4bc4-8944-f5766379921b+19:14403:x1870622715139200:12345-192.168.204.12@tcp:101:lfs.0 Request processed in 571us (4579us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1783965226.923704:0:14199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 31 00000040:00080000:3.0:1783965226.924044:0:14233:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1783965226.929146:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965226.929194:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965226.929264:0:14184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715139328 00000100:00100000:2.0:1783965226.929275:0:14184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715139328 00000100:00100000:3.0:1783965226.929338:0:14201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715139456 00000100:00100000:3.0:1783965226.929344:0:14201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715139456 00000100:00100000:2.0:1783965226.929489:0:14184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 0 00000100:00100000:2.0:1783965226.929500:0:14184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743fb9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b2c21b91-f3be-4bc4-8944-f5766379921b+20:2357:x1870622715139328:12345-192.168.204.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783965226.929516:0:14184:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783965226.929544:0:14184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947425974c00/0xe782b916994fe9d0 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f043a expref: 20 pid: 14199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965226.929566:0:14184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9474130d6f00) 00010000:00010000:2.0:1783965226.929570:0:14184:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783965226.929620:0:14184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743fb9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b2c21b91-f3be-4bc4-8944-f5766379921b+19:2357:x1870622715139328:12345-192.168.204.12@tcp:103:ldlm_bl.0 Request processed in 122us (485us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965226.929628:0:14184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 0 00000100:00100000:3.0:1783965226.929673:0:14201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 32 00000100:00100000:3.0:1783965226.929686:0:14201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743fb9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2c21b91-f3be-4bc4-8944-f5766379921b+18:14403:x1870622715139456:12345-192.168.204.12@tcp:54:lfs.0 00010000:00010000:3.0:1783965226.929760:0:14201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e000/0xe782b916994fe9de lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965226.929775:0:14201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e000/0xe782b916994fe9de lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965226.929786:0:14201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e000/0xe782b916994fe9de lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965226.929813:0:14201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e000/0xe782b916994fe9de lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965226.929821:0:14201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e000/0xe782b916994fe9de lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965226.929847:0:14201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e000/0xe782b916994fe9de lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965226.929853:0:14201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743fb8e000 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1783965226.929857:0:14201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e000/0xe782b916994fe9de lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965226.929865:0:14201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e000/0xe782b916994fe9de lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965226.929875:0:14201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9474130d6f00) 00010000:00010000:3.0:1783965226.929878:0:14201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1783965226.929881:0:14201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e000/0xe782b916994fe9de lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965226.929888:0:14201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e000/0xe782b916994fe9de lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14201 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783965226.929947:0:14201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743fb9a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2c21b91-f3be-4bc4-8944-f5766379921b+18:14403:x1870622715139456:12345-192.168.204.12@tcp:54:lfs.0 Request processed in 264us (752us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965226.929954:0:14201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 32 00000100:00100000:1.0:1783965226.935907:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783965226.937857:0:14203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715139712 00000100:00100000:0.0:1783965226.937872:0:14203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715139712 00000100:00100000:0.0:1783965226.937984:0:14203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 7 00000100:00100000:0.0:1783965226.937995:0:14203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743fb98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b2c21b91-f3be-4bc4-8944-f5766379921b+18:14403:x1870622715139712:12345-192.168.204.12@tcp:35:lfs.0 00000100:00100000:0.0:1783965226.938292:0:14203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743fb98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b2c21b91-f3be-4bc4-8944-f5766379921b+19:14403:x1870622715139712:12345-192.168.204.12@tcp:35:lfs.0 Request processed in 298us (2393us total) trans 8589934605 rc 0/0 00000100:00100000:0.0:1783965226.938301:0:14203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 7 00000100:00100000:0.0:1783965227.372390:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965227.372520:0:14200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715139968 00000100:00100000:2.0:1783965227.372531:0:14200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715139968 00000100:00100000:2.0:1783965227.372597:0:14200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 33 00000100:00100000:2.0:1783965227.372607:0:14200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e611880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2c21b91-f3be-4bc4-8944-f5766379921b+19:14434:x1870622715139968:12345-192.168.204.12@tcp:101:cat.0 00010000:00010000:2.0:1783965227.372632:0:14200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783965227.372655:0:14200:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947425974c00/0xe782b916994fe9e5 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5f0441 expref: -99 pid: 14200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965227.372782:0:14200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff947425974600/0xe782b916994fe9ec lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965227.372797:0:14200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947425974600/0xe782b916994fe9ec lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965227.372809:0:14200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947425974600/0xe782b916994fe9ec lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14200 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783965227.372820:0:14200:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1783965227.372952:0:14200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947425974c00/0xe782b916994fe9e5 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0441 expref: 22 pid: 14200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965227.372971:0:14200:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff947425974600/0xe782b916994fe9ec lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0441 expref: 21 pid: 14200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965227.372981:0:14200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9474130d6f00) 00010000:00010000:2.0:1783965227.372984:0:14200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1783965227.372987:0:14200:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff947425974600, rc 0) 00000100:00100000:2.0:1783965227.373055:0:14200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e611880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2c21b91-f3be-4bc4-8944-f5766379921b+21:14434:x1870622715139968:12345-192.168.204.12@tcp:101:cat.0 Request processed in 449us (674us total) trans 8589934606 rc 0/0 00000100:00100000:2.0:1783965227.373061:0:14200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 33 00000100:00100000:1.0:1783965227.376880:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965227.377235:0:14202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715140224 00000100:00100000:2.0:1783965227.377246:0:14202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715140224 00000100:00100000:2.0:1783965227.377315:0:14202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 8 00000100:00100000:2.0:1783965227.377326:0:14202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743fb98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b2c21b91-f3be-4bc4-8944-f5766379921b+21:14434:x1870622715140224:12345-192.168.204.12@tcp:35:cat.0 00000100:00100000:2.0:1783965227.379052:0:14202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743fb98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b2c21b91-f3be-4bc4-8944-f5766379921b+22:14434:x1870622715140224:12345-192.168.204.12@tcp:35:cat.0 Request processed in 1719us (2172us total) trans 8589934607 rc 0/0 00000100:00100000:2.0:1783965227.379085:0:14202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 8 00000100:00100000:0.0:1783965227.379713:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965227.379955:0:16223:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715140352 00000100:00100000:2.0:1783965227.379963:0:16223:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715140352 00000100:00100000:2.0:1783965227.380020:0:16223:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 1 00000100:00100000:2.0:1783965227.380030:0:16223:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e612680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b2c21b91-f3be-4bc4-8944-f5766379921b+22:2359:x1870622715140352:12345-192.168.204.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783965227.380044:0:16223:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783965227.380070:0:16223:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947425974600/0xe782b916994fe9ec lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0441 expref: 22 pid: 14200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965227.380088:0:16223:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9474130d6f00) 00010000:00010000:2.0:1783965227.380093:0:16223:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783965227.380284:0:16223:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e612680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b2c21b91-f3be-4bc4-8944-f5766379921b+21:2359:x1870622715140352:12345-192.168.204.12@tcp:103:ldlm_bl.0 Request processed in 254us (571us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965227.380292:0:16223:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 1 00000100:00100000:1.0:1783965227.462297:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965227.462717:0:14201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715140608 00000100:00100000:3.0:1783965227.462731:0:14201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715140608 00000100:00100000:3.0:1783965227.462825:0:14201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 34 00000100:00100000:3.0:1783965227.462837:0:14201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743fb99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2c21b91-f3be-4bc4-8944-f5766379921b+21:14440:x1870622715140608:12345-192.168.204.12@tcp:101:dd.0 00010000:00010000:3.0:1783965227.462865:0:14201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783965227.462888:0:14201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e000/0xe782b916994fe9fa lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5f0448 expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965227.463005:0:14201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f200/0xe782b916994fea01 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965227.463019:0:14201:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f800/0xe782b916994fe99f lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0425 expref: 22 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965227.463028:0:14201:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff947425974800/0xe782b916994fe9b4 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f042c expref: 22 pid: 14199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965227.463036:0:14201:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f200/0xe782b916994fea01 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965227.463071:0:14201:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff947425974800/0xe782b916994fe9b4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f042c expref: 22 pid: 14199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965227.463083:0:14201:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff947425974800/0xe782b916994fe9b4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f042c expref: 22 pid: 14199 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783965227.463097:0:14201:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9474368d6680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14201:1870622732950016:192.168.204.12@tcp:104: 00010000:00010000:3.0:1783965227.463240:0:14201:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f800/0xe782b916994fe99f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0425 expref: 22 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965227.463250:0:14201:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f800/0xe782b916994fe99f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0425 expref: 22 pid: 14201 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783965227.463259:0:14201:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9474368d6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14201:1870622732950144:192.168.204.12@tcp:104: 00000100:00100000:3.0:1783965227.463301:0:14201:0:(client.c:2702:ptlrpc_set_wait()) set ffff94743e29f300 going to sleep for 11 seconds 00000100:00100000:0.0:1783965227.469403:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783965227.469532:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965227.469667:0:14184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715140864 00000100:00100000:2.0:1783965227.469688:0:14184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715140864 00010000:00010000:2.0:1783965227.469748:0:14184:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f800/0xe782b916994fe99f lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0425 expref: 23 pid: 14201 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783965227.469810:0:14184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715140736 00000100:00100000:2.0:1783965227.469813:0:14184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715140736 00010000:00010000:2.0:1783965227.469831:0:14184:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff947425974800/0xe782b916994fe9b4 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f042c expref: 24 pid: 14199 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783965227.469859:0:14184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 11 00000100:00100000:2.0:1783965227.469869:0:14184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94741d455850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b2c21b91-f3be-4bc4-8944-f5766379921b+24:2359:x1870622715140864:12345-192.168.204.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783965227.469906:0:14184:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783965227.469914:0:14184:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f800/0xe782b916994fe99f lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0425 expref: 24 pid: 14201 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965227.469926:0:14184:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f800/0xe782b916994fe99f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0425 expref: 24 pid: 14201 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965227.469949:0:14184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9474130d6f00) 00010000:00010000:2.0:1783965227.469954:0:14184:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f200/0xe782b916994fea01 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965227.469962:0:14184:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f200/0xe782b916994fea01 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965227.469968:0:14184:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783965227.470025:0:14184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94741d455850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b2c21b91-f3be-4bc4-8944-f5766379921b+24:2359:x1870622715140864:12345-192.168.204.12@tcp:103:ldlm_bl.0 Request processed in 159us (638us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965227.470033:0:14184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 11 00000100:00100000:2.0:1783965227.470085:0:14184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 12 00000100:00100000:2.0:1783965227.470091:0:14184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e611f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b2c21b91-f3be-4bc4-8944-f5766379921b+23:2359:x1870622715140736:12345-192.168.204.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783965227.470097:0:14184:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783965227.470102:0:14184:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff947425974800/0xe782b916994fe9b4 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f042c expref: 23 pid: 14199 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965227.470113:0:14184:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff947425974800/0xe782b916994fe9b4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f042c expref: 23 pid: 14199 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965227.470136:0:14184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9474130d6f00) 00010000:00010000:2.0:1783965227.470139:0:14184:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f200/0xe782b916994fea01 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965227.470147:0:14184:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f200/0xe782b916994fea01 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965227.470153:0:14184:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f200/0xe782b916994fea01 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965227.470168:0:14184:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783965227.470186:0:14184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e611f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b2c21b91-f3be-4bc4-8944-f5766379921b+23:2359:x1870622715140736:12345-192.168.204.12@tcp:103:ldlm_bl.0 Request processed in 95us (654us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965227.470193:0:14184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 12 00010000:00010000:3.0:1783965227.470510:0:14201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947425974800/0xe782b916994fe9b4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f042c expref: 22 pid: 14199 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783965227.470560:0:14201:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9474368d6680 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14201:1870622732950016:192.168.204.12@tcp:104: 00010000:00010000:3.0:1783965227.470576:0:14201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f800/0xe782b916994fe99f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0425 expref: 21 pid: 14201 timeout: 561 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783965227.470588:0:14201:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9474368d6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14201:1870622732950144:192.168.204.12@tcp:104: 00010000:00010000:3.0:1783965227.470622:0:14201:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f200/0xe782b916994fea01 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965227.470634:0:14201:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f200/0xe782b916994fea01 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965227.470640:0:14201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f200/0xe782b916994fea01 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1783965227.470667:0:14201:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1783965227.471290:0:14201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e000/0xe782b916994fe9fa lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0448 expref: 22 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965227.471319:0:14201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f200/0xe782b916994fea01 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0448 expref: 21 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965227.471330:0:14201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9474130d6f00) 00010000:00010000:3.0:1783965227.471333:0:14201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1783965227.471336:0:14201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94743fb8f200, rc 0) 00000100:00100000:3.0:1783965227.472617:0:14201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743fb99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2c21b91-f3be-4bc4-8944-f5766379921b+21:14440:x1870622715140608:12345-192.168.204.12@tcp:101:dd.0 Request processed in 9772us (10325us total) trans 8589934608 rc 0/0 00000100:00100000:3.0:1783965227.472631:0:14201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 34 00000100:00100000:0.0:1783965227.476455:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965227.476801:0:14200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715141120 00000100:00100000:2.0:1783965227.476817:0:14200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715141120 00000100:00100000:2.0:1783965227.476908:0:14200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 35 00000100:00100000:2.0:1783965227.476921:0:14200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e613100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2c21b91-f3be-4bc4-8944-f5766379921b+21:14440:x1870622715141120:12345-192.168.204.12@tcp:36:dd.0 00010000:00010000:2.0:1783965227.477353:0:14200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff947425974600/0xe782b916994fea0f lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965227.477387:0:14200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947425974600/0xe782b916994fea0f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965227.477401:0:14200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947425974600/0xe782b916994fea0f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14200 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783965227.477493:0:14200:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:2.0:1783965227.477524:0:14200:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006d94742a reply state 0000000049931ff5 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff947425974600/0xe782b916994fea0f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14200 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783965227.477540:0:14200:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783965227.477670:0:14200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e613100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2c21b91-f3be-4bc4-8944-f5766379921b+24:14440:x1870622715141120:12345-192.168.204.12@tcp:36:dd.0 Request processed in 750us (1231us total) trans 8589934610 rc 0/0 00000100:00100000:2.0:1783965227.477679:0:14200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 35 00000020:00080000:2.0:1783965227.477685:0:14200:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1783965227.480464:0:3309:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff947425974600/0xe782b916994fea0f lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965227.480488:0:3309:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff947425974600/0xe782b916994fea0f lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965227.480497:0:3309:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff947425974600/0xe782b916994fea0f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965227.480504:0:3309:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947425974600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1783965227.480509:0:3309:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947425974600/0xe782b916994fea0f lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965227.480519:0:3309:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947425974600/0xe782b916994fea0f lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965227.480541:0:3309:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9474130d6f00) 00010000:00010000:2.0:1783965227.480545:0:3309:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783965227.480552:0:3309:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff947425974600/0xe782b916994fea0f lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965227.480559:0:3309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947425974600/0xe782b916994fea0f lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14200 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783965227.481848:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965227.482593:0:15978:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715141248 00000100:00100000:2.0:1783965227.482630:0:15978:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715141248 00000100:00100000:2.0:1783965227.482710:0:15978:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 36 00000100:00100000:2.0:1783965227.482722:0:15978:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e610700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2c21b91-f3be-4bc4-8944-f5766379921b+23:14440:x1870622715141248:12345-192.168.204.12@tcp:101:dd.0 00010000:00010000:2.0:1783965227.482755:0:15978:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783965227.482792:0:15978:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947425974c00/0xe782b916994fea16 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5f044f expref: -99 pid: 15978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965227.482874:0:15978:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947425974c00/0xe782b916994fea16 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f044f expref: 24 pid: 15978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965227.483701:0:15978:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff947425974c00/0xe782b916994fea16 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f044f expref: 24 pid: 15978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965227.483741:0:15978:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9474130d6f00) 00010000:00010000:2.0:1783965227.483746:0:15978:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783965227.483750:0:15978:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff947425974c00, rc 0) 00000100:00100000:2.0:1783965227.483857:0:15978:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e610700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2c21b91-f3be-4bc4-8944-f5766379921b+24:14440:x1870622715141248:12345-192.168.204.12@tcp:101:dd.0 Request processed in 1135us (2021us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965227.483867:0:15978:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 36 00000100:00100000:0.0:1783965227.503962:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965227.505127:0:14184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715141504 00000100:00100000:2.0:1783965227.505144:0:14184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715141504 00000100:00100000:2.0:1783965227.505292:0:14184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 2 00000100:00100000:2.0:1783965227.505305:0:14184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743e612680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b2c21b91-f3be-4bc4-8944-f5766379921b+24:14440:x1870622715141504:12345-192.168.204.12@tcp:103:dd.0 00010000:00010000:2.0:1783965227.505328:0:14184:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783965227.505372:0:14184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947425974c00/0xe782b916994fea16 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f044f expref: 24 pid: 15978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965227.505421:0:14184:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9474130d6f00) 00010000:00010000:2.0:1783965227.505428:0:14184:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783965227.505514:0:14184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743e612680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b2c21b91-f3be-4bc4-8944-f5766379921b+23:14440:x1870622715141504:12345-192.168.204.12@tcp:103:dd.0 Request processed in 210us (1566us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965227.505522:0:14184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 2 00000100:00100000:3.0:1783965227.511133:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965227.511509:0:14200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715141632 00000100:00100000:2.0:1783965227.511525:0:14200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715141632 00000100:00100000:2.0:1783965227.511603:0:14200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 37 00000100:00100000:2.0:1783965227.511615:0:14200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9474368d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2c21b91-f3be-4bc4-8944-f5766379921b+23:14440:x1870622715141632:12345-192.168.204.12@tcp:58:dd.0 00010000:00010000:2.0:1783965227.511754:0:14200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff947425974600/0xe782b916994fea1d lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965227.511777:0:14200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947425974600/0xe782b916994fea1d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965227.511791:0:14200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947425974600/0xe782b916994fea1d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14200 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783965227.512756:0:14200:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1783965227.512950:0:14200:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:2.0:1783965227.513048:0:14200:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:2.0:1783965227.513259:0:14200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9474368d6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2c21b91-f3be-4bc4-8944-f5766379921b+23:14440:x1870622715141632:12345-192.168.204.12@tcp:58:dd.0 Request processed in 1583us (2078us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965227.513271:0:14200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 37 00000100:00100000:1.0:1783965227.516269:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965227.518666:0:14201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715141760 00000100:00100000:3.0:1783965227.518687:0:14201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715141760 00000100:00100000:2.0:1783965227.518907:0:15978:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 38 00000100:00100000:2.0:1783965227.518923:0:15978:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743fb98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2c21b91-f3be-4bc4-8944-f5766379921b+23:14440:x1870622715141760:12345-192.168.204.12@tcp:101:dd.0 00010000:00010000:2.0:1783965227.518952:0:15978:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783965227.518998:0:15978:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947425974c00/0xe782b916994fea24 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5f0456 expref: -99 pid: 15978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965227.519074:0:15978:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff947425974600/0xe782b916994fea1d lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965227.519086:0:15978:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff947425974c00/0xe782b916994fea24 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0456 expref: 24 pid: 15978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965227.519109:0:15978:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff947425974600/0xe782b916994fea1d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965227.519124:0:15978:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff947425974c00/0xe782b916994fea24 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0456 expref: 24 pid: 15978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965227.519140:0:15978:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9474130d6f00) 00010000:00010000:2.0:1783965227.519143:0:15978:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783965227.519148:0:15978:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff947425974c00/0xe782b916994fea24 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0456 expref: 24 pid: 15978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965227.519156:0:15978:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff947425974c00, rc 0) 00000100:00100000:2.0:1783965227.519290:0:15978:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743fb98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2c21b91-f3be-4bc4-8944-f5766379921b+24:14440:x1870622715141760:12345-192.168.204.12@tcp:101:dd.0 Request processed in 372us (3038us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965227.519299:0:15978:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 38 00010000:00010000:3.0:1783965227.565437:0:14188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1783965227.947763:0:14233:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1783965227.948616:0:14233:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1783965227.948705:0:14233:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1783965227.948713:0:14233:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1783965227.950104:0:14233:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff9474368d6680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14233:1870622732950272:192.168.204.12@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1783965227.950517:0:14233:0:(client.c:2702:ptlrpc_set_wait()) set ffff947408bc8480 going to sleep for 11 seconds 00000100:00100000:3.0:1783965227.976551:0:14233:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff9474368d6680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14233:1870622732950272:192.168.204.12@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1783965227.984939:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783965227.985147:0:14210:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715141888 00000100:00100000:0.0:1783965227.985162:0:14210:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715141888 00000100:00100000:0.0:1783965227.985271:0:14210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 0 00000100:00100000:0.0:1783965227.985283:0:14210:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743fb98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:b2c21b91-f3be-4bc4-8944-f5766379921b+24:14441:x1870622715141888:12345-192.168.204.12@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1783965227.985408:0:14210:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743fb98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:b2c21b91-f3be-4bc4-8944-f5766379921b+24:14441:x1870622715141888:12345-192.168.204.12@tcp:900:lhsmtool_posix.0 Request processed in 127us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965227.985440:0:14210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 0 00000100:00100000:1.0:1783965228.005843:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965228.005970:0:14200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715142016 00000100:00100000:2.0:1783965228.005982:0:14200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715142016 00000100:00100000:2.0:1783965228.006076:0:14200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 39 00000100:00100000:2.0:1783965228.006090:0:14200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743fb98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2c21b91-f3be-4bc4-8944-f5766379921b+24:14441:x1870622715142016:12345-192.168.204.12@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1783965228.006143:0:14200:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1783965228.006363:0:14200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743fb98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2c21b91-f3be-4bc4-8944-f5766379921b+24:14441:x1870622715142016:12345-192.168.204.12@tcp:53:lhsmtool_posix.0 Request processed in 267us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965228.006372:0:14200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 39 00000100:00080000:0.0:1783965228.006648:0:14195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1783965228.016410:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965228.016728:0:15978:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715142144 00000100:00100000:2.0:1783965228.016743:0:15978:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715142144 00000100:00100000:2.0:1783965228.016823:0:15978:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 40 00000100:00100000:2.0:1783965228.016835:0:15978:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9474368d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2c21b91-f3be-4bc4-8944-f5766379921b+24:14441:x1870622715142144:12345-192.168.204.12@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1783965228.016930:0:15978:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff947425975200/0xe782b916994fea2b lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965228.016951:0:15978:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947425975200/0xe782b916994fea2b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965228.016967:0:15978:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947425975200/0xe782b916994fea2b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965228.018462:0:15978:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff947425975600/0xe782b916994fea32 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965228.018490:0:15978:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947425975600/0xe782b916994fea32 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965228.018502:0:15978:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947425975600/0xe782b916994fea32 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965228.018538:0:15978:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff947425974a00/0xe782b916994fea39 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965228.018546:0:15978:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947425974a00/0xe782b916994fea39 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965228.018551:0:15978:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947425974a00/0xe782b916994fea39 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783965228.018615:0:15978:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1783965228.018621:0:15978:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1783965228.018638:0:15978:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff947425974a00/0xe782b916994fea39 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965228.018650:0:15978:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff947425975200/0xe782b916994fea2b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965228.018656:0:15978:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff947425975200/0xe782b916994fea2b lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965228.018662:0:15978:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff947425975200/0xe782b916994fea2b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965228.018668:0:15978:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947425975200 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1783965228.018672:0:15978:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947425975200/0xe782b916994fea2b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965228.018680:0:15978:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947425975200/0xe782b916994fea2b lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965228.018692:0:15978:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff947402a2da00) 00010000:00010000:2.0:1783965228.018695:0:15978:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783965228.018699:0:15978:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff947425975200/0xe782b916994fea2b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965228.018705:0:15978:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947425975200/0xe782b916994fea2b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965228.018721:0:15978:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff947425975600/0xe782b916994fea32 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965228.018739:0:15978:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff947425975600/0xe782b916994fea32 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965228.018745:0:15978:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff947425975600/0xe782b916994fea32 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965228.018751:0:15978:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947425975600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1783965228.018754:0:15978:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947425975600/0xe782b916994fea32 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965228.018760:0:15978:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947425975600/0xe782b916994fea32 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965228.018769:0:15978:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff947402a2d700) 00010000:00010000:2.0:1783965228.018772:0:15978:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783965228.018774:0:15978:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff947425975600/0xe782b916994fea32 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965228.018779:0:15978:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947425975600/0xe782b916994fea32 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965228.018795:0:15978:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff947425974a00/0xe782b916994fea39 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965228.018800:0:15978:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff947425974a00/0xe782b916994fea39 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965228.018806:0:15978:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff947425974a00/0xe782b916994fea39 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965228.018811:0:15978:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947425974a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1783965228.018819:0:15978:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947425974a00/0xe782b916994fea39 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965228.018826:0:15978:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947425974a00/0xe782b916994fea39 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965228.018833:0:15978:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9474130d6f00) 00010000:00010000:2.0:1783965228.018836:0:15978:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783965228.018838:0:15978:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff947425974a00/0xe782b916994fea39 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965228.018844:0:15978:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947425974a00/0xe782b916994fea39 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783965228.018944:0:15978:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9474368d6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2c21b91-f3be-4bc4-8944-f5766379921b+24:14441:x1870622715142144:12345-192.168.204.12@tcp:34:lhsmtool_posix.0 Request processed in 2107us (2545us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965228.018955:0:15978:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 40 00000100:00100000:3.0:1783965228.028706:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965228.028837:0:14200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715142400 00000100:00100000:2.0:1783965228.028850:0:14200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715142400 00000100:00100000:2.0:1783965228.028927:0:14200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 41 00000100:00100000:2.0:1783965228.028939:0:14200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9474368d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2c21b91-f3be-4bc4-8944-f5766379921b+24:14441:x1870622715142400:12345-192.168.204.12@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783965228.028966:0:14200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783965228.028992:0:14200:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947425974a00/0xe782b916994fea40 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5f045d expref: -99 pid: 14200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965228.029119:0:14200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff947425975600/0xe782b916994fea47 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965228.029155:0:14200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947425975600/0xe782b916994fea47 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965228.029194:0:14200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947425975600/0xe782b916994fea47 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14200 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783965228.029236:0:14200:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1783965228.029521:0:14200:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff947425975600/0xe782b916994fea47 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965228.029529:0:14200:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff947425975600/0xe782b916994fea47 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965228.029536:0:14200:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff947425975600/0xe782b916994fea47 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965228.029543:0:14200:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947425975600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1783965228.029548:0:14200:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947425975600/0xe782b916994fea47 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965228.029555:0:14200:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947425975600/0xe782b916994fea47 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965228.029569:0:14200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9474130d6f00) 00010000:00010000:2.0:1783965228.029572:0:14200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1783965228.029579:0:14200:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff947425975600/0xe782b916994fea47 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965228.029586:0:14200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947425975600/0xe782b916994fea47 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965228.029639:0:14200:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff947425974a00/0xe782b916994fea40 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f045d expref: 26 pid: 14200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965228.029664:0:14200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff947402a2da00) 00010000:00010000:2.0:1783965228.029667:0:14200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1783965228.029672:0:14200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947425974a00/0xe782b916994fea40 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f045d expref: 26 pid: 14200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965228.029683:0:14200:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff947425974a00, rc 0) 00000100:00100000:2.0:1783965228.029896:0:14200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9474368d5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2c21b91-f3be-4bc4-8944-f5766379921b+25:14441:x1870622715142400:12345-192.168.204.12@tcp:101:lhsmtool_posix.0 Request processed in 958us (1203us total) trans 8589934611 rc 301/301 00000100:00100000:2.0:1783965228.029905:0:14200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 41 00000100:00100000:1.0:1783965228.041459:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965228.048494:0:14201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715142528 00000100:00100000:3.0:1783965228.048518:0:14201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715142528 00000100:00100000:3.0:1783965228.048628:0:14201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 42 00000100:00100000:3.0:1783965228.048641:0:14201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743fb99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2c21b91-f3be-4bc4-8944-f5766379921b+25:14441:x1870622715142528:12345-192.168.204.12@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1783965228.048697:0:14201:0:(mdt_handler.c:7961:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1783965228.048855:0:14201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743fb99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2c21b91-f3be-4bc4-8944-f5766379921b+25:14441:x1870622715142528:12345-192.168.204.12@tcp:53:lhsmtool_posix.0 Request processed in 216us (7410us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965228.048864:0:14201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 42 00000100:00100000:3.0:1783965228.051727:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965228.051853:0:14199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715142784 00000100:00100000:1.0:1783965228.051865:0:14199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715142784 00000100:00100000:1.0:1783965228.051941:0:14199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 43 00000100:00100000:1.0:1783965228.051953:0:14199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743fb9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2c21b91-f3be-4bc4-8944-f5766379921b+25:14441:x1870622715142784:12345-192.168.204.12@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783965228.051981:0:14199:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783965228.052013:0:14199:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef600/0xe782b916994fea55 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5f0464 expref: -99 pid: 14199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1783965228.052898:0:14199:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x7:0x0], count =27 00000004:00080000:1.0:1783965228.052910:0:14199:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0x7:0x0]+27 in llog 00000004:00080000:1.0:1783965228.052964:0:14199:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x22:0x0], index 1: 0 00010000:00010000:1.0:1783965228.053346:0:14199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eee00/0xe782b916994fea5c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965228.053392:0:14199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eee00/0xe782b916994fea5c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965228.053408:0:14199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eee00/0xe782b916994fea5c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965228.053493:0:14199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef600/0xe782b916994fea55 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0464 expref: 28 pid: 14199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965228.053524:0:14199:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eee00/0xe782b916994fea5c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0464 expref: 27 pid: 14199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965228.053534:0:14199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff947407b5c200) 00010000:00010000:1.0:1783965228.053537:0:14199:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1783965228.053541:0:14199:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94743d9eee00, rc 0) 00000100:00100000:1.0:1783965228.053639:0:14199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743fb9f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2c21b91-f3be-4bc4-8944-f5766379921b+27:14441:x1870622715142784:12345-192.168.204.12@tcp:101:lhsmtool_posix.0 Request processed in 1686us (1925us total) trans 8589934612 rc 0/0 00000100:00100000:1.0:1783965228.053648:0:14199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 43 00000100:00100000:1.0:1783965228.059928:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965228.060034:0:14201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715143040 00000100:00100000:3.0:1783965228.060046:0:14201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715143040 00000100:00100000:3.0:1783965228.060138:0:14201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 44 00000100:00100000:3.0:1783965228.060149:0:14201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743fb99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2c21b91-f3be-4bc4-8944-f5766379921b+27:14441:x1870622715143040:12345-192.168.204.12@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1783965228.060260:0:14201:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1783965228.060296:0:14201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9eee00/0xe782b916994fea5c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0464 expref: 27 pid: 14199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965228.060328:0:14201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff947407b5c200) 00010000:00010000:3.0:1783965228.060342:0:14201:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1783965228.060383:0:14201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f800/0xe782b916994fea6a lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965228.060400:0:14201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f800/0xe782b916994fea6a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965228.060413:0:14201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f800/0xe782b916994fea6a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965228.060577:0:14201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e000/0xe782b916994fea71 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd3b11d70 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965228.060615:0:14201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e000/0xe782b916994fea71 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd3b11d70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965228.060630:0:14201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e000/0xe782b916994fea71 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd3b11d70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965228.060728:0:14201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f800/0xe782b916994fea6a lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965228.060737:0:14201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f800/0xe782b916994fea6a lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965228.060775:0:14201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f800/0xe782b916994fea6a lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965228.060782:0:14201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743fb8f800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1783965228.060787:0:14201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f800/0xe782b916994fea6a lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965228.060795:0:14201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f800/0xe782b916994fea6a lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965228.060808:0:14201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff947409a45400) 00010000:00010000:3.0:1783965228.060812:0:14201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783965228.060816:0:14201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f800/0xe782b916994fea6a lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965228.060823:0:14201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8f800/0xe782b916994fea6a lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965228.060838:0:14201:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e000/0xe782b916994fea71 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd3b11d70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965228.060843:0:14201:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e000/0xe782b916994fea71 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd3b11d70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965228.060850:0:14201:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e000/0xe782b916994fea71 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd3b11d70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965228.060855:0:14201:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743fb8e000 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:3.0:1783965228.060858:0:14201:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e000/0xe782b916994fea71 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd3b11d70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965228.060875:0:14201:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e000/0xe782b916994fea71 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd3b11d70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965228.060884:0:14201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd3b11d70 (ffff9474130d6700) 00010000:00010000:3.0:1783965228.060886:0:14201:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1783965228.060888:0:14201:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e000/0xe782b916994fea71 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd3b11d70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965228.060894:0:14201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743fb8e000/0xe782b916994fea71 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd3b11d70 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14201 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783965228.061007:0:14201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743fb99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2c21b91-f3be-4bc4-8944-f5766379921b+26:14441:x1870622715143040:12345-192.168.204.12@tcp:36:lhsmtool_posix.0 Request processed in 855us (1089us total) trans 0 rc -2/-2 00000100:00100000:3.0:1783965228.061017:0:14201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 44 00000100:00100000:0.0:1783965228.062826:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965228.062900:0:14199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715143168 00000100:00100000:1.0:1783965228.062915:0:14199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715143168 00000100:00100000:1.0:1783965228.062994:0:14199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 45 00000100:00100000:1.0:1783965228.063016:0:14199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947425979f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2c21b91-f3be-4bc4-8944-f5766379921b+26:14441:x1870622715143168:12345-192.168.204.12@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783965228.063042:0:14199:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783965228.063080:0:14199:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee000/0xe782b916994fea78 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5f046b expref: -99 pid: 14199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965228.063150:0:14199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efe00/0xe782b916994fea7f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965228.063166:0:14199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efe00/0xe782b916994fea7f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965228.063180:0:14199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efe00/0xe782b916994fea7f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965228.063332:0:14199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee000/0xe782b916994fea78 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f046b expref: 28 pid: 14199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965228.063372:0:14199:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9efe00/0xe782b916994fea7f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f046b expref: 27 pid: 14199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965228.063383:0:14199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff947407b5c800) 00010000:00010000:1.0:1783965228.063386:0:14199:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1783965228.063390:0:14199:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94743d9efe00, rc 0) 00000100:00100000:1.0:1783965228.063469:0:14199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947425979f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2c21b91-f3be-4bc4-8944-f5766379921b+27:14441:x1870622715143168:12345-192.168.204.12@tcp:101:lhsmtool_posix.0 Request processed in 465us (650us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965228.063476:0:14199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 45 00000100:00100000:0.0:1783965228.067525:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965228.068133:0:15978:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715143424 00000100:00100000:2.0:1783965228.068148:0:15978:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715143424 00000100:00100000:2.0:1783965228.068262:0:15978:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 46 00000100:00100000:2.0:1783965228.068274:0:15978:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94742597bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2c21b91-f3be-4bc4-8944-f5766379921b+27:14441:x1870622715143424:12345-192.168.204.12@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1783965228.068401:0:15978:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff947425974a00/0xe782b916994fea86 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965228.068424:0:15978:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947425974a00/0xe782b916994fea86 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965228.068440:0:15978:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947425974a00/0xe782b916994fea86 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1783965228.069385:0:15978:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:2.0:1783965228.069401:0:15978:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 462298198646ns, next at 463298195395ns, rc = 0 00000004:00010000:2.0:1783965228.069524:0:15978:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009dc1ca37 reply state 00000000302223bb transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff947425974a00/0xe782b916994fea86 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783965228.069560:0:15978:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1783965228.069697:0:15978:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94742597bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:b2c21b91-f3be-4bc4-8944-f5766379921b+29:14441:x1870622715143424:12345-192.168.204.12@tcp:36:lhsmtool_posix.0 Request processed in 1422us (2184us total) trans 8589934613 rc 0/0 00000100:00100000:2.0:1783965228.069705:0:15978:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 46 00000100:00100000:3.0:1783965228.072252:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00010000:00010000:0.0:1783965228.072634:0:3308:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff947425974a00/0xe782b916994fea86 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965228.072649:0:3308:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff947425974a00/0xe782b916994fea86 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965228.072658:0:3308:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff947425974a00/0xe782b916994fea86 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965228.072665:0:3308:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947425974a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:0.0:1783965228.072670:0:3308:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947425974a00/0xe782b916994fea86 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965228.072680:0:3308:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947425974a00/0xe782b916994fea86 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965228.072702:0:3308:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff947407b5c800) 00010000:00010000:0.0:1783965228.072705:0:3308:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1783965228.072710:0:3308:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff947425974a00/0xe782b916994fea86 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965228.072716:0:3308:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947425974a00/0xe782b916994fea86 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15978 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783965228.073452:0:14199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715143552 00000100:00100000:1.0:1783965228.073469:0:14199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715143552 00000100:00100000:1.0:1783965228.073549:0:14199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 47 00000100:00100000:1.0:1783965228.073563:0:14199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743fb9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2c21b91-f3be-4bc4-8944-f5766379921b+28:14441:x1870622715143552:12345-192.168.204.12@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1783965228.073600:0:14199:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1783965228.073625:0:14199:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef600/0xe782b916994fea8d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5f0472 expref: -99 pid: 14199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965228.073721:0:14199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef600/0xe782b916994fea8d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0472 expref: 29 pid: 14199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965228.073736:0:14199:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef600/0xe782b916994fea8d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0472 expref: 29 pid: 14199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965228.073759:0:14199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff947407b5c800) 00010000:00010000:1.0:1783965228.073761:0:14199:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1783965228.073765:0:14199:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94743d9ef600, rc 0) 00000100:00100000:1.0:1783965228.073848:0:14199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743fb9f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2c21b91-f3be-4bc4-8944-f5766379921b+29:14441:x1870622715143552:12345-192.168.204.12@tcp:101:lhsmtool_posix.0 Request processed in 288us (1608us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965228.073856:0:14199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 47 00000100:00100000:1.0:1783965228.076385:0:3324:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1783965228.076418:0:3324:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947429f47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3324:1870622732950400:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1783965228.076508:0:3324:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783965228.076597:0:14839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732950400 00000100:00100000:2.0:1783965228.076608:0:14839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732950400 00000100:00100000:2.0:1783965228.076685:0:14839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1783965228.076697:0:14839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743fb9b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3324:x1870622732950400:12345-0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1783965228.076715:0:14195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:2.0:1783965228.076745:0:14839:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1783965228.076821:0:14839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743fb9b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3324:x1870622732950400:12345-0@lo:13:osp-pre-0-0.0 Request processed in 127us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965228.076828:0:14839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1783965228.077239:0:3324:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947429f47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3324:1870622732950400:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1783965228.077411:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965228.078110:0:14834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715143680 00000100:00100000:1.0:1783965228.078121:0:14834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715143680 00000100:00100000:3.0:1783965228.078882:0:14837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 12 00000100:00100000:3.0:1783965228.078901:0:14837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743fb9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b2c21b91-f3be-4bc4-8944-f5766379921b+5:2359:x1870622715143680:12345-192.168.204.12@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1783965228.078968:0:14195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783965228.079773:0:14837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743fb9c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b2c21b91-f3be-4bc4-8944-f5766379921b+6:2359:x1870622715143680:12345-192.168.204.12@tcp:2:lhsmtool_posix.0 Request processed in 873us (3204us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1783965228.079785:0:14837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 12 00000100:00100000:0.0:1783965228.089047:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965228.089280:0:14203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715143936 00000100:00100000:1.0:1783965228.089294:0:14203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715143936 00000100:00100000:1.0:1783965228.089379:0:14203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 9 00000100:00100000:1.0:1783965228.089391:0:14203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947425978a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b2c21b91-f3be-4bc4-8944-f5766379921b+29:14441:x1870622715143936:12345-192.168.204.12@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1783965228.089727:0:14203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947425978a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b2c21b91-f3be-4bc4-8944-f5766379921b+30:14441:x1870622715143936:12345-192.168.204.12@tcp:35:lhsmtool_posix.0 Request processed in 337us (696us total) trans 8589934614 rc 0/0 00000100:00100000:1.0:1783965228.089757:0:14203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 9 00000100:00100000:3.0:1783965228.093514:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783965228.093761:0:14201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715144192 00000100:00100000:0.0:1783965228.093849:0:14201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715144192 00000100:00100000:0.0:1783965228.093988:0:14201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 48 00000100:00100000:0.0:1783965228.094001:0:14201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743706ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2c21b91-f3be-4bc4-8944-f5766379921b+30:14441:x1870622715144192:12345-192.168.204.12@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1783965228.094159:0:14201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743706ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2c21b91-f3be-4bc4-8944-f5766379921b+30:14441:x1870622715144192:12345-192.168.204.12@tcp:57:lhsmtool_posix.0 Request processed in 160us (658us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965228.094167:0:14201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 48 00000100:00100000:3.0:1783965228.097381:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965228.097581:0:14200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715144320 00000100:00100000:2.0:1783965228.097594:0:14200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715144320 00000100:00100000:2.0:1783965228.097672:0:14200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 49 00000100:00100000:2.0:1783965228.097684:0:14200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743706c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2c21b91-f3be-4bc4-8944-f5766379921b+30:14441:x1870622715144320:12345-192.168.204.12@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783965228.097711:0:14200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783965228.097738:0:14200:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947425975600/0xe782b916994fea94 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5f0479 expref: -99 pid: 14200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965228.097842:0:14200:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff947425975200/0xe782b916994fea9b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965228.097893:0:14200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947425975200/0xe782b916994fea9b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965228.097908:0:14200:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947425975200/0xe782b916994fea9b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14200 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1783965228.097956:0:14200:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1783965228.097977:0:14200:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff947425975200/0xe782b916994fea9b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965228.098007:0:14200:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947425975600/0xe782b916994fea94 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0479 expref: 32 pid: 14200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965228.098031:0:14200:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff947425975200/0xe782b916994fea9b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0479 expref: 31 pid: 14200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965228.098041:0:14200:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff947407b5c800) 00010000:00010000:2.0:1783965228.098045:0:14200:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1783965228.098049:0:14200:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff947425975200, rc 0) 00000100:00100000:2.0:1783965228.098126:0:14200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743706c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2c21b91-f3be-4bc4-8944-f5766379921b+31:14441:x1870622715144320:12345-192.168.204.12@tcp:101:lhsmtool_posix.0 Request processed in 443us (759us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965228.098134:0:14200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 49 00000100:00100000:1.0:1783965228.101449:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965228.101581:0:16335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715144448 00000100:00100000:2.0:1783965228.101594:0:16335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715144448 00000100:00100000:2.0:1783965228.101753:0:16335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 13 00000100:00100000:2.0:1783965228.101774:0:16335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743fb9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b2c21b91-f3be-4bc4-8944-f5766379921b+6:2359:x1870622715144448:12345-192.168.204.12@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1783965228.101800:0:16335:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1783965228.101846:0:16335:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000021ea5a2f/0xe782b916994feaa2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5f0480 expref: -99 pid: 16335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1783965228.102031:0:16335:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a55262b, blocks: 0x1 00010000:00010000:2.0:1783965228.102059:0:16335:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=462s v=(0 0) 00010000:00010000:2.0:1783965228.102064:0:16335:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783965228.102077:0:16335:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000021ea5a2f/0xe782b916994feaa2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0480 expref: 7 pid: 16335 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965228.102101:0:16335:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000021ea5a2f/0xe782b916994feaa2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0480 expref: 7 pid: 16335 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965228.102118:0:16335:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff947425975800, rc 0) 00000100:00100000:2.0:1783965228.102227:0:16335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743fb9aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b2c21b91-f3be-4bc4-8944-f5766379921b+7:2359:x1870622715144448:12345-192.168.204.12@tcp:101:lhsmtool_posix.0 Request processed in 436us (765us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965228.102237:0:16335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 13 00000100:00100000:3.0:1783965228.105038:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783965228.105140:0:14201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715144704 00000100:00100000:0.0:1783965228.105153:0:14201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715144704 00000100:00100000:0.0:1783965228.105245:0:14201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 50 00000100:00100000:0.0:1783965228.105257:0:14201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743706ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2c21b91-f3be-4bc4-8944-f5766379921b+31:14441:x1870622715144704:12345-192.168.204.12@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1783965228.105409:0:14201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743706ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2c21b91-f3be-4bc4-8944-f5766379921b+31:14441:x1870622715144704:12345-192.168.204.12@tcp:57:lhsmtool_posix.0 Request processed in 152us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1783965228.105417:0:14201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 50 00000100:00100000:0.0:1783965228.108082:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965228.108163:0:14200:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715144832 00000100:00100000:2.0:1783965228.108174:0:14200:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715144832 00000100:00100000:2.0:1783965228.108277:0:14200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 51 00000100:00100000:2.0:1783965228.108289:0:14200:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947425978000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2c21b91-f3be-4bc4-8944-f5766379921b+31:14441:x1870622715144832:12345-192.168.204.12@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1783965228.159282:0:5835:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934605 is committed 00000001:00080000:3.0:1783965228.159308:0:5835:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934598 is committed 00000001:00080000:3.0:1783965228.159333:0:5835:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000001:00080000:3.0:1783965228.159345:0:5835:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000004:00080000:3.0:1783965228.159377:0:5835:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:0.0:1783965228.159780:0:3323:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1783965228.159808:0:3323:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947307dc5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3323:1870622732950528:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1783965228.159913:0:3323:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1783965228.160086:0:16185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732950528 00000100:00100000:1.0:1783965228.160096:0:16185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732950528 00000100:00100000:1.0:1783965228.160169:0:16185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1783965228.160179:0:16185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947425978380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3323:x1870622732950528:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1783965228.160433:0:16185:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:1.0:1783965228.160437:0:16185:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:1.0:1783965228.160440:0:16185:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1783965228.160442:0:16185:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1783965227 -> 1783965227 00002000:00010000:1.0:1783965228.160445:0:16185:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1783965228.160496:0:16185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947425978380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3323:x1870622732950528:12345-0@lo:2:osp-syn-1-0.0 Request processed in 318us (584us total) trans 8589934595 rc 0/0 00000100:00100000:1.0:1783965228.160506:0:16185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:0.0:1783965228.160724:0:14195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:0.0:1783965228.160782:0:3323:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff947307dc5880/2, rc 0, transno 8589934595 00000100:00100000:0.0:1783965228.160803:0:3323:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947307dc5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3323:1870622732950528:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1783965228.161253:0:14200:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947425978000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b2c21b91-f3be-4bc4-8944-f5766379921b+14:14441:x1870622715144832:12345-192.168.204.12@tcp:44:lhsmtool_posix.0 Request processed in 52960us (53180us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965228.161264:0:14200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 51 00000100:00100000:1.0:1783965228.164138:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965228.164260:0:14837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715144960 00000100:00100000:2.0:1783965228.164274:0:14837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715144960 00000100:00100000:2.0:1783965228.164358:0:14837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 15 00000100:00100000:2.0:1783965228.164371:0:14837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436e39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b2c21b91-f3be-4bc4-8944-f5766379921b+7:2360:x1870622715144960:12345-192.168.204.12@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1783965228.164547:0:14837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436e39880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:b2c21b91-f3be-4bc4-8944-f5766379921b+7:2360:x1870622715144960:12345-192.168.204.12@tcp:16:lhsmtool_posix.0 Request processed in 178us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965228.164555:0:14837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 15 00000100:00100000:3.0:1783965228.167485:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783965228.167613:0:14201:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715145216 00000100:00100000:0.0:1783965228.167626:0:14201:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715145216 00000100:00100000:0.0:1783965228.167810:0:14201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 52 00000100:00100000:0.0:1783965228.167823:0:14201:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743706f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2c21b91-f3be-4bc4-8944-f5766379921b+14:14441:x1870622715145216:12345-192.168.204.12@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1783965228.168006:0:14201:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783965228.168045:0:14201:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947425975200/0xe782b916994fea9b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0479 expref: 14 pid: 14200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965228.168081:0:14201:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff947407b5c800) 00010000:00010000:0.0:1783965228.168087:0:14201:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1783965228.168130:0:14201:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff947305c21a00/0xe782b916994feaa9 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965228.168147:0:14201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947305c21a00/0xe782b916994feaa9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965228.168159:0:14201:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff947305c21a00/0xe782b916994feaa9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14201 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1783965228.168480:0:14201:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007041c759 reply state 00000000d3223e0e transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff947305c21a00/0xe782b916994feaa9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14201 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783965228.168491:0:14201:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1783965228.168626:0:14201:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743706f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b2c21b91-f3be-4bc4-8944-f5766379921b+15:14441:x1870622715145216:12345-192.168.204.12@tcp:36:lhsmtool_posix.0 Request processed in 804us (1154us total) trans 8589934615 rc 0/0 00000100:00100000:0.0:1783965228.168634:0:14201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 52 00000100:00100000:1.0:1783965228.171834:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965228.172073:0:16335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715145344 00000100:00100000:3.0:1783965228.172086:0:16335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715145344 00000100:00100000:3.0:1783965228.172158:0:16335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 16 00000100:00100000:3.0:1783965228.172169:0:16335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436e3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b2c21b91-f3be-4bc4-8944-f5766379921b+7:14441:x1870622715145344:12345-192.168.204.12@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1783965228.172193:0:16335:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1783965228.172246:0:16335:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000be4742e3/0xe782b916994feab0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0xae7d4ea09b5f0487 expref: -99 pid: 16335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965228.172286:0:16335:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000021ea5a2f/0xe782b916994feaa2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0480 expref: 8 pid: 16335 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965228.172297:0:16335:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783965228.172303:0:16335:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783965228.172309:0:16335:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000be4742e3/0xe782b916994feab0 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0487 expref: 8 pid: 16335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965228.172364:0:16335:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000021ea5a2f/0xe782b916994feaa2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0480 expref: 8 pid: 16335 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965228.172380:0:16335:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000021ea5a2f/0xe782b916994feaa2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0480 expref: 8 pid: 16335 timeout: 562 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783965228.172398:0:16335:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743706ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:16335:1870622732950656:192.168.204.12@tcp:104: 00000100:00100000:3.0:1783965228.172508:0:16335:0:(client.c:2702:ptlrpc_set_wait()) set ffff9474259409c0 going to sleep for 11 seconds 00010000:00010000:2.0:1783965228.173399:0:3309:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff947305c21a00/0xe782b916994feaa9 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965228.173414:0:3309:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff947305c21a00/0xe782b916994feaa9 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965228.173422:0:3309:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff947305c21a00/0xe782b916994feaa9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965228.173430:0:3309:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947305c21a00 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1783965228.173435:0:3309:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947305c21a00/0xe782b916994feaa9 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965228.173444:0:3309:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947305c21a00/0xe782b916994feaa9 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965228.173465:0:3309:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff947407b5c800) 00010000:00010000:2.0:1783965228.173469:0:3309:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1783965228.173474:0:3309:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff947305c21a00/0xe782b916994feaa9 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14201 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965228.173481:0:3309:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947305c21a00/0xe782b916994feaa9 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14201 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783965228.176318:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965228.176456:0:16335:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743706ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_004:lustre-OST0001_UUID:16335:1870622732950656:192.168.204.12@tcp:104: 00010000:00010000:3.0:1783965228.176504:0:16335:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000be4742e3/0xe782b916994feab0 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0487 expref: 8 pid: 16335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965228.176550:0:16335:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff94743fb8e000, rc 0) 00000100:00100000:3.0:1783965228.176629:0:16335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436e3ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:b2c21b91-f3be-4bc4-8944-f5766379921b+8:14441:x1870622715145344:12345-192.168.204.12@tcp:101:lhsmtool_posix.0 Request processed in 4461us (4809us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965228.176640:0:16335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 16 00000100:00100000:0.0:1783965228.176892:0:14185:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715145472 00000100:00100000:0.0:1783965228.176901:0:14185:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715145472 00010000:00010000:0.0:1783965228.176947:0:14185:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000021ea5a2f/0xe782b916994feaa2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0480 expref: 8 pid: 16335 timeout: 562 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783965228.176988:0:14185:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 13 00000100:00100000:0.0:1783965228.176999:0:14185:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436e38380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b2c21b91-f3be-4bc4-8944-f5766379921b+8:2360:x1870622715145472:12345-192.168.204.12@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1783965228.177017:0:14185:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1783965228.177045:0:14185:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000021ea5a2f/0xe782b916994feaa2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0480 expref: 8 pid: 16335 timeout: 562 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965228.177066:0:14185:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000021ea5a2f/0xe782b916994feaa2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0480 expref: 8 pid: 16335 timeout: 562 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965228.177095:0:14185:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000021ea5a2f/0xe782b916994feaa2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0480 expref: 8 pid: 16335 timeout: 562 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965228.177114:0:14185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783965228.177120:0:14185:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783965228.177128:0:14185:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000be4742e3/0xe782b916994feab0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0487 expref: 7 pid: 16335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965228.177140:0:14185:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000be4742e3/0xe782b916994feab0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0487 expref: 7 pid: 16335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965228.177186:0:14185:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000be4742e3/0xe782b916994feab0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0487 expref: 7 pid: 16335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783965228.177234:0:14185:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94742597a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:14185:1870622732950784:192.168.204.12@tcp:105: 00000100:00100000:0.0:1783965228.177304:0:14185:0:(client.c:2702:ptlrpc_set_wait()) set ffff9474258aab40 going to sleep for 11 seconds 00000100:00100000:1.0:1783965228.180531:0:14185:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94742597a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:14185:1870622732950784:192.168.204.12@tcp:105: 00010000:00010000:1.0:1783965228.180568:0:14185:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783965228.180648:0:14185:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436e38380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:b2c21b91-f3be-4bc4-8944-f5766379921b+7:2360:x1870622715145472:12345-192.168.204.12@tcp:103:ldlm_bl.0 Request processed in 3649us (4344us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965228.180662:0:14185:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 13 00000100:00100000:1.0:1783965228.185189:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965228.185398:0:14834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715145600 00000100:00100000:2.0:1783965228.185422:0:14834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715145600 00000100:00100000:2.0:1783965228.185500:0:14834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 17 00000100:00100000:2.0:1783965228.185512:0:14834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436e38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b2c21b91-f3be-4bc4-8944-f5766379921b+7:2360:x1870622715145600:12345-192.168.204.12@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1783965228.185829:0:14834:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1783965228.185834:0:14834:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1783965227 00002000:00010000:2.0:1783965228.185837:0:14834:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 1783965226 00002000:00010000:2.0:1783965228.185839:0:14834:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1783965227 -> 1783965227 00002000:00010000:2.0:1783965228.185842:0:14834:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1783965228.185930:0:14834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436e38e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b2c21b91-f3be-4bc4-8944-f5766379921b+8:2360:x1870622715145600:12345-192.168.204.12@tcp:2:lhsmtool_posix.0 Request processed in 419us (754us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1783965228.185938:0:14834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 17 00000100:00100000:0.0:1783965228.189150:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965228.189337:0:14835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715145728 00000100:00100000:3.0:1783965228.189359:0:14835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715145728 00000100:00100000:3.0:1783965228.189434:0:14835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 18 00000100:00100000:3.0:1783965228.189446:0:14835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94742597b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b2c21b91-f3be-4bc4-8944-f5766379921b+8:2358:x1870622715145728:12345-192.168.204.12@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1783965228.189511:0:14835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c2001aa9/0xe782b916994feab7 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965228.189539:0:14835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000be4742e3/0xe782b916994feab0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0487 expref: 8 pid: 16335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965228.189551:0:14835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1783965228.189557:0:14835:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1783965228.189561:0:14835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2001aa9/0xe782b916994feab7 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965228.189608:0:14835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000be4742e3/0xe782b916994feab0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0487 expref: 8 pid: 16335 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965228.189625:0:14835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000be4742e3/0xe782b916994feab0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0487 expref: 8 pid: 16335 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783965228.189667:0:14835:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743706ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:14835:1870622732950912:192.168.204.12@tcp:104: 00000100:00100000:3.0:1783965228.189821:0:14835:0:(client.c:2702:ptlrpc_set_wait()) set ffff9474259409c0 going to sleep for 11 seconds 00000100:00100000:3.0:1783965228.192997:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783965228.193271:0:14835:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743706ca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:14835:1870622732950912:192.168.204.12@tcp:104: 00010000:00010000:0.0:1783965228.193308:0:14835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000c2001aa9/0xe782b916994feab7 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783965228.193559:0:14184:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715145856 00000100:00100000:2.0:1783965228.193570:0:14184:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715145856 00010000:00010000:2.0:1783965228.193628:0:14184:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000be4742e3/0xe782b916994feab0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0487 expref: 9 pid: 16335 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783965228.193676:0:14184:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 14 00000100:00100000:2.0:1783965228.193687:0:14184:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743706f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b2c21b91-f3be-4bc4-8944-f5766379921b+9:2359:x1870622715145856:12345-192.168.204.12@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1783965228.193709:0:14184:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1783965228.193755:0:14184:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000be4742e3/0xe782b916994feab0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0487 expref: 9 pid: 16335 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965228.193780:0:14184:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000be4742e3/0xe782b916994feab0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0487 expref: 9 pid: 16335 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965228.193811:0:14184:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000be4742e3/0xe782b916994feab0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0487 expref: 9 pid: 16335 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965228.193848:0:14184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783965228.193853:0:14184:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1783965228.193861:0:14184:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c2001aa9/0xe782b916994feab7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965228.194018:0:14184:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c2001aa9/0xe782b916994feab7 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965228.194056:0:14184:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1783965228.194135:0:14184:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743706f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b2c21b91-f3be-4bc4-8944-f5766379921b+8:2359:x1870622715145856:12345-192.168.204.12@tcp:103:ldlm_bl.0 Request processed in 449us (1152us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965228.194145:0:14184:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 14 00010000:00010000:3.0:1783965228.195086:0:14835:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000c2001aa9/0xe782b916994feab7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965228.195104:0:14835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c2001aa9/0xe782b916994feab7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965228.195139:0:14835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000c2001aa9/0xe782b916994feab7 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965228.195147:0:14835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c2001aa9/0xe782b916994feab7 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965228.195155:0:14835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c2001aa9/0xe782b916994feab7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965228.195161:0:14835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743fb8f800 already unused, calling callback (ffffffffc168d230) 00010000:00010000:3.0:1783965228.195166:0:14835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2001aa9/0xe782b916994feab7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965228.195175:0:14835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c2001aa9/0xe782b916994feab7 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965228.195250:0:14835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c2001aa9/0xe782b916994feab7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965228.195260:0:14835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c2001aa9/0xe782b916994feab7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783965228.195341:0:14835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94742597b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b2c21b91-f3be-4bc4-8944-f5766379921b+7:2358:x1870622715145728:12345-192.168.204.12@tcp:1:lhsmtool_posix.0 Request processed in 5895us (6207us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965228.195361:0:14835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 18 00000100:00100000:3.0:1783965228.198921:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965228.199093:0:14199:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715146112 00000100:00100000:1.0:1783965228.199107:0:14199:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715146112 00000100:00100000:1.0:1783965228.199181:0:14199:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 53 00000100:00100000:1.0:1783965228.199253:0:14199:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743706c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2c21b91-f3be-4bc4-8944-f5766379921b+14:14441:x1870622715146112:12345-192.168.204.12@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1783965228.199391:0:14199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994feabe lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965228.199426:0:14199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994feabe lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965228.199442:0:14199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994feabe lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965228.200061:0:14199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee600/0xe782b916994feac5 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965228.200079:0:14199:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef600/0xe782b916994fea8d lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0472 expref: 15 pid: 14199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965228.200088:0:14199:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee600/0xe782b916994feac5 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965228.200138:0:14199:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef600/0xe782b916994fea8d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0472 expref: 15 pid: 14199 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965228.200158:0:14199:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef600/0xe782b916994fea8d lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0472 expref: 15 pid: 14199 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783965228.200180:0:14199:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947436e3b800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14199:1870622732951040:192.168.204.12@tcp:104: 00000100:00100000:1.0:1783965228.200315:0:14199:0:(client.c:2702:ptlrpc_set_wait()) set ffff947410edf0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1783965228.203491:0:14199:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947436e3b800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14199:1870622732951040:192.168.204.12@tcp:104: 00010000:00010000:1.0:1783965228.203552:0:14199:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee600/0xe782b916994feac5 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14199 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783965228.204572:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965228.205150:0:14186:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715146240 00000100:00100000:1.0:1783965228.205162:0:14186:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715146240 00010000:00010000:1.0:1783965228.205264:0:14186:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef600/0xe782b916994fea8d lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0472 expref: 16 pid: 14199 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783965228.205308:0:14186:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 15 00000100:00100000:1.0:1783965228.205321:0:14186:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743706ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b2c21b91-f3be-4bc4-8944-f5766379921b+16:2360:x1870622715146240:12345-192.168.204.12@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1783965228.205340:0:14186:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1783965228.205359:0:14186:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef600/0xe782b916994fea8d lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0472 expref: 16 pid: 14199 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965228.205373:0:14186:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef600/0xe782b916994fea8d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0472 expref: 16 pid: 14199 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965228.205400:0:14186:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef600/0xe782b916994fea8d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0472 expref: 16 pid: 14199 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965228.205439:0:14186:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff947407b5c800) 00010000:00010000:1.0:1783965228.205444:0:14186:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee600/0xe782b916994feac5 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965228.205458:0:14186:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee600/0xe782b916994feac5 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965228.205467:0:14186:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee600/0xe782b916994feac5 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965228.205512:0:14186:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1783965228.205604:0:14186:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743706ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:b2c21b91-f3be-4bc4-8944-f5766379921b+15:2360:x1870622715146240:12345-192.168.204.12@tcp:103:ldlm_bl.0 Request processed in 286us (1039us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965228.205613:0:14186:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 15 00010000:00010000:2.0:1783965228.206131:0:14199:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee600/0xe782b916994feac5 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965228.206142:0:14199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee600/0xe782b916994feac5 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14199 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1783965228.206435:0:14199:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:2.0:1783965228.206619:0:14199:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:2.0:1783965228.206667:0:14199:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:2.0:1783965228.206800:0:14199:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947429f44000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14199:1870622732951168:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1783965228.207692:0:14199:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783965228.207745:0:14199:0:(client.c:2702:ptlrpc_set_wait()) set ffff947425854f00 going to sleep for 11 seconds 00000100:00100000:1.0:1783965228.209087:0:14204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732951168 00000100:00100000:1.0:1783965228.209105:0:14204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732951168 00000100:00100000:1.0:1783965228.209164:0:14204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1783965228.209174:0:14204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947429f46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14199:x1870622732951168:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1783965228.209403:0:14204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947429f46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14199:x1870622732951168:12345-0@lo:1000:mdt00_000.0 Request processed in 230us (1718us total) trans 0 rc 0/0 00000100:00100000:1.0:1783965228.209411:0:14204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1783965228.209608:0:14199:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947429f44000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14199:1870622732951168:0@lo:1000:mdt00_000.0 00000001:00080000:2.0:1783965228.213036:0:14199:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:2.0:1783965228.213177:0:14199:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947429f44000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14199:1870622732951296:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1783965228.213283:0:14199:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783965228.213336:0:14199:0:(client.c:2702:ptlrpc_set_wait()) set ffff947403777480 going to sleep for 11 seconds 00000100:00100000:1.0:1783965228.213436:0:14204:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732951296 00000100:00100000:1.0:1783965228.213453:0:14204:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732951296 00000100:00100000:1.0:1783965228.213544:0:14204:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1783965228.213556:0:14204:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947429f46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14199:x1870622732951296:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1783965228.213899:0:14204:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947429f46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:14199:x1870622732951296:12345-0@lo:1000:mdt00_000.0 Request processed in 345us (615us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1783965228.213909:0:14204:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1783965228.214089:0:14199:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947429f44000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:14199:1870622732951296:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1783965228.214144:0:14199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee600/0xe782b916994feac5 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965228.214156:0:14199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee600/0xe782b916994feac5 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965228.214164:0:14199:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee600/0xe782b916994feac5 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965228.214171:0:14199:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743d9ee600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1783965228.214175:0:14199:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee600/0xe782b916994feac5 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965228.214184:0:14199:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee600/0xe782b916994feac5 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965228.214760:0:14199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff947407b5c800) 00010000:00010000:2.0:1783965228.214765:0:14199:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783965228.214772:0:14199:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee600/0xe782b916994feac5 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965228.214780:0:14199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee600/0xe782b916994feac5 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965228.214969:0:14199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff947425974600/0xe782b916994fea1d lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965228.214977:0:14199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff947425974600/0xe782b916994fea1d lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965228.215000:0:14199:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff947425974600/0xe782b916994fea1d lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965228.215006:0:14199:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947425974600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:2.0:1783965228.215009:0:14199:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947425974600/0xe782b916994fea1d lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965228.215016:0:14199:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff947425974600/0xe782b916994fea1d lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 14200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965228.215027:0:14199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9474130d6f00) 00010000:00010000:2.0:1783965228.215029:0:14199:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1783965228.215038:0:14199:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff947425974c00/0xe782b916994fea24 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0456 expref: 18 pid: 15978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965228.215050:0:14199:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff947425974c00/0xe782b916994fea24 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0456 expref: 18 pid: 15978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965228.215058:0:14199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff947425974c00/0xe782b916994fea24 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0456 expref: 18 pid: 15978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965228.215128:0:14199:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff947425974c00/0xe782b916994fea24 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.204.12@tcp remote: 0xae7d4ea09b5f0456 expref: 18 pid: 15978 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783965228.215143:0:14199:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff947429f47800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14199:1870622732951424:192.168.204.12@tcp:105: 00000100:00100000:2.0:1783965228.215293:0:14199:0:(client.c:2702:ptlrpc_set_wait()) set ffff947403777480 going to sleep for 11 seconds 00000100:00100000:1.0:1783965228.227144:0:14199:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff947429f47800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14199:1870622732951424:192.168.204.12@tcp:105: 00010000:00010000:1.0:1783965228.227195:0:14199:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff947425974600/0xe782b916994fea1d lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965228.227251:0:14199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff947425974600/0xe782b916994fea1d lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14200 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965228.227301:0:14199:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef600/0xe782b916994feacc lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965228.227319:0:14199:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef600/0xe782b916994feacc lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965228.227360:0:14199:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef600/0xe782b916994feacc lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965228.227374:0:14199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef600/0xe782b916994feacc lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965228.227381:0:14199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef600/0xe782b916994feacc lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965228.227388:0:14199:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef600/0xe782b916994feacc lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965228.227394:0:14199:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743d9ef600 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1783965228.227399:0:14199:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef600/0xe782b916994feacc lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965228.227406:0:14199:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef600/0xe782b916994feacc lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965228.227421:0:14199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9474130d6f00) 00010000:00010000:1.0:1783965228.227424:0:14199:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1783965228.227428:0:14199:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef600/0xe782b916994feacc lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965228.227433:0:14199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ef600/0xe782b916994feacc lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965228.227452:0:14199:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994feabe lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965228.227457:0:14199:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994feabe lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965228.227469:0:14199:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994feabe lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965228.227474:0:14199:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743d9ee800 already unused, calling callback (ffffffffc20cb4f0) 00010000:00010000:1.0:1783965228.227476:0:14199:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994feabe lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965228.227483:0:14199:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994feabe lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965228.227490:0:14199:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9474130d6f00) 00010000:00010000:1.0:1783965228.227493:0:14199:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1783965228.227496:0:14199:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994feabe lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14199 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965228.227501:0:14199:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee800/0xe782b916994feabe lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14199 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783965228.228037:0:14199:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743706c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b2c21b91-f3be-4bc4-8944-f5766379921b+18:14441:x1870622715146112:12345-192.168.204.12@tcp:57:lhsmtool_posix.0 Request processed in 28784us (29127us total) trans 8589934620 rc 0/0 00000100:00100000:1.0:1783965228.228051:0:14199:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 53 00000020:00080000:1.0:1783965228.228062:0:14199:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1783965228.230599:0:14233:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1783965228.230608:0:14233:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1783965228.230668:0:14233:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1783965228.230675:0:14233:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1783965228.232854:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965228.232940:0:14202:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715146368 00000100:00100000:2.0:1783965228.232950:0:14202:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715146368 00000100:00100000:2.0:1783965228.233014:0:14202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 10 00000100:00100000:2.0:1783965228.233024:0:14202:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947304be4050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b2c21b91-f3be-4bc4-8944-f5766379921b+18:14440:x1870622715146368:12345-192.168.204.12@tcp:49:dd.0 00000100:00100000:2.0:1783965228.233158:0:14202:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947304be4050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b2c21b91-f3be-4bc4-8944-f5766379921b+18:14440:x1870622715146368:12345-192.168.204.12@tcp:49:dd.0 Request processed in 135us (312us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965228.233166:0:14202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 10 00000100:00100000:0.0:1783965228.234009:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:1.0:1783965228.234074:0:14203:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715146624 00000100:00100000:1.0:1783965228.234089:0:14203:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715146624 00000100:00100000:1.0:1783965228.234163:0:14203:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 11 00000100:00100000:1.0:1783965228.234174:0:14203:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947425978700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b2c21b91-f3be-4bc4-8944-f5766379921b+18:14441:x1870622715146624:12345-192.168.204.12@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1783965228.235066:0:14203:0:(mdd_object.c:4016:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1783965228.235198:0:14203:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:1.0:1783965228.235292:0:14203:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee400/0xe782b916994fead3 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965228.235315:0:14203:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee400/0xe782b916994fead3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965228.235329:0:14203:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee400/0xe782b916994fead3 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965228.235337:0:14203:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee400/0xe782b916994fead3 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965228.235344:0:14203:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee400/0xe782b916994fead3 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965228.235362:0:14203:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee400/0xe782b916994fead3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965228.235388:0:14203:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1783965228.235526:0:14203:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947425978700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b2c21b91-f3be-4bc4-8944-f5766379921b+20:14441:x1870622715146624:12345-192.168.204.12@tcp:35:lhsmtool_posix.0 Request processed in 1349us (1514us total) trans 8589934622 rc 0/0 00000100:00100000:1.0:1783965228.235537:0:14203:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 11 00000020:00080000:1.0:1783965228.235543:0:14203:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1783965228.236926:0:14187:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1783965228.236940:0:14187:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee400/0xe782b916994fead3 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965228.236952:0:14187:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743d9ee400 already unused, calling callback (ffffffffc168d230) 00010000:00010000:3.0:1783965228.236957:0:14187:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee400/0xe782b916994fead3 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965228.236967:0:14187:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee400/0xe782b916994fead3 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965228.236989:0:14187:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff947407b5c800) 00010000:00010000:3.0:1783965228.237010:0:14187:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1783965228.237015:0:14187:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee400/0xe782b916994fead3 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965228.237022:0:14187:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff94743d9ee400/0xe782b916994fead3 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14203 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965228.237054:0:14187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783965228.237058:0:14187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1783965228.237060:0:14187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783965228.416383:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965228.416434:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:0.0:1783965228.416653:0:14841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715146752 00000100:00100000:0.0:1783965228.416671:0:14841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715146752 00000100:00100000:0.0:1783965228.416767:0:14841:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715146880 00000100:00100000:0.0:1783965228.416771:0:14841:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715146880 00000100:00100000:0.0:1783965228.416799:0:14841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 0 00000100:00100000:0.0:1783965228.416811:0:14841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743648ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b2c21b91-f3be-4bc4-8944-f5766379921b+8:2357:x1870622715146752:12345-192.168.204.12@tcp:4:dd.0 00002000:00010000:0.0:1783965228.416887:0:14841:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x6a55262b, atime: 0x6a55262a, ctime: 0x6a55262b, blocks: 0x1 00010000:00010000:0.0:1783965228.416899:0:14841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000008167805/0xe782b916994feada lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965228.416922:0:14841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=462s v=(0 0) 00010000:00010000:0.0:1783965228.416927:0:14841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783965228.416937:0:14841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000008167805/0xe782b916994feada lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965228.416954:0:14841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000008167805/0xe782b916994feada lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783965228.421970:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:3.0:1783965228.427633:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965228.428000:0:14842:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:1.0:1783965228.435449:0:14840:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1783965228.436365:0:3315:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965228.440836:0:14842:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:2.0:1783965228.441522:0:14842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715147008 00000100:00100000:2.0:1783965228.441536:0:14842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715147008 00000100:00100000:2.0:1783965228.441609:0:14842:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1783965228.441619:0:14842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715147136 00000100:00100000:2.0:1783965228.441623:0:14842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715147136 00000100:00100000:2.0:1783965228.442177:0:16339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 1 00000100:00100000:2.0:1783965228.442197:0:16339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743648ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b2c21b91-f3be-4bc4-8944-f5766379921b+11:2357:x1870622715146880:12345-192.168.204.12@tcp:4:dd.0 00010000:00010000:2.0:1783965228.442307:0:16339:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fce2584e/0xe782b916994feae1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965228.442325:0:16339:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783965228.442329:0:16339:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783965228.442335:0:16339:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fce2584e/0xe782b916994feae1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965228.442358:0:16339:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fce2584e/0xe782b916994feae1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783965228.442543:0:14840:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00000100:00100000:1.0:1783965228.444092:0:16340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 2 00000100:00100000:1.0:1783965228.444113:0:16340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947425979880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b2c21b91-f3be-4bc4-8944-f5766379921b+12:2358:x1870622715147008:12345-192.168.204.12@tcp:4:dd.0 00010000:00010000:1.0:1783965228.444164:0:16340:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ec951ad7/0xe782b916994feae8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965228.444187:0:16340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783965228.444198:0:16340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783965228.444231:0:16340:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ec951ad7/0xe782b916994feae8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965228.444247:0:16340:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ec951ad7/0xe782b916994feae8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1783965228.449113:0:14842:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:2.0:1783965228.449134:0:14842:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_005' 00000100:00100000:1.0:1783965228.462110:0:3316:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965228.462710:0:14842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715147264 00000100:00100000:2.0:1783965228.462740:0:14842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715147264 00000100:00100000:2.0:1783965228.462807:0:14842:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:2.0:1783965228.462816:0:14842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715147392 00000100:00100000:2.0:1783965228.462819:0:14842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715147392 00000100:00100000:2.0:1783965228.463066:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965228.463094:0:14842:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:2.0:1783965228.463101:0:14842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715147520 00000100:00100000:2.0:1783965228.463106:0:14842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715147520 00000100:00100000:2.0:1783965228.463183:0:3317:0:(events.c:340:request_in_callback()) peer: 12345-192.168.204.12@tcp (source: 12345-192.168.204.12@tcp) 00000100:00100000:2.0:1783965228.463221:0:14842:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:2.0:1783965228.463233:0:14842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622715147648 00000100:00100000:2.0:1783965228.463237:0:14842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622715147648 00000100:00100000:1.0:1783965228.474927:0:16341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 3 00000100:00100000:1.0:1783965228.474967:0:16341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743648df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b2c21b91-f3be-4bc4-8944-f5766379921b+17:2358:x1870622715147136:12345-192.168.204.12@tcp:4:dd.0 00010000:00010000:1.0:1783965228.475031:0:16341:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bdc85d1d/0xe782b916994feaef lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965228.475055:0:16341:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783965228.475061:0:16341:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783965228.475072:0:16341:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bdc85d1d/0xe782b916994feaef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965228.475092:0:16341:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bdc85d1d/0xe782b916994feaef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965228.587437:0:15786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1783965228.591542:0:16340:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 4194304 00002000:00010000:2.0:1783965228.591557:0:16340:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 1783965227 -> 1783965228 00002000:00010000:2.0:1783965228.591561:0:16340:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1783965227 -> 1783965228 00002000:00010000:2.0:1783965228.591563:0:16340:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 6151 00010000:00010000:2.0:1783965228.591580:0:16340:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ec951ad7/0xe782b916994feae8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965228.591597:0:16340:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ec951ad7/0xe782b916994feae8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965228.591608:0:16340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ec951ad7/0xe782b916994feae8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965228.591616:0:16340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743d9ee800 already unused, calling callback (ffffffffc168d230) 00010000:00010000:2.0:1783965228.591622:0:16340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ec951ad7/0xe782b916994feae8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965228.591632:0:16340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ec951ad7/0xe782b916994feae8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965228.591668:0:16340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ec951ad7/0xe782b916994feae8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965228.591676:0:16340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ec951ad7/0xe782b916994feae8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965228.591857:0:16339:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fce2584e/0xe782b916994feae1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965228.591867:0:16339:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fce2584e/0xe782b916994feae1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965228.591887:0:16339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fce2584e/0xe782b916994feae1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965228.591894:0:16339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947425975600 already unused, calling callback (ffffffffc168d230) 00010000:00010000:1.0:1783965228.591897:0:16339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fce2584e/0xe782b916994feae1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965228.591905:0:16339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fce2584e/0xe782b916994feae1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965228.591918:0:16339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fce2584e/0xe782b916994feae1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965228.591926:0:16339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fce2584e/0xe782b916994feae1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783965228.592013:0:16339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743648ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b2c21b91-f3be-4bc4-8944-f5766379921b+24:2357:x1870622715146880:12345-192.168.204.12@tcp:4:dd.0 Request processed in 149817us (175570us total) trans 8589934599 rc 0/0 00000100:00100000:1.0:1783965228.592026:0:16339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 1 00000100:00100000:1.0:1783965228.592071:0:16339:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 4 00000100:00100000:1.0:1783965228.592095:0:16339:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743648c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b2c21b91-f3be-4bc4-8944-f5766379921b+23:2357:x1870622715147264:12345-192.168.204.12@tcp:4:dd.0 00010000:00010000:1.0:1783965228.592141:0:16339:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000b7b285e/0xe782b916994feaf6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965228.592155:0:16339:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783965228.592168:0:16339:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783965228.592175:0:16339:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000b7b285e/0xe782b916994feaf6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965228.592190:0:16339:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000b7b285e/0xe782b916994feaf6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1783965228.592320:0:7523:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00000001:00080000:1.0:1783965228.592338:0:7523:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934600 is committed 00000001:00080000:1.0:1783965228.592361:0:7523:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934597 is committed 00000100:00100000:2.0:1783965228.592639:0:16340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947425979880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b2c21b91-f3be-4bc4-8944-f5766379921b+15:2358:x1870622715147008:12345-192.168.204.12@tcp:4:dd.0 Request processed in 148531us (170683us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1783965228.592648:0:16340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 2 00000100:00100000:2.0:1783965228.592670:0:16340:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 5 00000100:00100000:2.0:1783965228.592678:0:16340:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947436e3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b2c21b91-f3be-4bc4-8944-f5766379921b+14:2357:x1870622715147392:12345-192.168.204.12@tcp:4:dd.0 00010000:00010000:2.0:1783965228.592699:0:16340:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fa0f3a54/0xe782b916994feafd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965228.592709:0:16340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783965228.592713:0:16340:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1783965228.592717:0:16340:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fa0f3a54/0xe782b916994feafd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1783965228.592728:0:16340:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fa0f3a54/0xe782b916994feafd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965228.592940:0:14841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000008167805/0xe782b916994feada lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965228.592951:0:14841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000008167805/0xe782b916994feada lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965228.592977:0:14841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000008167805/0xe782b916994feada lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965228.592985:0:14841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947305c20e00 already unused, calling callback (ffffffffc168d230) 00010000:00010000:0.0:1783965228.592988:0:14841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000008167805/0xe782b916994feada lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965228.592997:0:14841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000008167805/0xe782b916994feada lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965228.593012:0:14841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000008167805/0xe782b916994feada lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965228.593019:0:14841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000008167805/0xe782b916994feada lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783965228.593062:0:14841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743648ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b2c21b91-f3be-4bc4-8944-f5766379921b+13:2357:x1870622715146752:12345-192.168.204.12@tcp:4:dd.0 Request processed in 176254us (176691us total) trans 8589934598 rc 0/0 00000100:00100000:0.0:1783965228.593070:0:14841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 0 00000100:00100000:0.0:1783965228.593088:0:14841:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 6 00000100:00100000:0.0:1783965228.593096:0:14841:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947429f46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b2c21b91-f3be-4bc4-8944-f5766379921b+12:2357:x1870622715147520:12345-192.168.204.12@tcp:4:dd.0 00010000:00010000:0.0:1783965228.593116:0:14841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c915d388/0xe782b916994feb04 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965228.593123:0:14841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783965228.593131:0:14841:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1783965228.593136:0:14841:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c915d388/0xe782b916994feb04 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965228.593145:0:14841:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c915d388/0xe782b916994feb04 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783965228.668864:0:7523:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934601 is committed 00002000:00010000:1.0:1783965228.669531:0:16341:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 4194304 -> 7340032 00002000:00010000:1.0:1783965228.669538:0:16341:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 6151 -> 8199 00010000:00010000:1.0:1783965228.669557:0:16341:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bdc85d1d/0xe782b916994feaef lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965228.669574:0:16341:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bdc85d1d/0xe782b916994feaef lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965228.669584:0:16341:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bdc85d1d/0xe782b916994feaef lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965228.669593:0:16341:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743d9ee000 already unused, calling callback (ffffffffc168d230) 00010000:00010000:1.0:1783965228.669599:0:16341:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bdc85d1d/0xe782b916994feaef lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965228.669611:0:16341:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bdc85d1d/0xe782b916994feaef lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965228.669657:0:16341:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bdc85d1d/0xe782b916994feaef lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965228.669664:0:16341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bdc85d1d/0xe782b916994feaef lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783965228.670015:0:16341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743648df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b2c21b91-f3be-4bc4-8944-f5766379921b+18:2358:x1870622715147136:12345-192.168.204.12@tcp:4:dd.0 Request processed in 195065us (242391us total) trans 8589934601 rc 0/0 00000100:00100000:1.0:1783965228.670029:0:16341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 3 00000100:00100000:1.0:1783965228.670072:0:16341:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.204.12@tcp, seq: 7 00000100:00100000:1.0:1783965228.670097:0:16341:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947429f45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b2c21b91-f3be-4bc4-8944-f5766379921b+17:2357:x1870622715147648:12345-192.168.204.12@tcp:4:dd.0 00010000:00010000:1.0:1783965228.670150:0:16341:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ec951ad7/0xe782b916994feb0b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965228.670169:0:16341:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783965228.670174:0:16341:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1783965228.670183:0:16341:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ec951ad7/0xe782b916994feb0b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965228.670197:0:16341:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ec951ad7/0xe782b916994feb0b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1783965228.778570:0:7523:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934604 is committed 00002000:00010000:0.0:1783965228.786116:0:14841:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 7340032 -> 7654321 00002000:00010000:0.0:1783965228.786133:0:14841:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 8199 -> 16391 00010000:00010000:0.0:1783965228.786155:0:14841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c915d388/0xe782b916994feb04 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965228.786174:0:14841:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c915d388/0xe782b916994feb04 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965228.786185:0:14841:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c915d388/0xe782b916994feb04 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965228.786192:0:14841:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947305c21e00 already unused, calling callback (ffffffffc168d230) 00010000:00010000:0.0:1783965228.786198:0:14841:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c915d388/0xe782b916994feb04 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965228.786242:0:14841:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c915d388/0xe782b916994feb04 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965228.786272:0:14841:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c915d388/0xe782b916994feb04 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1783965228.786318:0:14841:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c915d388/0xe782b916994feb04 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1783965228.786471:0:14841:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947429f46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:b2c21b91-f3be-4bc4-8944-f5766379921b+15:2357:x1870622715147520:12345-192.168.204.12@tcp:4:dd.0 Request processed in 193366us (323403us total) trans 8589934602 rc 0/0 00000100:00100000:0.0:1783965228.786484:0:14841:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 6 00010000:00010000:1.0:1783965228.792175:0:16339:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000b7b285e/0xe782b916994feaf6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965228.792254:0:16339:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000b7b285e/0xe782b916994feaf6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965228.792263:0:16339:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000b7b285e/0xe782b916994feaf6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965228.792270:0:16339:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743d9eee00 already unused, calling callback (ffffffffc168d230) 00010000:00010000:1.0:1783965228.792275:0:16339:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000b7b285e/0xe782b916994feaf6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965228.792284:0:16339:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000b7b285e/0xe782b916994feaf6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965228.792305:0:16339:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000b7b285e/0xe782b916994feaf6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965228.792312:0:16339:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000b7b285e/0xe782b916994feaf6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16339 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783965228.792444:0:16339:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743648c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:b2c21b91-f3be-4bc4-8944-f5766379921b+11:2357:x1870622715147264:12345-192.168.204.12@tcp:4:dd.0 Request processed in 200358us (356097us total) trans 8589934604 rc 0/0 00000100:00100000:1.0:1783965228.792455:0:16339:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 4 00010000:00010000:3.0:1783965228.792944:0:16340:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fa0f3a54/0xe782b916994feafd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965228.792965:0:16340:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fa0f3a54/0xe782b916994feafd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965228.792974:0:16340:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fa0f3a54/0xe782b916994feafd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965228.792983:0:16340:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff947425974600 already unused, calling callback (ffffffffc168d230) 00010000:00010000:3.0:1783965228.792987:0:16340:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fa0f3a54/0xe782b916994feafd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965228.792996:0:16340:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fa0f3a54/0xe782b916994feafd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965228.793034:0:16340:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fa0f3a54/0xe782b916994feafd lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1783965228.793041:0:16340:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fa0f3a54/0xe782b916994feafd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16340 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1783965228.793136:0:16340:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947436e3b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:b2c21b91-f3be-4bc4-8944-f5766379921b+9:2357:x1870622715147392:12345-192.168.204.12@tcp:4:dd.0 Request processed in 200453us (331037us total) trans 8589934603 rc 0/0 00000100:00100000:3.0:1783965228.793153:0:16340:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 5 00000001:00080000:2.0:1783965228.829243:0:7523:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934605 is committed 00010000:00010000:1.0:1783965228.829968:0:16341:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ec951ad7/0xe782b916994feb0b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965228.830002:0:16341:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ec951ad7/0xe782b916994feb0b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965228.830012:0:16341:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ec951ad7/0xe782b916994feb0b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965228.830019:0:16341:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff94743d9ee800 already unused, calling callback (ffffffffc168d230) 00010000:00010000:1.0:1783965228.830024:0:16341:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ec951ad7/0xe782b916994feb0b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965228.830035:0:16341:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ec951ad7/0xe782b916994feb0b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965228.830056:0:16341:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ec951ad7/0xe782b916994feb0b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1783965228.830066:0:16341:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ec951ad7/0xe782b916994feb0b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16341 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1783965228.830296:0:16341:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947429f45c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:b2c21b91-f3be-4bc4-8944-f5766379921b+5:2357:x1870622715147648:12345-192.168.204.12@tcp:4:dd.0 Request processed in 160208us (367107us total) trans 8589934605 rc 0/0 00000100:00100000:1.0:1783965228.830307:0:16341:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.204.12@tcp, seq: 7 00000040:00080000:3.0:1783965229.291571:0:14233:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1783965229.291580:0:14233:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1783965229.291610:0:14233:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1783965229.291616:0:14233:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:3.0:1783965229.611610:0:14188:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1783965230.124083:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743648f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3325:1870622732951808:0@lo:400:kworker.0 00000100:00100000:3.0:1783965230.124164:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783965230.124253:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743648d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3322:1870622732951936:0@lo:400:kworker.0 00000100:00100000:3.0:1783965230.124262:0:3325:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1783965230.124267:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743648ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3325:1870622732951680:0@lo:400:kworker.0 00000100:00100000:3.0:1783965230.124291:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783965230.124302:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1783965230.124326:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743648d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3325:1870622732952192:0@lo:400:kworker.0 00000100:00100000:2.0:1783965230.124331:0:3322:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1783965230.124337:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743648f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:72a5858e-0958-4c77-91cf-d6507b930817:3322:1870622732951552:0@lo:400:kworker.0 00000100:00100000:3.0:1783965230.124352:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783965230.124363:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783965230.124382:0:3322:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743648f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3322:1870622732952064:0@lo:400:kworker.0 00000100:00100000:3.0:1783965230.124385:0:16335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732951808 00000100:00100000:3.0:1783965230.124392:0:16335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732951808 00000100:00100000:2.0:1783965230.124402:0:3322:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783965230.124426:0:15978:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732951936 00000100:00100000:2.0:1783965230.124430:0:15978:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732951936 00000100:00100000:3.0:1783965230.124440:0:16335:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732951680 00000100:00100000:3.0:1783965230.124442:0:16335:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732951680 00000100:00100000:2.0:1783965230.124451:0:15978:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732952192 00000100:00100000:2.0:1783965230.124454:0:15978:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732952192 00000100:00100000:2.0:1783965230.124466:0:15978:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732952064 00000100:00100000:3.0:1783965230.124467:0:16335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1783965230.124468:0:15978:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732952064 00000100:00100000:2.0:1783965230.124480:0:15978:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1783965230.124481:0:16335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743648c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3325:x1870622732951808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783965230.124485:0:15978:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947429f46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3322:x1870622732951936:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783965230.124528:0:16335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743648c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3325:x1870622732951808:12345-0@lo:400:kworker.0 Request processed in 48us (363us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965230.124528:0:15978:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947429f46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3322:x1870622732951936:12345-0@lo:400:kworker.0 Request processed in 41us (225us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965230.124536:0:16335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1783965230.124536:0:15978:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1783965230.124554:0:16335:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1783965230.124554:0:15978:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1783965230.124560:0:16335:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743648dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3325:x1870622732951680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783965230.124560:0:15978:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743648e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3325:x1870622732952192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783965230.124584:0:16335:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743648dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_004:lustre-MDT0000-mdtlov_UUID+5:3325:x1870622732951680:12345-0@lo:400:kworker.0 Request processed in 26us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1783965230.124584:0:15978:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743648e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3325:x1870622732952192:12345-0@lo:400:kworker.0 Request processed in 25us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965230.124591:0:16335:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1783965230.124591:0:15978:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1783965230.124602:0:15978:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1783965230.124608:0:15978:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff947429f45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3322:x1870622732952064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1783965230.124633:0:15978:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff947429f45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3322:x1870622732952064:12345-0@lo:400:kworker.0 Request processed in 25us (229us total) trans 0 rc 0/0 00000100:00080000:3.0:1783965230.124636:0:14195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1783965230.124641:0:14195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1783965230.124643:0:14195:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1783965230.124648:0:15978:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1783965230.124658:0:3325:0:(client.c:1906:ptlrpc_send_new_req()) Sending RPC req@ffff94743648ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3325:1870622732952320:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1783965230.124664:0:14194:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732951552 00000100:00100000:2.0:1783965230.124668:0:14194:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732951552 00000100:00100000:3.0:1783965230.124682:0:3325:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1783965230.124688:0:14194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:2.0:1783965230.124693:0:14194:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94741cd56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72a5858e-0958-4c77-91cf-d6507b930817+19:3322:x1870622732951552:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1783965230.124714:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743648ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3325:1870622732951680:0@lo:400:kworker.0 00000100:00100000:2.0:1783965230.124718:0:14194:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94741cd56850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:72a5858e-0958-4c77-91cf-d6507b930817+19:3322:x1870622732951552:12345-0@lo:400:kworker.0 Request processed in 26us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965230.124724:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743648d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3325:1870622732952192:0@lo:400:kworker.0 00000100:00100000:2.0:1783965230.124724:0:14194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1783965230.124730:0:3325:0:(client.c:3112:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:3.0:1783965230.124735:0:3325:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff947307dc5880, transno 8589934595 00000004:00080000:3.0:1783965230.124745:0:3325:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:2.0:1783965230.124756:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743648f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:72a5858e-0958-4c77-91cf-d6507b930817:3322:1870622732951552:0@lo:400:kworker.0 00000100:00100000:3.0:1783965230.124760:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743648f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3325:1870622732951808:0@lo:400:kworker.0 00000100:00100000:2.0:1783965230.124765:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743648f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3322:1870622732952064:0@lo:400:kworker.0 00000100:00100000:2.0:1783965230.124772:0:3322:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743648d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3322:1870622732951936:0@lo:400:kworker.0 00000100:00100000:3.0:1783965230.124784:0:14838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1870622732952320 00000100:00100000:3.0:1783965230.124787:0:14838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1870622732952320 00000100:00100000:3.0:1783965230.125512:0:14838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1783965230.125522:0:14838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff94743648fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3325:x1870622732952320:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1783965230.125552:0:14838:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3407872 granted 71499776 pending 0 free 3851419648 avail 3849322496 00000100:00100000:3.0:1783965230.125605:0:14838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff94743648fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3325:x1870622732952320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (922us total) trans 0 rc 0/0 00000100:00100000:3.0:1783965230.125611:0:14838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1783965230.126673:0:3325:0:(client.c:2401:ptlrpc_check_set()) Completed RPC req@ffff94743648ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3325:1870622732952320:0@lo:13:osp-pre-1-0.0 00000001:02000400:2.0:1783965230.445806:0:16379:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:1.0:1783965230.635660:0:14187:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1783965231.662073:0:15786:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 29310 lines, 29310 kept, 0 dropped, 0 bad.